2023-06-23T00:46:07.916 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-23T00:46:07.918 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} --name yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916/orig.config.yaml 2023-06-23T00:46:07.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:46:08.053 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916 branch: wip-yuri4-testing-2023-06-21-0846-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} email: yweinste@redhat.com first_in_suite: false job_id: '7311916' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri4-testing-2023-06-21-0846-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - Error loading MDS rank - missing journal object - Error recovering journal - error decoding table object - failed to read JournalPointer - Corrupt directory entry - Corrupt fnode header - corrupt sessionmap header - Corrupt dentry - Scrub error on inode - Metadata damage detected - MDS_READ_ONLY - force file system read-only - with standby daemon mds sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2023-06-21-0846-quincy sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9037 sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri4-testing-2023-06-21-0846-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c targets: smithi097.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi149.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_damage teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 076bbebc42a14f7d568aaa78eabb0038327bcb23 timestamp: 2023-06-22_15:25:25 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-23T00:46:08.054 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa; will attempt to use it 2023-06-23T00:46:08.054 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks 2023-06-23T00:46:08.055 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-23T00:46:08.058 INFO:teuthology.task.internal:Checking packages... 2023-06-23T00:46:08.086 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '42ddc46e6e6582d8e29a5a982a81886fe028be2c' 2023-06-23T00:46:08.087 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-23T00:46:08.087 INFO:teuthology.packaging:ref: None 2023-06-23T00:46:08.087 INFO:teuthology.packaging:tag: None 2023-06-23T00:46:08.087 INFO:teuthology.packaging:branch: wip-yuri4-testing-2023-06-21-0846-quincy 2023-06-23T00:46:08.088 INFO:teuthology.packaging:sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-23T00:46:08.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri4-testing-2023-06-21-0846-quincy 2023-06-23T00:46:08.230 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-719-g42ddc46e-1focal 2023-06-23T00:46:08.231 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-23T00:46:08.237 INFO:teuthology.task.internal:no buildpackages task found 2023-06-23T00:46:08.237 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-23T00:46:08.250 INFO:teuthology.task.internal:Saving configuration 2023-06-23T00:46:08.266 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-23T00:46:08.275 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T00:46:08.305 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:40:14.936087', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-23T00:46:08.330 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:40:14.937979', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-23T00:46:08.331 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-23T00:46:08.336 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-23T00:46:08.337 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-23T00:46:08.337 INFO:teuthology.run_tasks:Running task console_log... 2023-06-23T00:46:08.430 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6c0bd89040>, signals=[15]) 2023-06-23T00:46:08.433 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-23T00:46:08.442 INFO:teuthology.task.internal:Opening connections... 2023-06-23T00:46:08.442 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2023-06-23T00:46:08.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:46:08.500 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2023-06-23T00:46:08.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:46:08.550 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-23T00:46:08.557 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2023-06-23T00:46:08.582 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2023-06-23T00:46:08.584 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-06-23T00:46:08.629 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2023-06-23T00:46:08.629 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-23T00:46:08.629 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2023-06-23T00:46:08.630 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2023-06-23T00:46:08.630 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-23T00:46:08.630 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="20.04" 2023-06-23T00:46:08.630 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T00:46:08.630 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T00:46:08.630 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T00:46:08.630 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T00:46:08.630 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=focal 2023-06-23T00:46:08.631 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=focal 2023-06-23T00:46:08.631 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-06-23T00:46:08.658 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-06-23T00:46:08.667 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-06-23T00:46:08.667 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-06-23T00:46:08.714 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-06-23T00:46:08.715 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-23T00:46:08.715 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-06-23T00:46:08.715 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-06-23T00:46:08.715 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-23T00:46:08.715 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-06-23T00:46:08.715 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T00:46:08.715 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T00:46:08.716 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T00:46:08.716 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T00:46:08.716 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-06-23T00:46:08.716 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-06-23T00:46:08.716 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-06-23T00:46:08.750 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-23T00:46:08.759 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-23T00:46:08.770 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-23T00:46:08.770 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2023-06-23T00:46:08.773 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2023-06-23T00:46:08.778 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-23T00:46:08.792 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-23T00:46:08.792 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2023-06-23T00:46:08.795 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2023-06-23T00:46:08.816 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-23T00:46:08.881 INFO:teuthology.run_tasks:Running task kernel... 2023-06-23T00:46:08.896 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-06-23T00:46:08.897 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-06-23T00:46:08.897 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T00:46:08.898 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T00:46:08.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T00:46:08.904 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2023-06-23T00:46:08.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T00:46:08.905 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2023-06-23T00:46:08.911 INFO:teuthology.orchestra.run.smithi097.stdout:5.4.0-124-generic 2023-06-23T00:46:08.911 INFO:teuthology.task.kernel:Running kernel on smithi097: 5.4.0-124-generic 2023-06-23T00:46:08.912 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2023-06-23T00:46:08.912 INFO:teuthology.orchestra.run.smithi149.stdout:5.4.0-124-generic 2023-06-23T00:46:08.913 INFO:teuthology.task.kernel:Running kernel on smithi149: 5.4.0-124-generic 2023-06-23T00:46:08.913 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get clean 2023-06-23T00:46:09.055 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get update 2023-06-23T00:46:09.057 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2023-06-23T00:46:09.208 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-23T00:46:09.209 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-06-23T00:46:09.209 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-06-23T00:46:09.223 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-23T00:46:09.223 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-06-23T00:46:09.223 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-06-23T00:46:09.273 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-06-23T00:46:09.288 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-06-23T00:46:09.588 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [613 kB] 2023-06-23T00:46:09.610 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,267 kB] 2023-06-23T00:46:09.665 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,267 kB] 2023-06-23T00:46:09.712 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [362 kB] 2023-06-23T00:46:09.712 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.0 kB] 2023-06-23T00:46:09.713 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,885 kB] 2023-06-23T00:46:09.722 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [30.3 kB] 2023-06-23T00:46:09.722 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [264 kB] 2023-06-23T00:46:09.724 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [640 B] 2023-06-23T00:46:09.724 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [603 kB] 2023-06-23T00:46:09.725 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [613 kB] 2023-06-23T00:46:09.729 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [849 kB] 2023-06-23T00:46:09.730 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,648 kB] 2023-06-23T00:46:09.740 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [362 kB] 2023-06-23T00:46:09.741 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.0 kB] 2023-06-23T00:46:09.741 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [30.3 kB] 2023-06-23T00:46:09.742 INFO:teuthology.orchestra.run.smithi149.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,885 kB] 2023-06-23T00:46:09.755 INFO:teuthology.orchestra.run.smithi149.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [264 kB] 2023-06-23T00:46:09.756 INFO:teuthology.orchestra.run.smithi149.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [640 B] 2023-06-23T00:46:09.757 INFO:teuthology.orchestra.run.smithi149.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [849 kB] 2023-06-23T00:46:09.758 INFO:teuthology.orchestra.run.smithi149.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [844 kB] 2023-06-23T00:46:09.763 INFO:teuthology.orchestra.run.smithi149.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [603 kB] 2023-06-23T00:46:09.770 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [176 kB] 2023-06-23T00:46:09.802 INFO:teuthology.orchestra.run.smithi149.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [176 kB] 2023-06-23T00:46:09.825 INFO:teuthology.orchestra.run.smithi149.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,648 kB] 2023-06-23T00:46:09.825 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [844 kB] 2023-06-23T00:46:09.837 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [444 kB] 2023-06-23T00:46:09.840 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.9 kB] 2023-06-23T00:46:09.841 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,994 kB] 2023-06-23T00:46:09.853 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [31.6 kB] 2023-06-23T00:46:09.854 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [18.6 kB] 2023-06-23T00:46:09.854 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [280 kB] 2023-06-23T00:46:09.854 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2023-06-23T00:46:09.855 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [22.9 kB] 2023-06-23T00:46:09.855 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [636 B] 2023-06-23T00:46:09.856 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,488 B] 2023-06-23T00:46:09.857 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2023-06-23T00:46:09.862 INFO:teuthology.orchestra.run.smithi149.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [444 kB] 2023-06-23T00:46:09.864 INFO:teuthology.orchestra.run.smithi149.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.9 kB] 2023-06-23T00:46:09.864 INFO:teuthology.orchestra.run.smithi149.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,994 kB] 2023-06-23T00:46:09.877 INFO:teuthology.orchestra.run.smithi149.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [31.6 kB] 2023-06-23T00:46:09.877 INFO:teuthology.orchestra.run.smithi149.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [280 kB] 2023-06-23T00:46:09.879 INFO:teuthology.orchestra.run.smithi149.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [636 B] 2023-06-23T00:46:09.886 INFO:teuthology.orchestra.run.smithi149.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [18.6 kB] 2023-06-23T00:46:09.887 INFO:teuthology.orchestra.run.smithi149.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [22.9 kB] 2023-06-23T00:46:09.888 INFO:teuthology.orchestra.run.smithi149.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2023-06-23T00:46:09.889 INFO:teuthology.orchestra.run.smithi149.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,488 B] 2023-06-23T00:46:09.889 INFO:teuthology.orchestra.run.smithi149.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2023-06-23T00:46:09.890 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,074 kB] 2023-06-23T00:46:09.914 INFO:teuthology.orchestra.run.smithi149.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,074 kB] 2023-06-23T00:46:10.023 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [733 kB] 2023-06-23T00:46:10.033 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [256 kB] 2023-06-23T00:46:10.035 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.1 kB] 2023-06-23T00:46:10.035 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-06-23T00:46:10.036 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-06-23T00:46:10.036 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-06-23T00:46:10.040 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [612 B] 2023-06-23T00:46:10.040 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-06-23T00:46:10.041 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-06-23T00:46:10.041 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-06-23T00:46:10.045 INFO:teuthology.orchestra.run.smithi149.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [733 kB] 2023-06-23T00:46:10.054 INFO:teuthology.orchestra.run.smithi149.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [256 kB] 2023-06-23T00:46:10.058 INFO:teuthology.orchestra.run.smithi149.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.1 kB] 2023-06-23T00:46:10.058 INFO:teuthology.orchestra.run.smithi149.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-06-23T00:46:10.059 INFO:teuthology.orchestra.run.smithi149.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-06-23T00:46:10.059 INFO:teuthology.orchestra.run.smithi149.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-06-23T00:46:10.059 INFO:teuthology.orchestra.run.smithi149.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [612 B] 2023-06-23T00:46:10.059 INFO:teuthology.orchestra.run.smithi149.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-06-23T00:46:10.062 INFO:teuthology.orchestra.run.smithi149.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-06-23T00:46:10.062 INFO:teuthology.orchestra.run.smithi149.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-06-23T00:46:10.077 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-06-23T00:46:10.096 INFO:teuthology.orchestra.run.smithi149.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-06-23T00:46:10.111 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-06-23T00:46:10.121 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-06-23T00:46:10.130 INFO:teuthology.orchestra.run.smithi149.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-06-23T00:46:10.141 INFO:teuthology.orchestra.run.smithi149.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-06-23T00:46:13.395 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 16.0 MB in 2s (6,945 kB/s) 2023-06-23T00:46:13.668 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 16.0 MB in 2s (6,810 kB/s) 2023-06-23T00:46:14.836 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2023-06-23T00:46:14.859 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T00:46:14.933 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2023-06-23T00:46:15.126 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2023-06-23T00:46:15.127 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2023-06-23T00:46:15.130 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-23T00:46:15.155 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T00:46:15.231 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-23T00:46:15.314 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2023-06-23T00:46:15.314 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-5.4.0-152 linux-headers-5.4.0-152-generic 2023-06-23T00:46:15.315 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-generic linux-image-5.4.0-152-generic 2023-06-23T00:46:15.316 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-5.4.0-152-generic linux-modules-extra-5.4.0-152-generic 2023-06-23T00:46:15.316 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2023-06-23T00:46:15.316 INFO:teuthology.orchestra.run.smithi097.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-06-23T00:46:15.317 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2023-06-23T00:46:15.317 INFO:teuthology.orchestra.run.smithi097.stdout: thermald 2023-06-23T00:46:15.371 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2023-06-23T00:46:15.371 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-5.4.0-152 linux-headers-5.4.0-152-generic 2023-06-23T00:46:15.371 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-152-generic linux-modules-5.4.0-152-generic 2023-06-23T00:46:15.372 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-extra-5.4.0-152-generic 2023-06-23T00:46:15.373 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2023-06-23T00:46:15.373 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-23T00:46:15.425 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2023-06-23T00:46:15.425 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2023-06-23T00:46:15.426 INFO:teuthology.orchestra.run.smithi097.stdout:3 upgraded, 5 newly installed, 0 to remove and 223 not upgraded. 2023-06-23T00:46:15.426 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 77.1 MB of archives. 2023-06-23T00:46:15.426 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 380 MB of additional disk space will be used. 2023-06-23T00:46:15.426 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-152-generic amd64 5.4.0-152.169 [15.0 MB] 2023-06-23T00:46:15.604 INFO:teuthology.orchestra.run.smithi149.stdout:The following additional packages will be installed: 2023-06-23T00:46:15.605 INFO:teuthology.orchestra.run.smithi149.stdout: linux-generic linux-headers-5.4.0-152 linux-headers-5.4.0-152-generic 2023-06-23T00:46:15.605 INFO:teuthology.orchestra.run.smithi149.stdout: linux-headers-generic linux-image-5.4.0-152-generic 2023-06-23T00:46:15.605 INFO:teuthology.orchestra.run.smithi149.stdout: linux-modules-5.4.0-152-generic linux-modules-extra-5.4.0-152-generic 2023-06-23T00:46:15.606 INFO:teuthology.orchestra.run.smithi149.stdout:Suggested packages: 2023-06-23T00:46:15.606 INFO:teuthology.orchestra.run.smithi149.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-06-23T00:46:15.606 INFO:teuthology.orchestra.run.smithi149.stdout:Recommended packages: 2023-06-23T00:46:15.606 INFO:teuthology.orchestra.run.smithi149.stdout: thermald 2023-06-23T00:46:15.666 INFO:teuthology.orchestra.run.smithi149.stdout:The following NEW packages will be installed: 2023-06-23T00:46:15.667 INFO:teuthology.orchestra.run.smithi149.stdout: linux-headers-5.4.0-152 linux-headers-5.4.0-152-generic 2023-06-23T00:46:15.667 INFO:teuthology.orchestra.run.smithi149.stdout: linux-image-5.4.0-152-generic linux-modules-5.4.0-152-generic 2023-06-23T00:46:15.667 INFO:teuthology.orchestra.run.smithi149.stdout: linux-modules-extra-5.4.0-152-generic 2023-06-23T00:46:15.668 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages will be upgraded: 2023-06-23T00:46:15.668 INFO:teuthology.orchestra.run.smithi149.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-23T00:46:15.719 INFO:teuthology.orchestra.run.smithi149.stdout:3 upgraded, 5 newly installed, 0 to remove and 223 not upgraded. 2023-06-23T00:46:15.720 INFO:teuthology.orchestra.run.smithi149.stdout:Need to get 77.1 MB of archives. 2023-06-23T00:46:15.720 INFO:teuthology.orchestra.run.smithi149.stdout:After this operation, 380 MB of additional disk space will be used. 2023-06-23T00:46:15.720 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-152-generic amd64 5.4.0-152.169 [15.0 MB] 2023-06-23T00:46:15.758 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-152-generic amd64 5.4.0-152.169 [10.5 MB] 2023-06-23T00:46:15.850 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-152-generic amd64 5.4.0-152.169 [39.2 MB] 2023-06-23T00:46:16.045 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-152-generic amd64 5.4.0-152.169 [10.5 MB] 2023-06-23T00:46:16.135 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-152-generic amd64 5.4.0-152.169 [39.2 MB] 2023-06-23T00:46:16.309 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.152.149 [1,900 B] 2023-06-23T00:46:16.310 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.152.149 [2,596 B] 2023-06-23T00:46:16.310 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-152 all 5.4.0-152.169 [11.0 MB] 2023-06-23T00:46:16.508 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-152-generic amd64 5.4.0-152.169 [1,362 kB] 2023-06-23T00:46:16.526 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.152.149 [2,464 B] 2023-06-23T00:46:16.592 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.152.149 [1,900 B] 2023-06-23T00:46:16.592 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.152.149 [2,596 B] 2023-06-23T00:46:16.593 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-152 all 5.4.0-152.169 [11.0 MB] 2023-06-23T00:46:16.684 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-152-generic amd64 5.4.0-152.169 [1,362 kB] 2023-06-23T00:46:16.694 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.152.149 [2,464 B] 2023-06-23T00:46:17.210 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 77.1 MB in 1s (67.3 MB/s) 2023-06-23T00:46:17.428 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-5.4.0-152-generic. 2023-06-23T00:46:17.433 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 77.1 MB in 1s (75.7 MB/s) 2023-06-23T00:46:17.634 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-modules-5.4.0-152-generic. 2023-06-23T00:46:19.167 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-06-23T00:46:19.172 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../0-linux-modules-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T00:46:19.325 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:19.367 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-06-23T00:46:19.372 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../0-linux-modules-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T00:46:19.548 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-modules-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:21.350 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-image-5.4.0-152-generic. 2023-06-23T00:46:21.366 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../1-linux-image-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T00:46:21.469 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:21.656 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-image-5.4.0-152-generic. 2023-06-23T00:46:21.670 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../1-linux-image-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T00:46:21.782 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:22.595 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-152-generic. 2023-06-23T00:46:22.608 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T00:46:22.653 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-extra-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:22.893 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-152-generic. 2023-06-23T00:46:22.906 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T00:46:22.951 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-modules-extra-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:27.614 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../3-linux-generic_5.4.0.152.149_amd64.deb ... 2023-06-23T00:46:27.766 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-23T00:46:27.878 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../3-linux-generic_5.4.0.152.149_amd64.deb ... 2023-06-23T00:46:28.022 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-23T00:46:28.127 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.152.149_amd64.deb ... 2023-06-23T00:46:28.277 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-23T00:46:28.412 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.152.149_amd64.deb ... 2023-06-23T00:46:28.542 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-image-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-23T00:46:28.633 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.4.0-152. 2023-06-23T00:46:28.648 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../5-linux-headers-5.4.0-152_5.4.0-152.169_all.deb ... 2023-06-23T00:46:28.691 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.4.0-152 (5.4.0-152.169) ... 2023-06-23T00:46:28.912 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-headers-5.4.0-152. 2023-06-23T00:46:28.926 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../5-linux-headers-5.4.0-152_5.4.0-152.169_all.deb ... 2023-06-23T00:46:28.970 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-headers-5.4.0-152 (5.4.0-152.169) ... 2023-06-23T00:46:34.540 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.4.0-152-generic. 2023-06-23T00:46:34.562 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../6-linux-headers-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T00:46:34.607 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:34.736 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-headers-5.4.0-152-generic. 2023-06-23T00:46:34.758 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../6-linux-headers-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T00:46:34.802 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-headers-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:38.672 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.152.149_amd64.deb ... 2023-06-23T00:46:38.708 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.152.149_amd64.deb ... 2023-06-23T00:46:38.820 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-headers-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-23T00:46:38.855 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-23T00:46:39.171 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-headers-5.4.0-152 (5.4.0-152.169) ... 2023-06-23T00:46:39.206 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.4.0-152 (5.4.0-152.169) ... 2023-06-23T00:46:39.317 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-headers-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:39.351 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:39.467 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-modules-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:39.479 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:40.669 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:40.756 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:41.833 INFO:teuthology.orchestra.run.smithi149.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-152-generic 2023-06-23T00:46:41.833 INFO:teuthology.orchestra.run.smithi149.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-152-generic 2023-06-23T00:46:41.928 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-152-generic 2023-06-23T00:46:41.929 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-152-generic 2023-06-23T00:46:41.988 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-headers-generic (5.4.0.152.149) ... 2023-06-23T00:46:42.067 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-generic (5.4.0.152.149) ... 2023-06-23T00:46:42.564 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-modules-extra-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:43.076 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-extra-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:44.233 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-image-generic (5.4.0.152.149) ... 2023-06-23T00:46:44.295 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-generic (5.4.0.152.149) ... 2023-06-23T00:46:44.384 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-generic (5.4.0.152.149) ... 2023-06-23T00:46:44.446 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-generic (5.4.0.152.149) ... 2023-06-23T00:46:44.535 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:44.572 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T00:46:44.619 INFO:teuthology.orchestra.run.smithi149.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-23T00:46:44.619 INFO:teuthology.orchestra.run.smithi149.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-152-generic 2023-06-23T00:46:44.649 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-23T00:46:44.649 INFO:teuthology.orchestra.run.smithi097.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-152-generic 2023-06-23T00:47:06.892 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-23T00:47:06.892 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub' 2023-06-23T00:47:06.899 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T00:47:06.927 INFO:teuthology.orchestra.run.smithi097.stdout:Generating grub configuration file ... 2023-06-23T00:47:07.137 INFO:teuthology.orchestra.run.smithi149.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-23T00:47:07.138 INFO:teuthology.orchestra.run.smithi149.stdout:Sourcing file `/etc/default/grub' 2023-06-23T00:47:07.160 INFO:teuthology.orchestra.run.smithi149.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T00:47:07.181 INFO:teuthology.orchestra.run.smithi149.stdout:Generating grub configuration file ... 2023-06-23T00:47:07.250 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.4.0-152-generic 2023-06-23T00:47:07.275 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.4.0-152-generic 2023-06-23T00:47:07.542 INFO:teuthology.orchestra.run.smithi149.stdout:Found linux image: /boot/vmlinuz-5.4.0-152-generic 2023-06-23T00:47:07.564 INFO:teuthology.orchestra.run.smithi149.stdout:Found initrd image: /boot/initrd.img-5.4.0-152-generic 2023-06-23T00:47:07.706 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-23T00:47:07.718 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-23T00:47:08.014 INFO:teuthology.orchestra.run.smithi149.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-23T00:47:08.026 INFO:teuthology.orchestra.run.smithi149.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-23T00:47:10.461 INFO:teuthology.orchestra.run.smithi097.stdout:done 2023-06-23T00:47:10.800 INFO:teuthology.orchestra.run.smithi149.stdout:done 2023-06-23T00:47:10.915 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2023-06-23T00:47:10.966 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2023-06-23T00:47:10.982 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2023-06-23T00:47:10.982 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2023-06-23T00:47:10.982 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2023-06-23T00:47:10.983 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 19 2023-06-23T00:47:10.983 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T00:47:10.983 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2023-06-23T00:47:10.983 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2023-06-23T00:47:10.983 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.4.0.152.149 2023-06-23T00:47:10.983 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-06-23T00:47:10.983 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.4.0-152-generic, linux-modules-extra-5.4.0-152-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T00:47:10.984 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2023-06-23T00:47:10.984 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2023-06-23T00:47:10.984 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2023-06-23T00:47:10.984 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2023-06-23T00:47:10.984 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-152-generic 2023-06-23T00:47:10.985 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-23T00:47:10.985 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-23T00:47:10.985 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-06-23T00:47:10.985 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=None, version=distro) 2023-06-23T00:47:10.986 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2023-06-23T00:47:11.064 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2023-06-23T00:47:11.225 DEBUG:teuthology.orchestra.run.smithi149:> dpkg -s linux-image-generic 2023-06-23T00:47:11.273 INFO:teuthology.orchestra.run.smithi149.stdout:Package: linux-image-generic 2023-06-23T00:47:11.273 INFO:teuthology.orchestra.run.smithi149.stdout:Status: install ok installed 2023-06-23T00:47:11.273 INFO:teuthology.orchestra.run.smithi149.stdout:Priority: optional 2023-06-23T00:47:11.274 INFO:teuthology.orchestra.run.smithi149.stdout:Section: kernel 2023-06-23T00:47:11.274 INFO:teuthology.orchestra.run.smithi149.stdout:Installed-Size: 19 2023-06-23T00:47:11.274 INFO:teuthology.orchestra.run.smithi149.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T00:47:11.274 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: amd64 2023-06-23T00:47:11.274 INFO:teuthology.orchestra.run.smithi149.stdout:Source: linux-meta 2023-06-23T00:47:11.274 INFO:teuthology.orchestra.run.smithi149.stdout:Version: 5.4.0.152.149 2023-06-23T00:47:11.274 INFO:teuthology.orchestra.run.smithi149.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-06-23T00:47:11.275 INFO:teuthology.orchestra.run.smithi149.stdout:Depends: linux-image-5.4.0-152-generic, linux-modules-extra-5.4.0-152-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T00:47:11.275 INFO:teuthology.orchestra.run.smithi149.stdout:Recommends: thermald 2023-06-23T00:47:11.275 INFO:teuthology.orchestra.run.smithi149.stdout:Description: Generic Linux kernel image 2023-06-23T00:47:11.275 INFO:teuthology.orchestra.run.smithi149.stdout: This package will always depend on the latest generic kernel image 2023-06-23T00:47:11.275 INFO:teuthology.orchestra.run.smithi149.stdout: available. 2023-06-23T00:47:11.276 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-152-generic 2023-06-23T00:47:11.276 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-23T00:47:11.276 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-23T00:47:11.276 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-06-23T00:47:11.277 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=None, version=distro) 2023-06-23T00:47:11.277 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get clean 2023-06-23T00:47:11.343 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-23T00:47:11.344 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-06-23T00:47:11.398 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get update 2023-06-23T00:47:11.414 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-06-23T00:47:11.536 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-23T00:47:11.542 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-06-23T00:47:11.613 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-06-23T00:47:11.655 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-06-23T00:47:11.757 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-06-23T00:47:12.151 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 336 kB in 1s (377 kB/s) 2023-06-23T00:47:12.252 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 336 kB in 1s (529 kB/s) 2023-06-23T00:47:13.158 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2023-06-23T00:47:13.184 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T00:47:13.248 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2023-06-23T00:47:13.254 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-23T00:47:13.280 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T00:47:13.351 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-23T00:47:13.444 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2023-06-23T00:47:13.444 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2023-06-23T00:47:13.545 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2023-06-23T00:47:13.546 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2023-06-23T00:47:13.647 INFO:teuthology.orchestra.run.smithi097.stdout:linux-image-generic is already the newest version (5.4.0.152.149). 2023-06-23T00:47:13.648 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 0 newly installed, 0 to remove and 223 not upgraded. 2023-06-23T00:47:13.649 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2023-06-23T00:47:13.665 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2023-06-23T00:47:13.665 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2023-06-23T00:47:13.666 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2023-06-23T00:47:13.666 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2023-06-23T00:47:13.666 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 19 2023-06-23T00:47:13.666 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T00:47:13.666 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2023-06-23T00:47:13.666 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2023-06-23T00:47:13.666 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.4.0.152.149 2023-06-23T00:47:13.667 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-06-23T00:47:13.667 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.4.0-152-generic, linux-modules-extra-5.4.0-152-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T00:47:13.667 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2023-06-23T00:47:13.667 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2023-06-23T00:47:13.667 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2023-06-23T00:47:13.667 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2023-06-23T00:47:13.668 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-06-23T00:47:13.674 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.K4fWtlAFoo 2023-06-23T00:47:13.674 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub/grub.cfg /tmp/tmp.K4fWtlAFoo 2023-06-23T00:47:13.732 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.K4fWtlAFoo 2023-06-23T00:47:13.749 INFO:teuthology.orchestra.run.smithi149.stdout:linux-image-generic is already the newest version (5.4.0.152.149). 2023-06-23T00:47:13.749 INFO:teuthology.orchestra.run.smithi149.stdout:0 upgraded, 0 newly installed, 0 to remove and 223 not upgraded. 2023-06-23T00:47:13.751 DEBUG:teuthology.orchestra.run.smithi149:> dpkg -s linux-image-generic 2023-06-23T00:47:13.767 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.K4fWtlAFoo is 9KB 2023-06-23T00:47:13.770 INFO:teuthology.orchestra.run.smithi149.stdout:Package: linux-image-generic 2023-06-23T00:47:13.770 INFO:teuthology.orchestra.run.smithi149.stdout:Status: install ok installed 2023-06-23T00:47:13.770 INFO:teuthology.orchestra.run.smithi149.stdout:Priority: optional 2023-06-23T00:47:13.770 INFO:teuthology.orchestra.run.smithi149.stdout:Section: kernel 2023-06-23T00:47:13.770 INFO:teuthology.orchestra.run.smithi149.stdout:Installed-Size: 19 2023-06-23T00:47:13.771 INFO:teuthology.orchestra.run.smithi149.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T00:47:13.771 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: amd64 2023-06-23T00:47:13.771 INFO:teuthology.orchestra.run.smithi149.stdout:Source: linux-meta 2023-06-23T00:47:13.771 INFO:teuthology.orchestra.run.smithi149.stdout:Version: 5.4.0.152.149 2023-06-23T00:47:13.771 INFO:teuthology.orchestra.run.smithi149.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-06-23T00:47:13.771 INFO:teuthology.orchestra.run.smithi149.stdout:Depends: linux-image-5.4.0-152-generic, linux-modules-extra-5.4.0-152-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T00:47:13.771 INFO:teuthology.orchestra.run.smithi149.stdout:Recommends: thermald 2023-06-23T00:47:13.772 INFO:teuthology.orchestra.run.smithi149.stdout:Description: Generic Linux kernel image 2023-06-23T00:47:13.772 INFO:teuthology.orchestra.run.smithi149.stdout: This package will always depend on the latest generic kernel image 2023-06-23T00:47:13.772 INFO:teuthology.orchestra.run.smithi149.stdout: available. 2023-06-23T00:47:13.773 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2023-06-23T00:47:13.776 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.51RjqWP3Rr 2023-06-23T00:47:13.777 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub/grub.cfg /tmp/tmp.51RjqWP3Rr 2023-06-23T00:47:13.781 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.K4fWtlAFoo 2023-06-23T00:47:13.787 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-23T00:47:13.843 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:47:13.843 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-23T00:47:13.843 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-23T00:47:13.845 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.51RjqWP3Rr 2023-06-23T00:47:13.880 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-152-generic 2023-06-23T00:47:13.881 DEBUG:teuthology.orchestra.run.smithi097:> sudo update-grub 2023-06-23T00:47:13.888 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.51RjqWP3Rr is 9KB 2023-06-23T00:47:13.902 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.51RjqWP3Rr 2023-06-23T00:47:13.909 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-23T00:47:13.968 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:47:13.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-23T00:47:13.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-23T00:47:13.998 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-152-generic 2023-06-23T00:47:13.998 DEBUG:teuthology.orchestra.run.smithi149:> sudo update-grub 2023-06-23T00:47:15.319 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub' 2023-06-23T00:47:15.327 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T00:47:15.342 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2023-06-23T00:47:15.377 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub' 2023-06-23T00:47:15.383 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T00:47:15.396 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2023-06-23T00:47:15.617 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-152-generic 2023-06-23T00:47:15.629 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-152-generic 2023-06-23T00:47:15.704 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.4.0-152-generic 2023-06-23T00:47:15.715 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.4.0-152-generic 2023-06-23T00:47:16.068 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-23T00:47:16.079 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-23T00:47:16.102 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-23T00:47:16.113 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-23T00:47:17.730 INFO:teuthology.orchestra.run.smithi097.stderr:done 2023-06-23T00:47:17.732 DEBUG:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2023-06-23T00:47:17.799 INFO:teuthology.orchestra.run.smithi149.stderr:done 2023-06-23T00:47:17.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2023-06-23T00:47:47.764 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-06-23T00:47:47.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-06-23T00:47:47.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:47:47.804 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-06-23T00:47:47.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-06-23T00:47:47.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:48:06.256 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-06-23T00:48:06.260 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-23T00:48:36.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-06-23T00:48:36.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:48:36.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-06-23T00:48:36.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:48:53.616 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-06-23T00:48:54.640 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-23T00:49:23.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-06-23T00:49:23.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:49:23.855 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-06-23T00:49:24.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-06-23T00:49:24.428 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-152-generic"... 2023-06-23T00:49:24.428 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2023-06-23T00:49:24.435 INFO:teuthology.orchestra.run.smithi097.stdout:5.4.0-152-generic 2023-06-23T00:49:24.435 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-152-generic vs 5.4.0-152-generic 2023-06-23T00:49:24.435 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-23T00:49:24.436 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-23T00:49:24.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-06-23T00:49:24.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:49:24.841 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-06-23T00:49:25.437 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-06-23T00:49:25.438 DEBUG:teuthology.orchestra.run.smithi097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-23T00:49:25.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-06-23T00:49:25.462 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-152-generic"... 2023-06-23T00:49:25.462 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2023-06-23T00:49:25.468 INFO:teuthology.orchestra.run.smithi149.stdout:5.4.0-152-generic 2023-06-23T00:49:25.469 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-152-generic vs 5.4.0-152-generic 2023-06-23T00:49:25.469 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-23T00:49:25.469 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-23T00:49:25.532 INFO:teuthology.orchestra.run.smithi097.stdout:ttyS1 2023-06-23T00:49:25.565 DEBUG:teuthology.parallel:result is None 2023-06-23T00:49:26.470 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-06-23T00:49:26.470 DEBUG:teuthology.orchestra.run.smithi149:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-23T00:49:26.556 INFO:teuthology.orchestra.run.smithi149.stdout:ttyS1 2023-06-23T00:49:26.582 DEBUG:teuthology.parallel:result is None 2023-06-23T00:49:26.582 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-23T00:49:26.589 INFO:teuthology.task.internal:Creating test directory... 2023-06-23T00:49:26.590 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T00:49:26.593 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T00:49:26.600 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-23T00:49:26.654 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-23T00:49:26.666 INFO:teuthology.task.internal:Creating archive directory... 2023-06-23T00:49:26.667 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T00:49:26.669 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T00:49:26.697 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-23T00:49:26.705 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-23T00:49:26.705 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T00:49:26.708 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T00:49:26.724 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T00:49:26.734 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T00:49:26.745 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T00:49:26.756 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T00:49:26.758 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-23T00:49:26.767 INFO:teuthology.task.internal:Configuring sudo... 2023-06-23T00:49:26.767 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T00:49:26.781 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T00:49:26.797 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-23T00:49:26.810 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-23T00:49:26.810 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T00:49:26.813 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T00:49:26.846 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T00:49:26.854 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T00:49:26.901 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:49:26.902 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T00:49:26.919 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T00:49:26.927 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T00:49:26.934 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:49:26.934 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T00:49:27.003 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2023-06-23T00:49:27.005 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2023-06-23T00:49:27.051 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-23T00:49:27.059 INFO:teuthology.task.internal:Starting timer... 2023-06-23T00:49:27.059 INFO:teuthology.run_tasks:Running task pcp... 2023-06-23T00:49:27.095 INFO:teuthology.run_tasks:Running task selinux... 2023-06-23T00:49:27.106 DEBUG:teuthology.task.selinux:Excluding smithi097: OS 'ubuntu' does not support SELinux 2023-06-23T00:49:27.107 DEBUG:teuthology.task.selinux:Excluding smithi149: OS 'ubuntu' does not support SELinux 2023-06-23T00:49:27.107 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-23T00:49:27.107 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-06-23T00:49:27.108 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-23T00:49:27.108 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-23T00:49:27.120 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-06-23T00:49:27.128 INFO:teuthology.repo_utils:Fetching main from origin 2023-06-23T00:49:27.278 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-23T00:49:27.301 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-23T00:49:27.303 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi097.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-23T00:55:10.921 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi097.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2023-06-23T00:55:10.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-06-23T00:55:10.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:55:10.975 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-06-23T00:55:11.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-06-23T00:55:11.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:55:11.148 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-06-23T00:55:11.266 INFO:teuthology.run_tasks:Running task clock... 2023-06-23T00:55:11.282 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-23T00:55:11.283 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T00:55:11.284 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T00:55:11.287 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T00:55:11.287 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T00:55:11.317 INFO:teuthology.orchestra.run.smithi097.stdout:23 Jun 00:55:11 ntpd[22227]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-06-23T00:55:11.317 INFO:teuthology.orchestra.run.smithi097.stdout:23 Jun 00:55:11 ntpd[22227]: Command line: ntpd -gq 2023-06-23T00:55:11.318 INFO:teuthology.orchestra.run.smithi097.stdout:23 Jun 00:55:11 ntpd[22227]: proto: precision = 0.070 usec (-24) 2023-06-23T00:55:11.318 INFO:teuthology.orchestra.run.smithi097.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T00:55:11.319 INFO:teuthology.orchestra.run.smithi097.stdout:23 Jun 00:55:11 ntpd[22227]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T00:55:11.319 INFO:teuthology.orchestra.run.smithi097.stdout:23 Jun 00:55:11 ntpd[22227]: restrict ::: KOD does nothing without LIMITED. 2023-06-23T00:55:11.319 INFO:teuthology.orchestra.run.smithi097.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-23T00:55:11.320 INFO:teuthology.orchestra.run.smithi097.stdout:23 Jun 00:55:11 ntpd[22227]: Listen and drop on 0 v6wildcard [::]:123 2023-06-23T00:55:11.320 INFO:teuthology.orchestra.run.smithi097.stdout:23 Jun 00:55:11 ntpd[22227]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-23T00:55:11.320 INFO:teuthology.orchestra.run.smithi097.stdout:23 Jun 00:55:11 ntpd[22227]: Listen normally on 2 lo 127.0.0.1:123 2023-06-23T00:55:11.320 INFO:teuthology.orchestra.run.smithi097.stdout:23 Jun 00:55:11 ntpd[22227]: Listen normally on 3 enp3s0f1 172.21.15.97:123 2023-06-23T00:55:11.321 INFO:teuthology.orchestra.run.smithi097.stdout:23 Jun 00:55:11 ntpd[22227]: Listen normally on 4 lo [::1]:123 2023-06-23T00:55:11.321 INFO:teuthology.orchestra.run.smithi097.stdout:23 Jun 00:55:11 ntpd[22227]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d805%5]:123 2023-06-23T00:55:11.321 INFO:teuthology.orchestra.run.smithi097.stdout:23 Jun 00:55:11 ntpd[22227]: Listening on routing socket on fd #22 for interface updates 2023-06-23T00:55:11.322 INFO:teuthology.orchestra.run.smithi149.stdout:23 Jun 00:55:11 ntpd[22258]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-06-23T00:55:11.322 INFO:teuthology.orchestra.run.smithi149.stdout:23 Jun 00:55:11 ntpd[22258]: Command line: ntpd -gq 2023-06-23T00:55:11.322 INFO:teuthology.orchestra.run.smithi149.stdout:23 Jun 00:55:11 ntpd[22258]: proto: precision = 0.100 usec (-23) 2023-06-23T00:55:11.322 INFO:teuthology.orchestra.run.smithi149.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T00:55:11.323 INFO:teuthology.orchestra.run.smithi149.stdout:23 Jun 00:55:11 ntpd[22258]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T00:55:11.323 INFO:teuthology.orchestra.run.smithi149.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-23T00:55:11.324 INFO:teuthology.orchestra.run.smithi149.stdout:23 Jun 00:55:11 ntpd[22258]: restrict ::: KOD does nothing without LIMITED. 2023-06-23T00:55:11.324 INFO:teuthology.orchestra.run.smithi149.stdout:23 Jun 00:55:11 ntpd[22258]: Listen and drop on 0 v6wildcard [::]:123 2023-06-23T00:55:11.325 INFO:teuthology.orchestra.run.smithi149.stdout:23 Jun 00:55:11 ntpd[22258]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-23T00:55:11.325 INFO:teuthology.orchestra.run.smithi149.stdout:23 Jun 00:55:11 ntpd[22258]: Listen normally on 2 lo 127.0.0.1:123 2023-06-23T00:55:11.325 INFO:teuthology.orchestra.run.smithi149.stdout:23 Jun 00:55:11 ntpd[22258]: Listen normally on 3 enp3s0f1 172.21.15.149:123 2023-06-23T00:55:11.325 INFO:teuthology.orchestra.run.smithi149.stdout:23 Jun 00:55:11 ntpd[22258]: Listen normally on 4 lo [::1]:123 2023-06-23T00:55:11.325 INFO:teuthology.orchestra.run.smithi149.stdout:23 Jun 00:55:11 ntpd[22258]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7d57%5]:123 2023-06-23T00:55:11.325 INFO:teuthology.orchestra.run.smithi149.stdout:23 Jun 00:55:11 ntpd[22258]: Listening on routing socket on fd #22 for interface updates 2023-06-23T00:55:12.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:12 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:12.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:12 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:12.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:12 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:12.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:12 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:12.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:12 ntpd[22227]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:12.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:12 ntpd[22227]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:13.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:13 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:13.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:13 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:13.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:13 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:13.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:13 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:13.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:13 ntpd[22227]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:13.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:13 ntpd[22227]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:14.320 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:14 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:14.320 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:14 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:14.320 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:14 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:14.320 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:14 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:14.320 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:14 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:14.321 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:14 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:14.321 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:14 ntpd[22227]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:14.321 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:14 ntpd[22227]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:14.321 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:14 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:14.321 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:14 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:14.321 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:14 ntpd[22227]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:14.321 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:14 ntpd[22227]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:14.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:14 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:14.323 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:14 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:14.323 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:14 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:14.323 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:14 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:14.323 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:14 ntpd[22258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:14.323 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:14 ntpd[22258]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:15.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:15 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:15.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:15 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:15.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:15 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:15.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:15 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:15.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:15 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:15.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:15 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:15.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:15 ntpd[22227]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:15.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:15 ntpd[22227]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:15.327 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:15 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:15.328 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:15 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:15.328 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:15 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:15.328 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:15 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:15.329 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:15 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:15.330 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:15 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:15.331 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:15 ntpd[22258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:15.331 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:15 ntpd[22258]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:15.331 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:15 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:15.331 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:15 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:15.331 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:15 ntpd[22258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:15.331 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:15 ntpd[22258]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:16.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:16 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:16.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:16 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:16.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:16 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:16.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:16 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:16.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:16 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:16.320 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:16 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:16.320 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:16 ntpd[22227]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:16.321 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:16 ntpd[22227]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:16.321 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:16 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:16.321 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:16 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:16.321 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:16 ntpd[22227]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:16.321 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:16 ntpd[22227]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:16.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:16 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:16.323 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:16 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:16.323 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:16 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:16.323 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:16 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:16.323 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:16 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:16.323 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:16 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:16.324 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:16 ntpd[22258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:16.324 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:16 ntpd[22258]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:17.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:17 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:17.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:17 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:17.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:17 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:17.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:17 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:17.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:17 ntpd[22227]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:17.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:17 ntpd[22227]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:17.320 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:17 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:17.320 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:17 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:17.321 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:17 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:17.321 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:17 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:17.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:17 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:17.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:17 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:17.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:17 ntpd[22258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:17.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:17 ntpd[22258]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:17.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:17 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:17.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:17 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:17.323 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:17 ntpd[22258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:17.323 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:17 ntpd[22258]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:18.318 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:18 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:18.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:18 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:18.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:18 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:18.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:18 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:18.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:18 ntpd[22227]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:18.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:18 ntpd[22227]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:18.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:18 ntpd[22227]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:18.319 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:18 ntpd[22227]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout:23 Jun 00:55:18 ntpd[22227]: ntpd: time slew +0.003119 s 2023-06-23T00:55:18.320 INFO:teuthology.orchestra.run.smithi097.stdout:ntpd: time slew +0.003119s 2023-06-23T00:55:18.320 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:18 ntpd[22227]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-23T00:55:18.321 INFO:teuthology.orchestra.run.smithi097.stderr:23 Jun 00:55:18 ntpd[22227]: can't open /var/log/ntpstats/loopstats.20230623: Permission denied 2023-06-23T00:55:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:18 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:18 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:18 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:18 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:18 ntpd[22258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:18 ntpd[22258]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:18.383 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T00:55:18.384 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2023-06-23T00:55:18.384 INFO:teuthology.orchestra.run.smithi097.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T00:55:18.384 INFO:teuthology.orchestra.run.smithi097.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T00:55:18.384 INFO:teuthology.orchestra.run.smithi097.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T00:55:18.384 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T00:55:19.320 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:19 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:19.321 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:19 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:19.321 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:19 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:19.321 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:19 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:19.321 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:19 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:19.321 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:19 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:19.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:19 ntpd[22258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:19.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:19 ntpd[22258]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:19.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:19 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:19.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:19 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:19.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:19 ntpd[22258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:19.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:19 ntpd[22258]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:20.321 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:20 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:20.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:20 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:20.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:20 ntpd[22258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T00:55:20.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:20 ntpd[22258]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T00:55:20.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:20 ntpd[22258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T00:55:20.322 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:20 ntpd[22258]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T00:55:20.323 INFO:teuthology.orchestra.run.smithi149.stdout:23 Jun 00:55:20 ntpd[22258]: ntpd: time slew +0.004371 s 2023-06-23T00:55:20.323 INFO:teuthology.orchestra.run.smithi149.stdout:ntpd: time slew +0.004371s 2023-06-23T00:55:20.323 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:20 ntpd[22258]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-23T00:55:20.324 INFO:teuthology.orchestra.run.smithi149.stderr:23 Jun 00:55:20 ntpd[22258]: can't open /var/log/ntpstats/loopstats.20230623: Permission denied 2023-06-23T00:55:20.389 INFO:teuthology.orchestra.run.smithi149.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T00:55:20.390 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================== 2023-06-23T00:55:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T00:55:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T00:55:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T00:55:20.390 INFO:teuthology.orchestra.run.smithi149.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T00:55:20.391 INFO:teuthology.run_tasks:Running task install... 2023-06-23T00:55:20.411 DEBUG:teuthology.task.install:project ceph 2023-06-23T00:55:20.411 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}} 2023-06-23T00:55:20.412 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'} 2023-06-23T00:55:20.412 INFO:teuthology.task.install:Using flavor: default 2023-06-23T00:55:20.418 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-23T00:55:20.418 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-23T00:55:20.419 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-key list | grep Ceph 2023-06-23T00:55:20.419 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-key list | grep Ceph 2023-06-23T00:55:20.517 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-06-23T00:55:20.530 INFO:teuthology.orchestra.run.smithi149.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-06-23T00:55:20.578 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-23T00:55:20.578 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph.com (release key) 2023-06-23T00:55:20.579 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-23T00:55:20.579 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-06-23T00:55:20.580 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-23T00:55:20.591 INFO:teuthology.orchestra.run.smithi149.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-23T00:55:20.591 INFO:teuthology.orchestra.run.smithi149.stdout:uid [ unknown] Ceph.com (release key) 2023-06-23T00:55:20.592 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-23T00:55:20.592 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-06-23T00:55:20.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-23T00:55:20.719 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default/ 2023-06-23T00:55:20.719 INFO:teuthology.task.install.deb:Package version is 17.2.6-719-g42ddc46e-1focal 2023-06-23T00:55:20.729 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default/ 2023-06-23T00:55:20.729 INFO:teuthology.task.install.deb:Package version is 17.2.6-719-g42ddc46e-1focal 2023-06-23T00:55:21.091 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:55:21.091 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-23T00:55:21.102 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:55:21.103 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-23T00:55:21.109 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2023-06-23T00:55:21.118 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get update 2023-06-23T00:55:21.257 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-23T00:55:21.263 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-23T00:55:21.283 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-06-23T00:55:21.289 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-23T00:55:21.289 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-06-23T00:55:21.295 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-23T00:55:21.313 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-06-23T00:55:21.378 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-06-23T00:55:21.515 INFO:teuthology.orchestra.run.smithi149.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal InRelease 2023-06-23T00:55:21.548 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal InRelease 2023-06-23T00:55:21.588 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-06-23T00:55:21.621 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-06-23T00:55:21.663 INFO:teuthology.orchestra.run.smithi149.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal Release.gpg 2023-06-23T00:55:21.697 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal Release.gpg 2023-06-23T00:55:21.736 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main i386 Packages [3,385 B] 2023-06-23T00:55:21.772 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-06-23T00:55:21.832 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-06-23T00:55:21.944 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main i386 Packages [3,385 B] 2023-06-23T00:55:22.000 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 251 kB in 1s (347 kB/s) 2023-06-23T00:55:22.032 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 251 kB in 1s (346 kB/s) 2023-06-23T00:55:23.002 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-23T00:55:23.024 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2023-06-23T00:55:23.026 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-719-g42ddc46e-1focal cephadm=17.2.6-719-g42ddc46e-1focal ceph-mds=17.2.6-719-g42ddc46e-1focal ceph-mgr=17.2.6-719-g42ddc46e-1focal ceph-common=17.2.6-719-g42ddc46e-1focal ceph-fuse=17.2.6-719-g42ddc46e-1focal ceph-test=17.2.6-719-g42ddc46e-1focal ceph-volume=17.2.6-719-g42ddc46e-1focal radosgw=17.2.6-719-g42ddc46e-1focal python3-rados=17.2.6-719-g42ddc46e-1focal python3-rgw=17.2.6-719-g42ddc46e-1focal python3-cephfs=17.2.6-719-g42ddc46e-1focal python3-rbd=17.2.6-719-g42ddc46e-1focal libcephfs2=17.2.6-719-g42ddc46e-1focal libcephfs-dev=17.2.6-719-g42ddc46e-1focal librados2=17.2.6-719-g42ddc46e-1focal librbd1=17.2.6-719-g42ddc46e-1focal rbd-fuse=17.2.6-719-g42ddc46e-1focal python3-cephfs=17.2.6-719-g42ddc46e-1focal cephfs-shell=17.2.6-719-g42ddc46e-1focal cephfs-top=17.2.6-719-g42ddc46e-1focal cephfs-mirror=17.2.6-719-g42ddc46e-1focal 2023-06-23T00:55:23.049 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-719-g42ddc46e-1focal cephadm=17.2.6-719-g42ddc46e-1focal ceph-mds=17.2.6-719-g42ddc46e-1focal ceph-mgr=17.2.6-719-g42ddc46e-1focal ceph-common=17.2.6-719-g42ddc46e-1focal ceph-fuse=17.2.6-719-g42ddc46e-1focal ceph-test=17.2.6-719-g42ddc46e-1focal ceph-volume=17.2.6-719-g42ddc46e-1focal radosgw=17.2.6-719-g42ddc46e-1focal python3-rados=17.2.6-719-g42ddc46e-1focal python3-rgw=17.2.6-719-g42ddc46e-1focal python3-cephfs=17.2.6-719-g42ddc46e-1focal python3-rbd=17.2.6-719-g42ddc46e-1focal libcephfs2=17.2.6-719-g42ddc46e-1focal libcephfs-dev=17.2.6-719-g42ddc46e-1focal librados2=17.2.6-719-g42ddc46e-1focal librbd1=17.2.6-719-g42ddc46e-1focal rbd-fuse=17.2.6-719-g42ddc46e-1focal python3-cephfs=17.2.6-719-g42ddc46e-1focal cephfs-shell=17.2.6-719-g42ddc46e-1focal cephfs-top=17.2.6-719-g42ddc46e-1focal cephfs-mirror=17.2.6-719-g42ddc46e-1focal 2023-06-23T00:55:23.092 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-23T00:55:23.124 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2023-06-23T00:55:23.289 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2023-06-23T00:55:23.290 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2023-06-23T00:55:23.319 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2023-06-23T00:55:23.320 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2023-06-23T00:55:23.469 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T00:55:23.470 INFO:teuthology.orchestra.run.smithi149.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-23T00:55:23.471 INFO:teuthology.orchestra.run.smithi149.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T00:55:23.471 INFO:teuthology.orchestra.run.smithi149.stdout:The following additional packages will be installed: 2023-06-23T00:55:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-23T00:55:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-06-23T00:55:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-06-23T00:55:23.471 INFO:teuthology.orchestra.run.smithi149.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-06-23T00:55:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-06-23T00:55:23.472 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-06-23T00:55:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-06-23T00:55:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-06-23T00:55:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-06-23T00:55:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-06-23T00:55:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-06-23T00:55:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-23T00:55:23.473 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-23T00:55:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-23T00:55:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-23T00:55:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-23T00:55:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-06-23T00:55:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-06-23T00:55:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-23T00:55:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-23T00:55:23.474 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-23T00:55:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-23T00:55:23.475 INFO:teuthology.orchestra.run.smithi149.stdout:Suggested packages: 2023-06-23T00:55:23.475 INFO:teuthology.orchestra.run.smithi149.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-06-23T00:55:23.476 INFO:teuthology.orchestra.run.smithi149.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-06-23T00:55:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-06-23T00:55:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-06-23T00:55:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-06-23T00:55:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-06-23T00:55:23.477 INFO:teuthology.orchestra.run.smithi149.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-06-23T00:55:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-06-23T00:55:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-06-23T00:55:23.478 INFO:teuthology.orchestra.run.smithi149.stdout:Recommended packages: 2023-06-23T00:55:23.478 INFO:teuthology.orchestra.run.smithi149.stdout: btrfs-tools 2023-06-23T00:55:23.485 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T00:55:23.486 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-23T00:55:23.487 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T00:55:23.487 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2023-06-23T00:55:23.487 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-23T00:55:23.487 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-06-23T00:55:23.488 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-06-23T00:55:23.488 INFO:teuthology.orchestra.run.smithi097.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-06-23T00:55:23.488 INFO:teuthology.orchestra.run.smithi097.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-06-23T00:55:23.488 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-06-23T00:55:23.488 INFO:teuthology.orchestra.run.smithi097.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-06-23T00:55:23.489 INFO:teuthology.orchestra.run.smithi097.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-06-23T00:55:23.489 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-06-23T00:55:23.489 INFO:teuthology.orchestra.run.smithi097.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-06-23T00:55:23.489 INFO:teuthology.orchestra.run.smithi097.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-06-23T00:55:23.489 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-23T00:55:23.489 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-23T00:55:23.489 INFO:teuthology.orchestra.run.smithi097.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-23T00:55:23.490 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-23T00:55:23.490 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-23T00:55:23.490 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-06-23T00:55:23.490 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-06-23T00:55:23.490 INFO:teuthology.orchestra.run.smithi097.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-23T00:55:23.490 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-23T00:55:23.490 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-23T00:55:23.490 INFO:teuthology.orchestra.run.smithi097.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-23T00:55:23.491 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2023-06-23T00:55:23.491 INFO:teuthology.orchestra.run.smithi097.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-06-23T00:55:23.491 INFO:teuthology.orchestra.run.smithi097.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-06-23T00:55:23.491 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-06-23T00:55:23.491 INFO:teuthology.orchestra.run.smithi097.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-06-23T00:55:23.492 INFO:teuthology.orchestra.run.smithi097.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-06-23T00:55:23.492 INFO:teuthology.orchestra.run.smithi097.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-06-23T00:55:23.492 INFO:teuthology.orchestra.run.smithi097.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-06-23T00:55:23.492 INFO:teuthology.orchestra.run.smithi097.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-06-23T00:55:23.492 INFO:teuthology.orchestra.run.smithi097.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-06-23T00:55:23.492 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2023-06-23T00:55:23.492 INFO:teuthology.orchestra.run.smithi097.stdout: btrfs-tools 2023-06-23T00:55:23.591 INFO:teuthology.orchestra.run.smithi149.stdout:The following NEW packages will be installed: 2023-06-23T00:55:23.592 INFO:teuthology.orchestra.run.smithi149.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-23T00:55:23.592 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-23T00:55:23.592 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-23T00:55:23.592 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-06-23T00:55:23.592 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-06-23T00:55:23.592 INFO:teuthology.orchestra.run.smithi149.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-06-23T00:55:23.593 INFO:teuthology.orchestra.run.smithi149.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-06-23T00:55:23.594 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-06-23T00:55:23.594 INFO:teuthology.orchestra.run.smithi149.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-06-23T00:55:23.594 INFO:teuthology.orchestra.run.smithi149.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-06-23T00:55:23.594 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-06-23T00:55:23.594 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-06-23T00:55:23.595 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-06-23T00:55:23.595 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-23T00:55:23.595 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-23T00:55:23.595 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-23T00:55:23.595 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-23T00:55:23.595 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-23T00:55:23.595 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-06-23T00:55:23.596 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-23T00:55:23.596 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-23T00:55:23.596 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-23T00:55:23.596 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-23T00:55:23.596 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-23T00:55:23.596 INFO:teuthology.orchestra.run.smithi149.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-06-23T00:55:23.596 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages will be upgraded: 2023-06-23T00:55:23.596 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 librbd1 2023-06-23T00:55:23.610 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2023-06-23T00:55:23.610 INFO:teuthology.orchestra.run.smithi097.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-23T00:55:23.610 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-23T00:55:23.610 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-23T00:55:23.611 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-06-23T00:55:23.611 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-06-23T00:55:23.611 INFO:teuthology.orchestra.run.smithi097.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-06-23T00:55:23.611 INFO:teuthology.orchestra.run.smithi097.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-06-23T00:55:23.612 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-06-23T00:55:23.612 INFO:teuthology.orchestra.run.smithi097.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-06-23T00:55:23.612 INFO:teuthology.orchestra.run.smithi097.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-06-23T00:55:23.613 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-06-23T00:55:23.613 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-06-23T00:55:23.613 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-06-23T00:55:23.613 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-23T00:55:23.613 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-23T00:55:23.613 INFO:teuthology.orchestra.run.smithi097.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-23T00:55:23.613 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-23T00:55:23.614 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-23T00:55:23.614 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-06-23T00:55:23.614 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-23T00:55:23.614 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-23T00:55:23.614 INFO:teuthology.orchestra.run.smithi097.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-23T00:55:23.614 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-23T00:55:23.614 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-23T00:55:23.614 INFO:teuthology.orchestra.run.smithi097.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-06-23T00:55:23.615 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2023-06-23T00:55:23.615 INFO:teuthology.orchestra.run.smithi097.stdout: librados2 librbd1 2023-06-23T00:55:23.657 INFO:teuthology.orchestra.run.smithi149.stdout:2 upgraded, 114 newly installed, 0 to remove and 205 not upgraded. 2023-06-23T00:55:23.657 INFO:teuthology.orchestra.run.smithi149.stdout:Need to get 209 MB of archives. 2023-06-23T00:55:23.658 INFO:teuthology.orchestra.run.smithi149.stdout:After this operation, 981 MB of additional disk space will be used. 2023-06-23T00:55:23.658 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-06-23T00:55:23.675 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-06-23T00:55:23.676 INFO:teuthology.orchestra.run.smithi097.stdout:2 upgraded, 114 newly installed, 0 to remove and 205 not upgraded. 2023-06-23T00:55:23.676 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 209 MB of archives. 2023-06-23T00:55:23.676 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 981 MB of additional disk space will be used. 2023-06-23T00:55:23.676 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-06-23T00:55:23.683 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-06-23T00:55:23.695 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-06-23T00:55:23.702 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-06-23T00:55:23.708 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-06-23T00:55:23.728 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-06-23T00:55:23.737 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-06-23T00:55:23.739 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-06-23T00:55:23.748 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-06-23T00:55:23.751 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-06-23T00:55:23.757 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-06-23T00:55:23.758 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-06-23T00:55:23.769 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-06-23T00:55:23.770 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-06-23T00:55:23.770 INFO:teuthology.orchestra.run.smithi149.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-06-23T00:55:23.770 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-06-23T00:55:23.774 INFO:teuthology.orchestra.run.smithi149.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-06-23T00:55:23.788 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-06-23T00:55:23.790 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-06-23T00:55:23.794 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-06-23T00:55:23.838 INFO:teuthology.orchestra.run.smithi149.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-06-23T00:55:23.855 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-06-23T00:55:23.925 INFO:teuthology.orchestra.run.smithi149.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-06-23T00:55:23.946 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-06-23T00:55:23.964 INFO:teuthology.orchestra.run.smithi149.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-06-23T00:55:23.970 INFO:teuthology.orchestra.run.smithi149.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-06-23T00:55:23.971 INFO:teuthology.orchestra.run.smithi149.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-06-23T00:55:23.977 INFO:teuthology.orchestra.run.smithi149.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-06-23T00:55:23.977 INFO:teuthology.orchestra.run.smithi149.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-06-23T00:55:23.978 INFO:teuthology.orchestra.run.smithi149.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-06-23T00:55:23.981 INFO:teuthology.orchestra.run.smithi149.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-06-23T00:55:23.982 INFO:teuthology.orchestra.run.smithi149.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-06-23T00:55:23.982 INFO:teuthology.orchestra.run.smithi149.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-06-23T00:55:24.001 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-06-23T00:55:24.012 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-06-23T00:55:24.012 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-06-23T00:55:24.012 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-06-23T00:55:24.012 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-06-23T00:55:24.013 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-06-23T00:55:24.014 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-06-23T00:55:24.014 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-06-23T00:55:24.014 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-06-23T00:55:24.017 INFO:teuthology.orchestra.run.smithi149.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-06-23T00:55:24.049 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-06-23T00:55:24.054 INFO:teuthology.orchestra.run.smithi149.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-06-23T00:55:24.081 INFO:teuthology.orchestra.run.smithi149.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-23T00:55:24.084 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-06-23T00:55:24.085 INFO:teuthology.orchestra.run.smithi149.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-06-23T00:55:24.087 INFO:teuthology.orchestra.run.smithi149.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-06-23T00:55:24.094 INFO:teuthology.orchestra.run.smithi149.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-719-g42ddc46e-1focal [3,504 kB] 2023-06-23T00:55:24.103 INFO:teuthology.orchestra.run.smithi149.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-06-23T00:55:24.108 INFO:teuthology.orchestra.run.smithi149.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-06-23T00:55:24.112 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-23T00:55:24.113 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-719-g42ddc46e-1focal [3,504 kB] 2023-06-23T00:55:24.116 INFO:teuthology.orchestra.run.smithi149.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-06-23T00:55:24.117 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-06-23T00:55:24.119 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-06-23T00:55:24.123 INFO:teuthology.orchestra.run.smithi149.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-06-23T00:55:24.123 INFO:teuthology.orchestra.run.smithi149.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-06-23T00:55:24.134 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-06-23T00:55:24.139 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-06-23T00:55:24.145 INFO:teuthology.orchestra.run.smithi149.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-06-23T00:55:24.147 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-06-23T00:55:24.154 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-06-23T00:55:24.154 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-06-23T00:55:24.180 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-06-23T00:55:24.181 INFO:teuthology.orchestra.run.smithi149.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-06-23T00:55:24.215 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-06-23T00:55:24.219 INFO:teuthology.orchestra.run.smithi149.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-06-23T00:55:24.229 INFO:teuthology.orchestra.run.smithi149.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-06-23T00:55:24.255 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-06-23T00:55:24.256 INFO:teuthology.orchestra.run.smithi149.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-06-23T00:55:24.265 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-06-23T00:55:24.278 INFO:teuthology.orchestra.run.smithi149.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-06-23T00:55:24.283 INFO:teuthology.orchestra.run.smithi149.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-23T00:55:24.284 INFO:teuthology.orchestra.run.smithi149.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-06-23T00:55:24.289 INFO:teuthology.orchestra.run.smithi149.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-06-23T00:55:24.291 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-06-23T00:55:24.294 INFO:teuthology.orchestra.run.smithi149.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-06-23T00:55:24.297 INFO:teuthology.orchestra.run.smithi149.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-06-23T00:55:24.297 INFO:teuthology.orchestra.run.smithi149.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-06-23T00:55:24.313 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-06-23T00:55:24.320 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-23T00:55:24.320 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-06-23T00:55:24.326 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-06-23T00:55:24.329 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-06-23T00:55:24.333 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-06-23T00:55:24.333 INFO:teuthology.orchestra.run.smithi149.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-06-23T00:55:24.334 INFO:teuthology.orchestra.run.smithi097.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-06-23T00:55:24.369 INFO:teuthology.orchestra.run.smithi097.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-06-23T00:55:24.541 INFO:teuthology.orchestra.run.smithi149.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-06-23T00:55:24.562 INFO:teuthology.orchestra.run.smithi149.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-06-23T00:55:24.563 INFO:teuthology.orchestra.run.smithi149.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-06-23T00:55:24.574 INFO:teuthology.orchestra.run.smithi149.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-06-23T00:55:24.575 INFO:teuthology.orchestra.run.smithi149.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-06-23T00:55:24.575 INFO:teuthology.orchestra.run.smithi149.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-06-23T00:55:24.575 INFO:teuthology.orchestra.run.smithi149.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-06-23T00:55:24.576 INFO:teuthology.orchestra.run.smithi149.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-06-23T00:55:24.576 INFO:teuthology.orchestra.run.smithi097.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-06-23T00:55:24.576 INFO:teuthology.orchestra.run.smithi149.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-06-23T00:55:24.597 INFO:teuthology.orchestra.run.smithi097.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-06-23T00:55:24.598 INFO:teuthology.orchestra.run.smithi097.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-06-23T00:55:24.610 INFO:teuthology.orchestra.run.smithi149.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-06-23T00:55:24.611 INFO:teuthology.orchestra.run.smithi097.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-06-23T00:55:24.647 INFO:teuthology.orchestra.run.smithi149.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-06-23T00:55:24.654 INFO:teuthology.orchestra.run.smithi097.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-06-23T00:55:24.655 INFO:teuthology.orchestra.run.smithi097.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-06-23T00:55:24.656 INFO:teuthology.orchestra.run.smithi097.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-06-23T00:55:24.657 INFO:teuthology.orchestra.run.smithi097.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-06-23T00:55:24.658 INFO:teuthology.orchestra.run.smithi097.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-06-23T00:55:24.659 INFO:teuthology.orchestra.run.smithi097.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-06-23T00:55:24.682 INFO:teuthology.orchestra.run.smithi149.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-06-23T00:55:24.695 INFO:teuthology.orchestra.run.smithi097.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-06-23T00:55:24.700 INFO:teuthology.orchestra.run.smithi149.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-06-23T00:55:24.731 INFO:teuthology.orchestra.run.smithi097.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-06-23T00:55:24.746 INFO:teuthology.orchestra.run.smithi149.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-06-23T00:55:24.748 INFO:teuthology.orchestra.run.smithi097.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-06-23T00:55:24.755 INFO:teuthology.orchestra.run.smithi149.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-06-23T00:55:24.761 INFO:teuthology.orchestra.run.smithi149.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-06-23T00:55:24.764 INFO:teuthology.orchestra.run.smithi149.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-06-23T00:55:24.774 INFO:teuthology.orchestra.run.smithi149.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-06-23T00:55:24.780 INFO:teuthology.orchestra.run.smithi149.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-06-23T00:55:24.781 INFO:teuthology.orchestra.run.smithi149.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-06-23T00:55:24.798 INFO:teuthology.orchestra.run.smithi097.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-06-23T00:55:24.806 INFO:teuthology.orchestra.run.smithi097.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-06-23T00:55:24.807 INFO:teuthology.orchestra.run.smithi149.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-06-23T00:55:24.812 INFO:teuthology.orchestra.run.smithi097.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-06-23T00:55:24.814 INFO:teuthology.orchestra.run.smithi097.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-06-23T00:55:24.825 INFO:teuthology.orchestra.run.smithi097.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-06-23T00:55:24.831 INFO:teuthology.orchestra.run.smithi097.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-06-23T00:55:24.831 INFO:teuthology.orchestra.run.smithi097.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-06-23T00:55:24.844 INFO:teuthology.orchestra.run.smithi149.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-06-23T00:55:24.857 INFO:teuthology.orchestra.run.smithi097.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-06-23T00:55:24.894 INFO:teuthology.orchestra.run.smithi097.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-06-23T00:55:25.024 INFO:teuthology.orchestra.run.smithi149.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-06-23T00:55:25.024 INFO:teuthology.orchestra.run.smithi149.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-06-23T00:55:25.024 INFO:teuthology.orchestra.run.smithi149.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-06-23T00:55:25.024 INFO:teuthology.orchestra.run.smithi149.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-06-23T00:55:25.025 INFO:teuthology.orchestra.run.smithi149.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-06-23T00:55:25.025 INFO:teuthology.orchestra.run.smithi149.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-06-23T00:55:25.040 INFO:teuthology.orchestra.run.smithi149.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-06-23T00:55:25.041 INFO:teuthology.orchestra.run.smithi149.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-23T00:55:25.041 INFO:teuthology.orchestra.run.smithi149.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-06-23T00:55:25.041 INFO:teuthology.orchestra.run.smithi149.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-06-23T00:55:25.069 INFO:teuthology.orchestra.run.smithi097.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-06-23T00:55:25.070 INFO:teuthology.orchestra.run.smithi097.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-06-23T00:55:25.070 INFO:teuthology.orchestra.run.smithi097.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-06-23T00:55:25.071 INFO:teuthology.orchestra.run.smithi097.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-06-23T00:55:25.071 INFO:teuthology.orchestra.run.smithi097.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-06-23T00:55:25.073 INFO:teuthology.orchestra.run.smithi097.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-06-23T00:55:25.077 INFO:teuthology.orchestra.run.smithi149.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-06-23T00:55:25.089 INFO:teuthology.orchestra.run.smithi097.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-06-23T00:55:25.089 INFO:teuthology.orchestra.run.smithi097.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-23T00:55:25.090 INFO:teuthology.orchestra.run.smithi097.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-06-23T00:55:25.090 INFO:teuthology.orchestra.run.smithi097.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-06-23T00:55:25.125 INFO:teuthology.orchestra.run.smithi097.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-06-23T00:55:25.136 INFO:teuthology.orchestra.run.smithi149.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-06-23T00:55:25.141 INFO:teuthology.orchestra.run.smithi149.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-06-23T00:55:25.173 INFO:teuthology.orchestra.run.smithi149.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-06-23T00:55:25.176 INFO:teuthology.orchestra.run.smithi149.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-06-23T00:55:25.185 INFO:teuthology.orchestra.run.smithi097.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-06-23T00:55:25.189 INFO:teuthology.orchestra.run.smithi097.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-06-23T00:55:25.221 INFO:teuthology.orchestra.run.smithi097.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-06-23T00:55:25.224 INFO:teuthology.orchestra.run.smithi097.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-06-23T00:55:26.074 INFO:teuthology.orchestra.run.smithi149.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-719-g42ddc46e-1focal [3,559 kB] 2023-06-23T00:55:26.264 INFO:teuthology.orchestra.run.smithi097.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-719-g42ddc46e-1focal [3,559 kB] 2023-06-23T00:55:27.655 INFO:teuthology.orchestra.run.smithi149.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-719-g42ddc46e-1focal [757 kB] 2023-06-23T00:55:28.015 INFO:teuthology.orchestra.run.smithi149.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-719-g42ddc46e-1focal [414 kB] 2023-06-23T00:55:28.139 INFO:teuthology.orchestra.run.smithi097.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-719-g42ddc46e-1focal [757 kB] 2023-06-23T00:55:28.199 INFO:teuthology.orchestra.run.smithi149.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-719-g42ddc46e-1focal [22.5 kB] 2023-06-23T00:55:28.202 INFO:teuthology.orchestra.run.smithi149.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-719-g42ddc46e-1focal [200 kB] 2023-06-23T00:55:28.297 INFO:teuthology.orchestra.run.smithi149.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-719-g42ddc46e-1focal [47.1 kB] 2023-06-23T00:55:28.343 INFO:teuthology.orchestra.run.smithi149.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-719-g42ddc46e-1focal [384 kB] 2023-06-23T00:55:28.484 INFO:teuthology.orchestra.run.smithi149.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-719-g42ddc46e-1focal [5,565 kB] 2023-06-23T00:55:28.506 INFO:teuthology.orchestra.run.smithi097.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-719-g42ddc46e-1focal [414 kB] 2023-06-23T00:55:28.775 INFO:teuthology.orchestra.run.smithi097.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-719-g42ddc46e-1focal [22.5 kB] 2023-06-23T00:55:28.776 INFO:teuthology.orchestra.run.smithi097.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-719-g42ddc46e-1focal [200 kB] 2023-06-23T00:55:28.871 INFO:teuthology.orchestra.run.smithi097.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-719-g42ddc46e-1focal [47.1 kB] 2023-06-23T00:55:28.872 INFO:teuthology.orchestra.run.smithi097.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-719-g42ddc46e-1focal [384 kB] 2023-06-23T00:55:29.066 INFO:teuthology.orchestra.run.smithi097.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-719-g42ddc46e-1focal [5,565 kB] 2023-06-23T00:55:31.253 INFO:teuthology.orchestra.run.smithi149.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-719-g42ddc46e-1focal [116 kB] 2023-06-23T00:55:31.266 INFO:teuthology.orchestra.run.smithi149.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-719-g42ddc46e-1focal [479 kB] 2023-06-23T00:55:31.505 INFO:teuthology.orchestra.run.smithi097.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-719-g42ddc46e-1focal [116 kB] 2023-06-23T00:55:31.537 INFO:teuthology.orchestra.run.smithi097.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-719-g42ddc46e-1focal [479 kB] 2023-06-23T00:55:31.630 INFO:teuthology.orchestra.run.smithi097.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-719-g42ddc46e-1focal [27.3 MB] 2023-06-23T00:55:33.787 INFO:teuthology.orchestra.run.smithi149.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-719-g42ddc46e-1focal [27.3 MB] 2023-06-23T00:55:37.814 INFO:teuthology.orchestra.run.smithi097.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-719-g42ddc46e-1focal [6,447 kB] 2023-06-23T00:55:39.226 INFO:teuthology.orchestra.run.smithi097.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-719-g42ddc46e-1focal [221 kB] 2023-06-23T00:55:39.254 INFO:teuthology.orchestra.run.smithi097.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-719-g42ddc46e-1focal [152 kB] 2023-06-23T00:55:39.287 INFO:teuthology.orchestra.run.smithi097.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-719-g42ddc46e-1focal [1,588 kB] 2023-06-23T00:55:39.646 INFO:teuthology.orchestra.run.smithi097.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-719-g42ddc46e-1focal [7,843 kB] 2023-06-23T00:55:41.338 INFO:teuthology.orchestra.run.smithi097.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-719-g42ddc46e-1focal [28.7 MB] 2023-06-23T00:55:44.529 INFO:teuthology.orchestra.run.smithi149.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-719-g42ddc46e-1focal [6,447 kB] 2023-06-23T00:55:46.348 INFO:teuthology.orchestra.run.smithi149.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-719-g42ddc46e-1focal [221 kB] 2023-06-23T00:55:46.432 INFO:teuthology.orchestra.run.smithi149.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-719-g42ddc46e-1focal [152 kB] 2023-06-23T00:55:46.513 INFO:teuthology.orchestra.run.smithi149.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-719-g42ddc46e-1focal [1,588 kB] 2023-06-23T00:55:46.951 INFO:teuthology.orchestra.run.smithi149.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-719-g42ddc46e-1focal [7,843 kB] 2023-06-23T00:55:48.037 INFO:teuthology.orchestra.run.smithi097.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-719-g42ddc46e-1focal [3,920 B] 2023-06-23T00:55:48.038 INFO:teuthology.orchestra.run.smithi097.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-719-g42ddc46e-1focal [867 kB] 2023-06-23T00:55:48.122 INFO:teuthology.orchestra.run.smithi097.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-719-g42ddc46e-1focal [2,399 kB] 2023-06-23T00:55:48.663 INFO:teuthology.orchestra.run.smithi097.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-719-g42ddc46e-1focal [78.9 kB] 2023-06-23T00:55:48.665 INFO:teuthology.orchestra.run.smithi097.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-719-g42ddc46e-1focal [117 kB] 2023-06-23T00:55:48.710 INFO:teuthology.orchestra.run.smithi097.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-719-g42ddc46e-1focal [1,759 kB] 2023-06-23T00:55:49.079 INFO:teuthology.orchestra.run.smithi097.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-719-g42ddc46e-1focal [7,886 kB] 2023-06-23T00:55:49.241 INFO:teuthology.orchestra.run.smithi149.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-719-g42ddc46e-1focal [28.7 MB] 2023-06-23T00:55:50.753 INFO:teuthology.orchestra.run.smithi097.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-719-g42ddc46e-1focal [4,036 B] 2023-06-23T00:55:50.754 INFO:teuthology.orchestra.run.smithi097.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-719-g42ddc46e-1focal [56.2 MB] 2023-06-23T00:56:00.547 INFO:teuthology.orchestra.run.smithi149.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-719-g42ddc46e-1focal [3,920 B] 2023-06-23T00:56:00.620 INFO:teuthology.orchestra.run.smithi149.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-719-g42ddc46e-1focal [867 kB] 2023-06-23T00:56:00.783 INFO:teuthology.orchestra.run.smithi149.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-719-g42ddc46e-1focal [2,399 kB] 2023-06-23T00:56:01.619 INFO:teuthology.orchestra.run.smithi149.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-719-g42ddc46e-1focal [78.9 kB] 2023-06-23T00:56:01.622 INFO:teuthology.orchestra.run.smithi149.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-719-g42ddc46e-1focal [117 kB] 2023-06-23T00:56:01.710 INFO:teuthology.orchestra.run.smithi149.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-719-g42ddc46e-1focal [1,759 kB] 2023-06-23T00:56:02.293 INFO:teuthology.orchestra.run.smithi149.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-719-g42ddc46e-1focal [7,886 kB] 2023-06-23T00:56:02.903 INFO:teuthology.orchestra.run.smithi097.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-719-g42ddc46e-1focal [226 kB] 2023-06-23T00:56:02.908 INFO:teuthology.orchestra.run.smithi097.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-719-g42ddc46e-1focal [238 kB] 2023-06-23T00:56:02.912 INFO:teuthology.orchestra.run.smithi097.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-719-g42ddc46e-1focal [22.0 kB] 2023-06-23T00:56:02.973 INFO:teuthology.orchestra.run.smithi097.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-719-g42ddc46e-1focal [12.8 kB] 2023-06-23T00:56:02.974 INFO:teuthology.orchestra.run.smithi097.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-719-g42ddc46e-1focal [21.9 kB] 2023-06-23T00:56:02.974 INFO:teuthology.orchestra.run.smithi097.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-719-g42ddc46e-1focal [17.0 MB] 2023-06-23T00:56:05.238 INFO:teuthology.orchestra.run.smithi149.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-719-g42ddc46e-1focal [4,036 B] 2023-06-23T00:56:05.240 INFO:teuthology.orchestra.run.smithi149.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-719-g42ddc46e-1focal [56.2 MB] 2023-06-23T00:56:06.508 INFO:teuthology.orchestra.run.smithi097.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-719-g42ddc46e-1focal [79.4 kB] 2023-06-23T00:56:07.123 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 209 MB in 43s (4,880 kB/s) 2023-06-23T00:56:07.266 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-23T00:56:07.322 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141758 files and directories currently installed.) 2023-06-23T00:56:07.326 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-06-23T00:56:07.373 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-06-23T00:56:07.650 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-23T00:56:07.666 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-06-23T00:56:07.700 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-23T00:56:07.936 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cmd2. 2023-06-23T00:56:07.953 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-06-23T00:56:07.995 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-06-23T00:56:08.356 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-06-23T00:56:08.371 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-06-23T00:56:08.456 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-23T00:56:08.780 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../004-librbd1_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:08.907 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librbd1 (17.2.6-719-g42ddc46e-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-23T00:56:09.611 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../005-librados2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:09.745 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librados2 (17.2.6-719-g42ddc46e-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-23T00:56:10.465 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs2. 2023-06-23T00:56:10.485 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:10.523 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:10.852 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rados. 2023-06-23T00:56:10.870 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../007-python3-rados_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:10.910 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rados (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:11.314 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-23T00:56:11.331 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:11.372 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-argparse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:11.633 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cephfs. 2023-06-23T00:56:11.650 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:11.683 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cephfs (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:12.021 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-23T00:56:12.038 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:12.079 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:12.407 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-prettytable. 2023-06-23T00:56:12.427 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-06-23T00:56:12.465 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-06-23T00:56:12.702 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rbd. 2023-06-23T00:56:12.718 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:12.760 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rbd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:13.105 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-06-23T00:56:13.122 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-06-23T00:56:13.163 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-23T00:56:13.549 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-06-23T00:56:13.566 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-06-23T00:56:13.607 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-06-23T00:56:13.953 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-23T00:56:13.969 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-06-23T00:56:14.010 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-23T00:56:14.406 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-23T00:56:14.422 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-06-23T00:56:14.463 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-23T00:56:14.758 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-23T00:56:14.775 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-06-23T00:56:14.809 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-23T00:56:15.244 INFO:teuthology.orchestra.run.smithi149.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-719-g42ddc46e-1focal [226 kB] 2023-06-23T00:56:15.275 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-23T00:56:15.288 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-23T00:56:15.313 INFO:teuthology.orchestra.run.smithi149.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-719-g42ddc46e-1focal [238 kB] 2023-06-23T00:56:15.317 INFO:teuthology.orchestra.run.smithi149.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-719-g42ddc46e-1focal [22.0 kB] 2023-06-23T00:56:15.317 INFO:teuthology.orchestra.run.smithi149.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-719-g42ddc46e-1focal [12.8 kB] 2023-06-23T00:56:15.318 INFO:teuthology.orchestra.run.smithi149.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-719-g42ddc46e-1focal [21.9 kB] 2023-06-23T00:56:15.318 INFO:teuthology.orchestra.run.smithi149.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-719-g42ddc46e-1focal [17.0 MB] 2023-06-23T00:56:15.338 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T00:56:15.831 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-23T00:56:15.847 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-23T00:56:15.889 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T00:56:16.242 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-23T00:56:16.261 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-23T00:56:16.292 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T00:56:16.670 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-06-23T00:56:16.686 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-06-23T00:56:16.728 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-23T00:56:17.065 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librgw2. 2023-06-23T00:56:17.080 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../022-librgw2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:17.123 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librgw2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:17.473 INFO:teuthology.orchestra.run.smithi149.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-719-g42ddc46e-1focal [79.4 kB] 2023-06-23T00:56:17.825 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rgw. 2023-06-23T00:56:17.842 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:17.875 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:18.084 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 209 MB in 54s (3,885 kB/s) 2023-06-23T00:56:18.207 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-23T00:56:18.249 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liboath0. 2023-06-23T00:56:18.264 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141758 files and directories currently installed.) 2023-06-23T00:56:18.268 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-06-23T00:56:18.269 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-06-23T00:56:18.299 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-06-23T00:56:18.305 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-06-23T00:56:18.607 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libradosstriper1. 2023-06-23T00:56:18.608 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-23T00:56:18.623 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:18.624 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-06-23T00:56:18.657 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libradosstriper1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:18.666 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-23T00:56:19.003 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cmd2. 2023-06-23T00:56:19.020 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-06-23T00:56:19.061 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-06-23T00:56:19.090 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-common. 2023-06-23T00:56:19.106 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../026-ceph-common_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:19.149 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:19.388 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-06-23T00:56:19.406 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-06-23T00:56:19.489 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-23T00:56:19.825 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../004-librbd1_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:19.955 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librbd1 (17.2.6-719-g42ddc46e-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-23T00:56:20.638 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../005-librados2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:20.761 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librados2 (17.2.6-719-g42ddc46e-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-23T00:56:21.465 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libcephfs2. 2023-06-23T00:56:21.483 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:21.523 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libcephfs2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:21.788 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-base. 2023-06-23T00:56:21.804 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../027-ceph-base_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:21.851 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rados. 2023-06-23T00:56:21.857 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-base (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:21.866 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../007-python3-rados_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:21.901 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rados (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:22.238 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-23T00:56:22.258 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:22.296 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-ceph-argparse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:22.557 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cephfs. 2023-06-23T00:56:22.576 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:22.615 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cephfs (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:22.837 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cryptography. 2023-06-23T00:56:22.852 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-06-23T00:56:22.886 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-23T00:56:22.928 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-23T00:56:22.944 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:22.986 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:23.240 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-openssl. 2023-06-23T00:56:23.258 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-06-23T00:56:23.290 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-06-23T00:56:23.331 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-prettytable. 2023-06-23T00:56:23.350 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-06-23T00:56:23.390 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-06-23T00:56:23.543 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-23T00:56:23.560 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:23.604 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-modules-core (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:23.643 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rbd. 2023-06-23T00:56:23.659 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:23.701 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rbd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:23.965 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-23T00:56:23.984 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-06-23T00:56:24.023 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-23T00:56:24.030 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-06-23T00:56:24.045 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-06-23T00:56:24.080 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-23T00:56:24.351 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-23T00:56:24.367 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-06-23T00:56:24.409 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-06-23T00:56:24.440 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-06-23T00:56:24.456 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-06-23T00:56:24.498 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-06-23T00:56:24.754 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-natsort. 2023-06-23T00:56:24.770 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-06-23T00:56:24.813 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-06-23T00:56:24.851 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-23T00:56:24.871 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-06-23T00:56:24.910 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-23T00:56:25.148 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jwt. 2023-06-23T00:56:25.168 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-06-23T00:56:25.216 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-23T00:56:25.230 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-23T00:56:25.247 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-06-23T00:56:25.279 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-23T00:56:25.527 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-logutils. 2023-06-23T00:56:25.543 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-06-23T00:56:25.585 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-06-23T00:56:25.632 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-23T00:56:25.651 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-06-23T00:56:25.690 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-23T00:56:25.888 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-23T00:56:25.905 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-06-23T00:56:25.948 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-06-23T00:56:26.152 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-23T00:56:26.170 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-23T00:56:26.212 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T00:56:26.275 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-mako. 2023-06-23T00:56:26.293 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-06-23T00:56:26.334 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-23T00:56:26.688 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-23T00:56:26.703 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-23T00:56:26.746 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-23T00:56:26.746 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-23T00:56:26.764 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-23T00:56:26.805 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T00:56:27.040 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-23T00:56:27.057 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-06-23T00:56:27.098 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-06-23T00:56:27.166 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-23T00:56:27.183 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-23T00:56:27.224 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T00:56:27.426 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webob. 2023-06-23T00:56:27.442 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-06-23T00:56:27.484 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-06-23T00:56:27.619 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-06-23T00:56:27.637 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-06-23T00:56:27.677 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-23T00:56:27.813 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-soupsieve. 2023-06-23T00:56:27.833 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-06-23T00:56:27.871 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-23T00:56:28.022 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librgw2. 2023-06-23T00:56:28.039 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../022-librgw2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:28.080 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librgw2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:28.199 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-bs4. 2023-06-23T00:56:28.215 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-06-23T00:56:28.257 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-06-23T00:56:28.593 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-waitress. 2023-06-23T00:56:28.612 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-06-23T00:56:28.655 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-23T00:56:28.866 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rgw. 2023-06-23T00:56:28.886 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:28.924 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:28.972 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempita. 2023-06-23T00:56:28.989 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-06-23T00:56:29.030 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-06-23T00:56:29.245 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liboath0. 2023-06-23T00:56:29.268 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-06-23T00:56:29.303 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-06-23T00:56:29.358 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-paste. 2023-06-23T00:56:29.375 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-06-23T00:56:29.416 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-06-23T00:56:29.657 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libradosstriper1. 2023-06-23T00:56:29.672 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:29.695 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-23T00:56:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-06-23T00:56:29.715 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libradosstriper1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-06-23T00:56:30.064 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-23T00:56:30.084 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-06-23T00:56:30.147 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-06-23T00:56:30.178 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-common. 2023-06-23T00:56:30.193 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../026-ceph-common_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:30.255 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:30.450 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webtest. 2023-06-23T00:56:30.466 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-06-23T00:56:30.508 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-06-23T00:56:30.828 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pecan. 2023-06-23T00:56:30.848 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-06-23T00:56:30.887 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-06-23T00:56:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-23T00:56:31.534 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-06-23T00:56:31.575 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-23T00:56:31.920 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-23T00:56:31.940 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:31.978 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:32.365 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr. 2023-06-23T00:56:32.382 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:32.422 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:32.909 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mon. 2023-06-23T00:56:32.926 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:32.967 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mon (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:32.971 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-base. 2023-06-23T00:56:32.988 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../027-ceph-base_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:33.039 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-base (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:34.092 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cryptography. 2023-06-23T00:56:34.109 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-06-23T00:56:34.146 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-osd. 2023-06-23T00:56:34.150 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-23T00:56:34.163 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:34.204 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-osd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:34.556 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-openssl. 2023-06-23T00:56:34.571 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-06-23T00:56:34.612 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-06-23T00:56:34.884 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-23T00:56:34.897 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:34.948 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-modules-core (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:35.362 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-23T00:56:35.381 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-06-23T00:56:35.420 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-23T00:56:35.707 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-23T00:56:35.726 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-06-23T00:56:35.756 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-06-23T00:56:36.118 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-natsort. 2023-06-23T00:56:36.135 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-06-23T00:56:36.176 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-06-23T00:56:36.471 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jwt. 2023-06-23T00:56:36.487 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-06-23T00:56:36.529 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-23T00:56:36.866 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-logutils. 2023-06-23T00:56:36.886 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-06-23T00:56:36.924 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-06-23T00:56:36.974 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph. 2023-06-23T00:56:36.991 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../055-ceph_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:37.052 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:37.227 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-23T00:56:37.244 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-06-23T00:56:37.286 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-06-23T00:56:37.376 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-fuse. 2023-06-23T00:56:37.393 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:37.435 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:37.572 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-mako. 2023-06-23T00:56:37.591 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-06-23T00:56:37.630 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-23T00:56:37.780 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mds. 2023-06-23T00:56:37.795 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:37.838 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mds (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:37.952 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-23T00:56:37.968 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-23T00:56:38.036 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-23T00:56:38.347 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-23T00:56:38.364 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-06-23T00:56:38.374 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephadm. 2023-06-23T00:56:38.390 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../058-cephadm_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:38.405 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-06-23T00:56:38.432 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:38.666 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-webob. 2023-06-23T00:56:38.684 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-06-23T00:56:38.751 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-06-23T00:56:38.752 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jinja2. 2023-06-23T00:56:38.768 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-06-23T00:56:38.810 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-06-23T00:56:39.044 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-soupsieve. 2023-06-23T00:56:39.061 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-06-23T00:56:39.094 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-23T00:56:39.163 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-23T00:56:39.179 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:39.223 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:39.347 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-bs4. 2023-06-23T00:56:39.366 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-06-23T00:56:39.406 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-06-23T00:56:39.575 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-23T00:56:39.591 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-06-23T00:56:39.633 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-23T00:56:39.758 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-waitress. 2023-06-23T00:56:39.775 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-06-23T00:56:39.819 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-23T00:56:39.861 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjs-underscore. 2023-06-23T00:56:39.880 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-06-23T00:56:39.910 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-23T00:56:40.188 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-tempita. 2023-06-23T00:56:40.204 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-06-23T00:56:40.205 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-06-23T00:56:40.222 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-06-23T00:56:40.245 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-06-23T00:56:40.264 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-23T00:56:40.548 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-paste. 2023-06-23T00:56:40.564 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-06-23T00:56:40.582 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-routes. 2023-06-23T00:56:40.598 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-06-23T00:56:40.607 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-06-23T00:56:40.640 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-06-23T00:56:40.935 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-23T00:56:40.952 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-06-23T00:56:40.969 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-23T00:56:40.986 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:40.993 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-06-23T00:56:41.068 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-dashboard (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:41.296 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-23T00:56:41.312 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-06-23T00:56:41.354 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-06-23T00:56:41.539 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-decorator. 2023-06-23T00:56:41.555 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-06-23T00:56:41.599 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-06-23T00:56:41.791 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-webtest. 2023-06-23T00:56:41.807 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-06-23T00:56:41.849 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-06-23T00:56:42.083 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-06-23T00:56:42.099 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-06-23T00:56:42.141 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-23T00:56:42.160 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pecan. 2023-06-23T00:56:42.176 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-06-23T00:56:42.218 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-06-23T00:56:42.453 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-scipy. 2023-06-23T00:56:42.470 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-06-23T00:56:42.511 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-06-23T00:56:42.582 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-23T00:56:42.598 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-06-23T00:56:42.640 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-23T00:56:43.010 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-23T00:56:43.026 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:43.068 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:43.421 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr. 2023-06-23T00:56:43.440 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:43.479 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:43.787 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-06-23T00:56:43.806 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-06-23T00:56:43.844 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-23T00:56:43.983 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mon. 2023-06-23T00:56:44.000 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:44.041 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mon (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:44.398 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-joblib. 2023-06-23T00:56:44.415 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-06-23T00:56:44.456 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-06-23T00:56:44.826 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn. 2023-06-23T00:56:44.843 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-06-23T00:56:44.885 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-23T00:56:45.187 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-osd. 2023-06-23T00:56:45.204 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:45.244 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-osd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:45.568 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-23T00:56:45.589 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:45.618 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:46.729 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cachetools. 2023-06-23T00:56:46.749 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-06-23T00:56:46.787 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-06-23T00:56:47.123 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-23T00:56:47.140 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-06-23T00:56:47.181 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-06-23T00:56:47.510 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-23T00:56:47.526 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-06-23T00:56:47.568 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-23T00:56:47.879 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rsa. 2023-06-23T00:56:47.898 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-06-23T00:56:47.937 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rsa (4.0-3) ... 2023-06-23T00:56:48.039 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph. 2023-06-23T00:56:48.056 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../055-ceph_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:48.097 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:48.282 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-google-auth. 2023-06-23T00:56:48.299 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-06-23T00:56:48.341 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-06-23T00:56:48.400 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-fuse. 2023-06-23T00:56:48.420 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:48.450 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:48.660 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-blinker. 2023-06-23T00:56:48.677 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-06-23T00:56:48.719 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-23T00:56:48.903 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mds. 2023-06-23T00:56:48.920 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:48.961 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mds (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:49.021 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-oauthlib. 2023-06-23T00:56:49.041 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-06-23T00:56:49.079 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-23T00:56:49.425 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-23T00:56:49.441 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-06-23T00:56:49.481 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephadm. 2023-06-23T00:56:49.483 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-23T00:56:49.497 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../058-cephadm_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:49.531 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:49.834 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jinja2. 2023-06-23T00:56:49.849 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-06-23T00:56:49.880 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-websocket. 2023-06-23T00:56:49.892 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-06-23T00:56:49.896 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-06-23T00:56:49.971 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-06-23T00:56:50.237 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-23T00:56:50.255 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:50.292 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-23T00:56:50.295 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:50.313 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-06-23T00:56:50.350 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-06-23T00:56:50.640 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-23T00:56:50.656 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-06-23T00:56:50.698 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-23T00:56:50.897 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-23T00:56:50.917 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:50.967 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjs-underscore. 2023-06-23T00:56:50.974 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:50.984 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-06-23T00:56:51.025 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-23T00:56:51.292 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-23T00:56:51.303 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-06-23T00:56:51.308 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-06-23T00:56:51.319 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-06-23T00:56:51.350 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-06-23T00:56:51.362 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-23T00:56:51.703 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-23T00:56:51.714 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-routes. 2023-06-23T00:56:51.719 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-23T00:56:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-06-23T00:56:51.761 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-23T00:56:51.772 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-06-23T00:56:52.039 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package jq. 2023-06-23T00:56:52.057 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-23T00:56:52.097 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-06-23T00:56:52.175 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-23T00:56:52.194 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:52.233 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-dashboard (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:52.350 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package socat. 2023-06-23T00:56:52.367 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-06-23T00:56:52.408 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking socat (1.7.3.3-2) ... 2023-06-23T00:56:52.721 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-decorator. 2023-06-23T00:56:52.728 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package xmlstarlet. 2023-06-23T00:56:52.737 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-06-23T00:56:52.744 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-06-23T00:56:52.780 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-06-23T00:56:52.786 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-06-23T00:56:53.114 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-06-23T00:56:53.132 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-06-23T00:56:53.158 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-test. 2023-06-23T00:56:53.172 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-23T00:56:53.177 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../089-ceph-test_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:53.216 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-test (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:53.475 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-scipy. 2023-06-23T00:56:53.494 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-06-23T00:56:53.548 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-06-23T00:56:54.843 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-06-23T00:56:54.862 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-06-23T00:56:54.892 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-23T00:56:55.429 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-joblib. 2023-06-23T00:56:55.450 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-06-23T00:56:55.487 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-06-23T00:56:55.908 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-sklearn. 2023-06-23T00:56:55.925 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-06-23T00:56:55.972 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-23T00:56:56.724 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-23T00:56:56.741 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:56.782 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:57.927 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cachetools. 2023-06-23T00:56:57.944 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-06-23T00:56:57.985 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-06-23T00:56:58.255 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-23T00:56:58.274 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-06-23T00:56:58.294 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-volume. 2023-06-23T00:56:58.313 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-06-23T00:56:58.314 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:58.352 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-volume (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:58.666 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-23T00:56:58.667 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-23T00:56:58.683 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:56:58.688 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-06-23T00:56:58.724 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-mirror (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:58.730 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-23T00:56:59.019 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rsa. 2023-06-23T00:56:59.038 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-06-23T00:56:59.060 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-colorama. 2023-06-23T00:56:59.076 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-06-23T00:56:59.077 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rsa (4.0-3) ... 2023-06-23T00:56:59.120 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-06-23T00:56:59.362 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-shell. 2023-06-23T00:56:59.378 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:59.406 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-google-auth. 2023-06-23T00:56:59.421 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-shell (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:59.422 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-06-23T00:56:59.469 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-06-23T00:56:59.675 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-top. 2023-06-23T00:56:59.690 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:56:59.731 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-top (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:56:59.768 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-blinker. 2023-06-23T00:56:59.785 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-06-23T00:56:59.825 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-23T00:57:00.009 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package fonts-mathjax. 2023-06-23T00:57:00.025 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-23T00:57:00.067 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-23T00:57:00.145 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-oauthlib. 2023-06-23T00:57:00.161 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-06-23T00:57:00.203 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-23T00:57:00.515 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-23T00:57:00.535 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-06-23T00:57:00.554 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-23T00:57:00.571 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:57:00.572 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-23T00:57:00.621 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs-dev (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:00.978 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-websocket. 2023-06-23T00:57:00.996 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-06-23T00:57:01.036 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-06-23T00:57:01.049 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package nvme-cli. 2023-06-23T00:57:01.066 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-06-23T00:57:01.124 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-06-23T00:57:01.373 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-23T00:57:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-06-23T00:57:01.431 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-06-23T00:57:01.454 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjs-mathjax. 2023-06-23T00:57:01.473 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-23T00:57:01.512 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-23T00:57:02.026 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-23T00:57:02.046 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:57:02.103 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:02.414 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-23T00:57:02.432 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-06-23T00:57:02.472 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-06-23T00:57:02.859 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-23T00:57:02.876 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-23T00:57:02.917 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-23T00:57:03.195 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package jq. 2023-06-23T00:57:03.212 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-23T00:57:03.253 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-06-23T00:57:03.523 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package socat. 2023-06-23T00:57:03.540 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-06-23T00:57:03.581 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking socat (1.7.3.3-2) ... 2023-06-23T00:57:03.588 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-natsort-doc. 2023-06-23T00:57:03.606 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-06-23T00:57:03.647 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-06-23T00:57:03.892 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package xmlstarlet. 2023-06-23T00:57:03.911 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-06-23T00:57:03.953 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-06-23T00:57:04.016 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-atomicwrites. 2023-06-23T00:57:04.037 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-06-23T00:57:04.074 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-06-23T00:57:04.347 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-test. 2023-06-23T00:57:04.364 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../089-ceph-test_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:57:04.377 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-attr. 2023-06-23T00:57:04.395 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-06-23T00:57:04.405 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-test (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:04.438 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-06-23T00:57:04.755 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webencodings. 2023-06-23T00:57:04.771 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-06-23T00:57:04.813 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-23T00:57:05.140 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-html5lib. 2023-06-23T00:57:05.157 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-06-23T00:57:05.199 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-06-23T00:57:05.528 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-06-23T00:57:05.549 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-06-23T00:57:05.591 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-23T00:57:06.056 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-packaging. 2023-06-23T00:57:06.077 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-06-23T00:57:06.114 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-packaging (20.3-1) ... 2023-06-23T00:57:06.400 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastescript. 2023-06-23T00:57:06.417 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-06-23T00:57:06.458 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-23T00:57:06.795 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pluggy. 2023-06-23T00:57:06.813 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-06-23T00:57:06.853 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-06-23T00:57:07.190 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-psutil. 2023-06-23T00:57:07.207 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-06-23T00:57:07.248 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-06-23T00:57:07.584 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-py. 2023-06-23T00:57:07.601 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-06-23T00:57:07.642 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-06-23T00:57:07.996 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-23T00:57:08.013 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-06-23T00:57:08.054 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-23T00:57:08.348 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pytest. 2023-06-23T00:57:08.369 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-06-23T00:57:08.406 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-06-23T00:57:08.752 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplejson. 2023-06-23T00:57:08.771 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-06-23T00:57:08.810 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-23T00:57:09.113 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-23T00:57:09.130 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-06-23T00:57:09.171 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-23T00:57:09.392 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-volume. 2023-06-23T00:57:09.409 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:57:09.450 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-volume (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:09.772 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-23T00:57:09.791 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:57:09.863 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephfs-mirror (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:09.925 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package radosgw. 2023-06-23T00:57:09.942 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../114-radosgw_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:57:09.983 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking radosgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:10.183 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-colorama. 2023-06-23T00:57:10.203 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-06-23T00:57:10.240 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-06-23T00:57:10.502 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephfs-shell. 2023-06-23T00:57:10.520 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:57:10.577 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephfs-shell (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:10.812 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephfs-top. 2023-06-23T00:57:10.829 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T00:57:10.862 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephfs-top (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:11.106 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package fonts-mathjax. 2023-06-23T00:57:11.125 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-23T00:57:11.165 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-23T00:57:11.720 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package rbd-fuse. 2023-06-23T00:57:11.727 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-23T00:57:11.739 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:57:11.743 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:57:11.778 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking rbd-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:11.785 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libcephfs-dev (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:12.115 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-attr (19.3.0-2) ... 2023-06-23T00:57:12.205 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package nvme-cli. 2023-06-23T00:57:12.222 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-06-23T00:57:12.280 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-06-23T00:57:12.408 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-06-23T00:57:12.509 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-23T00:57:12.610 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjs-mathjax. 2023-06-23T00:57:12.627 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-23T00:57:12.635 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-06-23T00:57:12.692 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-23T00:57:12.829 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:13.482 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user cephadm....done 2023-06-23T00:57:13.652 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-23T00:57:13.778 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-23T00:57:14.139 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-23T00:57:14.344 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python-natsort-doc. 2023-06-23T00:57:14.362 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-06-23T00:57:14.402 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-06-23T00:57:14.432 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-23T00:57:14.558 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-06-23T00:57:14.684 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-06-23T00:57:14.730 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-atomicwrites. 2023-06-23T00:57:14.751 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-06-23T00:57:14.796 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-06-23T00:57:15.027 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-06-23T00:57:15.091 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-attr. 2023-06-23T00:57:15.111 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-06-23T00:57:15.149 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-06-23T00:57:15.413 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-23T00:57:15.502 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-webencodings. 2023-06-23T00:57:15.519 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-06-23T00:57:15.560 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-23T00:57:15.706 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-06-23T00:57:15.846 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-html5lib. 2023-06-23T00:57:15.866 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-06-23T00:57:15.904 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-06-23T00:57:16.003 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-06-23T00:57:16.262 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-23T00:57:16.267 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-06-23T00:57:16.285 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-06-23T00:57:16.326 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-23T00:57:16.513 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-23T00:57:16.770 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-packaging. 2023-06-23T00:57:16.788 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-06-23T00:57:16.798 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-argparse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:16.828 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-packaging (20.3-1) ... 2023-06-23T00:57:17.124 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-23T00:57:17.165 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pastescript. 2023-06-23T00:57:17.182 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-06-23T00:57:17.222 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-23T00:57:17.250 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-06-23T00:57:17.526 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pluggy. 2023-06-23T00:57:17.534 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-06-23T00:57:17.547 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-06-23T00:57:17.619 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-06-23T00:57:17.819 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-23T00:57:17.929 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-psutil. 2023-06-23T00:57:17.948 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-06-23T00:57:17.987 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-06-23T00:57:18.112 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-23T00:57:18.213 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-06-23T00:57:18.340 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-py. 2023-06-23T00:57:18.360 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-06-23T00:57:18.407 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-06-23T00:57:18.573 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-06-23T00:57:18.752 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-23T00:57:18.769 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-06-23T00:57:18.809 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-23T00:57:18.879 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-06-23T00:57:19.137 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pytest. 2023-06-23T00:57:19.158 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-06-23T00:57:19.159 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-23T00:57:19.195 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-06-23T00:57:19.510 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-06-23T00:57:19.549 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-simplejson. 2023-06-23T00:57:19.568 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-06-23T00:57:19.607 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-23T00:57:19.795 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-06-23T00:57:19.919 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-23T00:57:19.935 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-06-23T00:57:19.976 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-23T00:57:20.130 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-06-23T00:57:20.414 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-packaging (20.3-1) ... 2023-06-23T00:57:20.713 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-06-23T00:57:20.756 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package radosgw. 2023-06-23T00:57:20.773 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../114-radosgw_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:57:20.814 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking radosgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:20.828 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-23T00:57:20.955 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-23T00:57:21.231 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-06-23T00:57:21.633 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-06-23T00:57:21.936 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-23T00:57:22.294 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-23T00:57:22.639 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package rbd-fuse. 2023-06-23T00:57:22.829 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T00:57:22.829 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up socat (1.7.3.3-2) ... 2023-06-23T00:57:22.829 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:22.909 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking rbd-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:23.127 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T00:57:23.192 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-attr (19.3.0-2) ... 2023-06-23T00:57:23.260 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-06-23T00:57:23.514 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-06-23T00:57:23.612 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-23T00:57:23.649 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-23T00:57:23.721 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-06-23T00:57:23.776 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-06-23T00:57:23.872 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-06-23T00:57:24.002 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:24.165 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-23T00:57:24.475 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T00:57:24.601 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-23T00:57:24.655 INFO:teuthology.orchestra.run.smithi149.stdout:Adding system user cephadm....done 2023-06-23T00:57:24.727 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-06-23T00:57:24.817 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-23T00:57:24.935 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-23T00:57:25.087 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-06-23T00:57:25.287 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-23T00:57:25.355 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-06-23T00:57:25.623 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-23T00:57:25.664 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-23T00:57:25.750 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-06-23T00:57:25.790 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-23T00:57:25.882 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-06-23T00:57:26.091 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-06-23T00:57:26.200 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-06-23T00:57:26.376 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-23T00:57:26.586 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-23T00:57:26.677 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-06-23T00:57:26.881 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-06-23T00:57:27.056 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-06-23T00:57:27.159 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-06-23T00:57:27.313 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-06-23T00:57:27.415 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-23T00:57:27.460 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-23T00:57:27.733 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-06-23T00:57:27.744 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-23T00:57:28.037 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-ceph-argparse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:28.109 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-23T00:57:28.237 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-23T00:57:28.338 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-06-23T00:57:28.346 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-23T00:57:28.472 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-06-23T00:57:28.657 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-23T00:57:28.757 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-06-23T00:57:28.942 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librados2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:29.066 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-23T00:57:29.067 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-06-23T00:57:29.351 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-23T00:57:29.469 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-06-23T00:57:29.886 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-06-23T00:57:30.171 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-06-23T00:57:30.481 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-23T00:57:30.535 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsqlite3-mod-ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:30.661 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-23T00:57:30.804 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-06-23T00:57:30.841 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-06-23T00:57:31.117 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-06-23T00:57:31.164 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-06-23T00:57:31.448 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-06-23T00:57:31.459 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-06-23T00:57:31.734 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T00:57:31.752 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-packaging (20.3-1) ... 2023-06-23T00:57:31.888 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-06-23T00:57:32.033 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-06-23T00:57:32.158 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-23T00:57:32.181 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:32.268 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-23T00:57:32.307 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-23T00:57:32.569 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-06-23T00:57:32.626 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libradosstriper1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:32.785 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-23T00:57:32.971 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-06-23T00:57:33.111 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-23T00:57:33.289 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-23T00:57:33.674 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-23T00:57:34.053 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up socat (1.7.3.3-2) ... 2023-06-23T00:57:34.117 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librbd1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:34.179 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:34.244 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-23T00:57:34.369 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-06-23T00:57:34.487 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-06-23T00:57:34.513 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T00:57:34.612 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rsa (4.0-3) ... 2023-06-23T00:57:34.648 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-06-23T00:57:34.922 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-23T00:57:34.983 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-23T00:57:35.048 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-06-23T00:57:35.109 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-06-23T00:57:35.244 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-06-23T00:57:35.443 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-modules-core (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:35.528 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-23T00:57:35.569 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:35.789 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T00:57:35.789 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T00:57:35.837 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T00:57:35.996 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-23T00:57:36.123 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-06-23T00:57:36.229 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs-dev (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:36.355 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-23T00:57:36.449 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-06-23T00:57:36.623 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-23T00:57:36.742 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-06-23T00:57:36.925 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-06-23T00:57:37.026 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-23T00:57:37.144 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-23T00:57:37.277 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rados (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:37.403 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librgw2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:37.420 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-06-23T00:57:37.529 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-top (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:37.655 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rbd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:37.696 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-23T00:57:37.798 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up rbd-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:37.916 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-routes (2.4.1-2) ... 2023-06-23T00:57:38.022 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-06-23T00:57:38.201 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-06-23T00:57:38.463 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-06-23T00:57:38.502 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:38.628 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cephfs (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:38.733 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-06-23T00:57:38.779 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-shell (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:38.859 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-23T00:57:38.905 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-06-23T00:57:39.152 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-06-23T00:57:39.504 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-23T00:57:39.631 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-23T00:57:39.756 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-06-23T00:57:39.808 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:40.126 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-23T00:57:40.345 INFO:teuthology.orchestra.run.smithi097.stdout:Adding group ceph....done 2023-06-23T00:57:40.411 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librados2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:40.537 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-06-23T00:57:40.746 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user ceph....done 2023-06-23T00:57:40.889 INFO:teuthology.orchestra.run.smithi097.stdout:Setting system user ceph properties....done 2023-06-23T00:57:40.908 INFO:teuthology.orchestra.run.smithi097.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-23T00:57:41.055 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-23T00:57:41.381 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-23T00:57:41.844 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-mirror (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:41.969 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-test (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:42.011 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libsqlite3-mod-ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:42.095 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up radosgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:42.139 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-23T00:57:42.290 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-06-23T00:57:42.343 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T00:57:42.343 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T00:57:42.675 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-06-23T00:57:42.968 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-06-23T00:57:42.989 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-base (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:43.236 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T00:57:43.366 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-23T00:57:43.370 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-06-23T00:57:43.713 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libcephfs2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:43.824 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mds (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:43.853 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-23T00:57:44.052 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T00:57:44.053 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T00:57:44.176 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libradosstriper1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:44.302 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-23T00:57:44.510 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:44.654 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-23T00:57:44.738 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T00:57:44.738 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T00:57:45.195 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-osd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:45.684 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librbd1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:45.693 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T00:57:45.694 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T00:57:45.827 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-23T00:57:45.944 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-06-23T00:57:46.070 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-06-23T00:57:46.147 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-k8sevents (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:46.197 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rsa (4.0-3) ... 2023-06-23T00:57:46.281 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:46.415 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mon (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:46.506 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-23T00:57:46.632 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-06-23T00:57:46.642 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T00:57:46.642 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T00:57:47.019 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-modules-core (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:47.108 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:47.161 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:47.251 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:47.377 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-dashboard (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:47.384 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T00:57:47.384 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T00:57:47.506 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-volume (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:47.658 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-23T00:57:47.809 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-23T00:57:47.871 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libcephfs-dev (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:47.997 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-23T00:57:48.094 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-23T00:57:48.290 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-23T00:57:48.600 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-06-23T00:57:48.961 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rados (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:49.087 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librgw2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:49.213 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephfs-top (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:49.364 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rbd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:49.490 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up rbd-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:49.610 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-routes (2.4.1-2) ... 2023-06-23T00:57:49.895 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-06-23T00:57:50.213 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:50.338 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cephfs (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:50.456 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephfs-shell (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:50.574 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-06-23T00:57:50.939 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-06-23T00:57:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T00:57:51.481 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-06-23T00:57:51.519 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:51.551 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2023-06-23T00:57:51.746 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2023-06-23T00:57:51.747 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2023-06-23T00:57:51.929 INFO:teuthology.orchestra.run.smithi097.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-06-23T00:57:51.929 INFO:teuthology.orchestra.run.smithi097.stdout:flex is already the newest version (2.6.4-6.2). 2023-06-23T00:57:51.929 INFO:teuthology.orchestra.run.smithi097.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-06-23T00:57:51.929 INFO:teuthology.orchestra.run.smithi097.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-23T00:57:51.930 INFO:teuthology.orchestra.run.smithi097.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-23T00:57:51.930 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T00:57:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-23T00:57:51.931 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T00:57:51.931 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2023-06-23T00:57:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-06-23T00:57:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-06-23T00:57:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-06-23T00:57:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: usb-modeswitch-data wpasupplicant 2023-06-23T00:57:51.932 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2023-06-23T00:57:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-06-23T00:57:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-06-23T00:57:51.974 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2023-06-23T00:57:51.975 INFO:teuthology.orchestra.run.smithi097.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-06-23T00:57:51.975 INFO:teuthology.orchestra.run.smithi097.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-06-23T00:57:51.976 INFO:teuthology.orchestra.run.smithi097.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-06-23T00:57:51.976 INFO:teuthology.orchestra.run.smithi097.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T00:57:51.977 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2023-06-23T00:57:51.977 INFO:teuthology.orchestra.run.smithi097.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-06-23T00:57:52.091 INFO:teuthology.orchestra.run.smithi149.stdout:Adding group ceph....done 2023-06-23T00:57:52.160 INFO:teuthology.orchestra.run.smithi097.stdout:4 upgraded, 23 newly installed, 0 to remove and 201 not upgraded. 2023-06-23T00:57:52.160 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 10.2 MB of archives. 2023-06-23T00:57:52.160 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-06-23T00:57:52.160 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-06-23T00:57:52.431 INFO:teuthology.orchestra.run.smithi149.stdout:Adding system user ceph....done 2023-06-23T00:57:52.608 INFO:teuthology.orchestra.run.smithi149.stdout:Setting system user ceph properties....done 2023-06-23T00:57:52.629 INFO:teuthology.orchestra.run.smithi149.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-23T00:57:52.776 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-23T00:57:52.783 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-06-23T00:57:52.784 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-06-23T00:57:52.785 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-06-23T00:57:52.882 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-06-23T00:57:52.886 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-06-23T00:57:52.896 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-06-23T00:57:52.899 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-06-23T00:57:52.899 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-06-23T00:57:52.902 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-06-23T00:57:52.905 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-06-23T00:57:53.076 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-06-23T00:57:53.089 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-23T00:57:53.159 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-06-23T00:57:53.450 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-06-23T00:57:53.456 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-06-23T00:57:53.575 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-06-23T00:57:53.662 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-06-23T00:57:53.663 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-06-23T00:57:53.758 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-06-23T00:57:53.759 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-06-23T00:57:53.779 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephfs-mirror (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:53.791 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-06-23T00:57:53.825 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-06-23T00:57:54.013 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-test (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:54.045 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-06-23T00:57:54.139 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up radosgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:54.441 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T00:57:54.441 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T00:57:54.532 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-06-23T00:57:54.539 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-06-23T00:57:54.545 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-06-23T00:57:54.550 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-06-23T00:57:54.887 INFO:teuthology.orchestra.run.smithi097.stdout:Preconfiguring packages ... 2023-06-23T00:57:55.029 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 10.2 MB in 3s (3,948 kB/s) 2023-06-23T00:57:55.107 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-base (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:55.293 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-23T00:57:55.298 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-23T00:57:55.450 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-23T00:57:55.486 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-23T00:57:55.951 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mds (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:56.191 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T00:57:56.191 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T00:57:56.575 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-06-23T00:57:56.636 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:56.865 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T00:57:56.865 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T00:57:57.321 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-osd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:57.825 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T00:57:57.826 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T00:57:58.006 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-23T00:57:58.012 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-23T00:57:58.118 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-23T00:57:58.281 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-k8sevents (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:58.432 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:58.507 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-23T00:57:58.574 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mon (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:58.707 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-23T00:57:58.800 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T00:57:58.801 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T00:57:59.030 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-06-23T00:57:59.260 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:59.403 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:59.514 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-23T00:57:59.518 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-23T00:57:59.529 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-dashboard (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:59.673 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-volume (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T00:57:59.715 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-06-23T00:57:59.774 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-23T00:57:59.942 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-23T00:58:00.228 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-23T00:58:00.236 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-23T00:58:00.257 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-06-23T00:58:00.286 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-06-23T00:58:00.655 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package dump. 2023-06-23T00:58:00.674 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-06-23T00:58:00.714 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking dump (0.4b46-6) ... 2023-06-23T00:58:01.017 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package indent. 2023-06-23T00:58:01.034 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-06-23T00:58:01.075 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking indent (2.2.12-1) ... 2023-06-23T00:58:01.395 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-23T00:58:01.415 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-06-23T00:58:01.453 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-06-23T00:58:01.790 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-23T00:58:01.810 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-06-23T00:58:01.848 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-23T00:58:02.110 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-23T00:58:02.126 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-06-23T00:58:02.167 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-23T00:58:02.537 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-23T00:58:02.555 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T00:58:02.595 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T00:58:02.874 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-23T00:58:02.892 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T00:58:02.931 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T00:58:03.082 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-06-23T00:58:03.259 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-23T00:58:03.277 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T00:58:03.318 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T00:58:03.620 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-23T00:58:03.637 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-06-23T00:58:03.670 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-23T00:58:03.689 INFO:teuthology.orchestra.run.smithi149.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T00:58:03.691 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-06-23T00:58:03.762 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-23T00:58:03.958 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2023-06-23T00:58:03.959 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2023-06-23T00:58:03.973 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-23T00:58:03.993 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-23T00:58:04.031 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-23T00:58:04.146 INFO:teuthology.orchestra.run.smithi149.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-06-23T00:58:04.146 INFO:teuthology.orchestra.run.smithi149.stdout:flex is already the newest version (2.6.4-6.2). 2023-06-23T00:58:04.146 INFO:teuthology.orchestra.run.smithi149.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-06-23T00:58:04.147 INFO:teuthology.orchestra.run.smithi149.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-23T00:58:04.147 INFO:teuthology.orchestra.run.smithi149.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-23T00:58:04.147 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T00:58:04.148 INFO:teuthology.orchestra.run.smithi149.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-23T00:58:04.148 INFO:teuthology.orchestra.run.smithi149.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T00:58:04.148 INFO:teuthology.orchestra.run.smithi149.stdout:The following additional packages will be installed: 2023-06-23T00:58:04.148 INFO:teuthology.orchestra.run.smithi149.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-06-23T00:58:04.148 INFO:teuthology.orchestra.run.smithi149.stdout: libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-06-23T00:58:04.149 INFO:teuthology.orchestra.run.smithi149.stdout: modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-06-23T00:58:04.149 INFO:teuthology.orchestra.run.smithi149.stdout: usb-modeswitch-data wpasupplicant 2023-06-23T00:58:04.150 INFO:teuthology.orchestra.run.smithi149.stdout:Suggested packages: 2023-06-23T00:58:04.150 INFO:teuthology.orchestra.run.smithi149.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-06-23T00:58:04.151 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-06-23T00:58:04.194 INFO:teuthology.orchestra.run.smithi149.stdout:The following NEW packages will be installed: 2023-06-23T00:58:04.194 INFO:teuthology.orchestra.run.smithi149.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-06-23T00:58:04.195 INFO:teuthology.orchestra.run.smithi149.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-06-23T00:58:04.195 INFO:teuthology.orchestra.run.smithi149.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-06-23T00:58:04.195 INFO:teuthology.orchestra.run.smithi149.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T00:58:04.196 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages will be upgraded: 2023-06-23T00:58:04.197 INFO:teuthology.orchestra.run.smithi149.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-06-23T00:58:04.251 INFO:teuthology.orchestra.run.smithi149.stdout:4 upgraded, 23 newly installed, 0 to remove and 201 not upgraded. 2023-06-23T00:58:04.251 INFO:teuthology.orchestra.run.smithi149.stdout:Need to get 10.2 MB of archives. 2023-06-23T00:58:04.251 INFO:teuthology.orchestra.run.smithi149.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-06-23T00:58:04.251 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-06-23T00:58:04.381 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-06-23T00:58:04.381 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-06-23T00:58:04.382 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-06-23T00:58:04.401 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-06-23T00:58:04.402 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-06-23T00:58:04.403 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-06-23T00:58:04.404 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-06-23T00:58:04.404 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-06-23T00:58:04.405 INFO:teuthology.orchestra.run.smithi149.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-06-23T00:58:04.406 INFO:teuthology.orchestra.run.smithi149.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-06-23T00:58:04.410 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-23T00:58:04.427 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../12-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T00:58:04.442 INFO:teuthology.orchestra.run.smithi149.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-06-23T00:58:04.461 INFO:teuthology.orchestra.run.smithi149.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-06-23T00:58:04.468 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T00:58:04.521 INFO:teuthology.orchestra.run.smithi149.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-06-23T00:58:04.522 INFO:teuthology.orchestra.run.smithi149.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-06-23T00:58:04.547 INFO:teuthology.orchestra.run.smithi149.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-06-23T00:58:04.565 INFO:teuthology.orchestra.run.smithi149.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-06-23T00:58:04.566 INFO:teuthology.orchestra.run.smithi149.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-06-23T00:58:04.586 INFO:teuthology.orchestra.run.smithi149.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-06-23T00:58:04.586 INFO:teuthology.orchestra.run.smithi149.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-06-23T00:58:04.593 INFO:teuthology.orchestra.run.smithi149.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-06-23T00:58:04.604 INFO:teuthology.orchestra.run.smithi149.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-06-23T00:58:04.653 INFO:teuthology.orchestra.run.smithi149.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-06-23T00:58:04.754 INFO:teuthology.orchestra.run.smithi149.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-06-23T00:58:04.756 INFO:teuthology.orchestra.run.smithi149.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-06-23T00:58:04.757 INFO:teuthology.orchestra.run.smithi149.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-06-23T00:58:04.758 INFO:teuthology.orchestra.run.smithi149.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-06-23T00:58:05.084 INFO:teuthology.orchestra.run.smithi149.stdout:Preconfiguring packages ... 2023-06-23T00:58:05.245 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 10.2 MB in 1s (18.3 MB/s) 2023-06-23T00:58:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-23T00:58:05.399 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../13-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T00:58:05.439 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T00:58:05.540 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-23T00:58:05.545 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-23T00:58:05.692 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-23T00:58:05.716 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-23T00:58:05.736 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../14-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-23T00:58:05.774 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-23T00:58:06.228 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-23T00:58:06.248 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../15-libteamdctl0_1.30-1_amd64.deb ... 2023-06-23T00:58:06.278 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-06-23T00:58:06.673 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package modemmanager. 2023-06-23T00:58:06.691 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../16-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T00:58:06.741 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T00:58:06.852 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-06-23T00:58:07.355 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package wpasupplicant. 2023-06-23T00:58:07.371 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../17-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-06-23T00:58:07.412 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-23T00:58:07.967 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package network-manager. 2023-06-23T00:58:07.984 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../18-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-23T00:58:08.050 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-06-23T00:58:08.215 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-23T00:58:08.220 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-23T00:58:08.369 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-23T00:58:08.774 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-23T00:58:08.791 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ppp. 2023-06-23T00:58:08.810 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../19-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-06-23T00:58:08.969 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-23T00:58:09.081 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-23T00:58:09.420 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package pptp-linux. 2023-06-23T00:58:09.436 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-06-23T00:58:09.440 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../20-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-06-23T00:58:09.495 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-06-23T00:58:09.874 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-23T00:58:09.891 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../21-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-06-23T00:58:09.949 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-06-23T00:58:09.952 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-23T00:58:09.958 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-23T00:58:10.091 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-06-23T00:58:10.201 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-23T00:58:10.222 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../22-usb-modeswitch-data_20191128-3_all.deb ... 2023-06-23T00:58:10.259 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-06-23T00:58:10.629 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-23T00:58:10.648 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-06-23T00:58:10.687 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-06-23T00:58:10.832 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-23T00:58:10.851 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../23-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-06-23T00:58:10.900 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-23T00:58:11.015 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package dump. 2023-06-23T00:58:11.035 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-06-23T00:58:11.098 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking dump (0.4b46-6) ... 2023-06-23T00:58:11.194 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-23T00:58:11.402 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package indent. 2023-06-23T00:58:11.423 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-06-23T00:58:11.460 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking indent (2.2.12-1) ... 2023-06-23T00:58:11.537 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-06-23T00:58:11.646 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-06-23T00:58:11.772 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-23T00:58:11.813 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-23T00:58:11.832 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-06-23T00:58:11.872 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-06-23T00:58:12.173 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T00:58:12.174 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T00:58:12.183 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-23T00:58:12.204 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-06-23T00:58:12.241 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-23T00:58:12.544 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-23T00:58:12.561 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-06-23T00:58:12.602 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-23T00:58:12.659 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-06-23T00:58:12.784 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-06-23T00:58:12.911 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-23T00:58:12.956 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-23T00:58:12.976 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T00:58:13.014 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T00:58:13.037 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-06-23T00:58:13.163 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-23T00:58:13.289 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-23T00:58:13.291 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-23T00:58:13.309 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T00:58:13.341 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T00:58:13.448 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-23T00:58:13.678 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-23T00:58:13.696 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T00:58:13.736 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T00:58:14.122 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-23T00:58:14.139 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-06-23T00:58:14.180 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-23T00:58:14.418 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-06-23T00:58:14.449 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-23T00:58:14.466 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-23T00:58:14.499 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-23T00:58:14.654 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up dump (0.4b46-6) ... 2023-06-23T00:58:14.750 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-23T00:58:14.814 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T00:58:14.949 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-23T00:58:15.075 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up indent (2.2.12-1) ... 2023-06-23T00:58:15.201 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-23T00:58:15.377 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-23T00:58:15.528 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T00:58:15.654 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-06-23T00:58:15.822 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-06-23T00:58:16.033 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-23T00:58:16.053 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../12-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T00:58:16.305 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T00:58:16.617 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-23T00:58:16.635 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../13-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T00:58:16.666 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T00:58:16.716 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:16.716 INFO:teuthology.orchestra.run.smithi097.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-23T00:58:16.717 INFO:teuthology.orchestra.run.smithi097.stdout:which means they are currently configured by ifupdown: 2023-06-23T00:58:16.717 INFO:teuthology.orchestra.run.smithi097.stdout:- enp3s0f1 2023-06-23T00:58:16.717 INFO:teuthology.orchestra.run.smithi097.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-23T00:58:16.717 INFO:teuthology.orchestra.run.smithi097.stdout:remove their configuration from /etc/network/interfaces. 2023-06-23T00:58:16.717 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:16.872 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-23T00:58:16.911 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-23T00:58:16.929 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../14-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-23T00:58:16.985 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-23T00:58:17.206 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-23T00:58:17.439 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-23T00:58:17.459 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../15-libteamdctl0_1.30-1_amd64.deb ... 2023-06-23T00:58:17.489 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-06-23T00:58:17.730 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-23T00:58:17.883 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package modemmanager. 2023-06-23T00:58:17.901 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../16-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T00:58:17.952 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T00:58:18.218 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T00:58:18.352 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-06-23T00:58:18.528 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T00:58:18.623 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package wpasupplicant. 2023-06-23T00:58:18.641 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../17-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-06-23T00:58:18.654 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T00:58:18.681 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-23T00:58:18.781 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T00:58:19.048 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T00:58:19.049 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T00:58:19.245 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package network-manager. 2023-06-23T00:58:19.262 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../18-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-23T00:58:19.327 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-06-23T00:58:19.577 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-06-23T00:58:19.686 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-23T00:58:19.812 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-23T00:58:19.963 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-23T00:58:20.068 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ppp. 2023-06-23T00:58:20.085 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../19-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-06-23T00:58:20.265 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-23T00:58:20.352 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-23T00:58:20.723 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package pptp-linux. 2023-06-23T00:58:20.741 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../20-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-06-23T00:58:20.781 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-06-23T00:58:21.101 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-23T00:58:21.118 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../21-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-06-23T00:58:21.211 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-06-23T00:58:21.601 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-23T00:58:21.620 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../22-usb-modeswitch-data_20191128-3_all.deb ... 2023-06-23T00:58:21.847 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-06-23T00:58:22.751 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-23T00:58:22.772 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../23-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-06-23T00:58:22.812 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-23T00:58:23.097 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-23T00:58:23.406 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-06-23T00:58:23.533 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-06-23T00:58:23.650 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-23T00:58:23.967 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-06-23T00:58:24.051 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T00:58:24.052 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T00:58:24.067 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-23T00:58:24.512 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-06-23T00:58:24.629 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-06-23T00:58:24.780 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-23T00:58:24.891 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T00:58:24.893 DEBUG:teuthology.parallel:result is None 2023-06-23T00:58:24.906 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-06-23T00:58:25.034 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-23T00:58:25.158 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-23T00:58:25.284 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-23T00:58:26.205 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-06-23T00:58:26.431 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up dump (0.4b46-6) ... 2023-06-23T00:58:26.525 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-23T00:58:26.592 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T00:58:26.717 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-23T00:58:26.887 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up indent (2.2.12-1) ... 2023-06-23T00:58:27.012 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-23T00:58:27.188 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-23T00:58:27.314 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T00:58:27.424 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-06-23T00:58:27.904 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-06-23T00:58:28.792 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:28.792 INFO:teuthology.orchestra.run.smithi149.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-23T00:58:28.793 INFO:teuthology.orchestra.run.smithi149.stdout:which means they are currently configured by ifupdown: 2023-06-23T00:58:28.793 INFO:teuthology.orchestra.run.smithi149.stdout:- enp3s0f1 2023-06-23T00:58:28.793 INFO:teuthology.orchestra.run.smithi149.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-23T00:58:28.793 INFO:teuthology.orchestra.run.smithi149.stdout:remove their configuration from /etc/network/interfaces. 2023-06-23T00:58:28.793 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:28.954 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-23T00:58:29.277 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-23T00:58:29.814 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-23T00:58:30.337 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T00:58:30.471 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-06-23T00:58:30.614 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T00:58:30.723 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T00:58:30.849 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T00:58:31.123 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T00:58:31.123 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T00:58:31.635 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-06-23T00:58:31.770 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-23T00:58:31.896 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-23T00:58:32.047 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-23T00:58:32.340 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-23T00:58:36.359 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-06-23T00:58:36.459 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-23T00:58:37.287 INFO:teuthology.orchestra.run.smithi149.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T00:58:37.289 DEBUG:teuthology.parallel:result is None 2023-06-23T00:58:37.290 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-23T00:58:37.510 DEBUG:teuthology.orchestra.run.smithi097:> dpkg-query -W -f '${Version}' ceph 2023-06-23T00:58:37.537 INFO:teuthology.orchestra.run.smithi097.stdout:17.2.6-719-g42ddc46e-1focal 2023-06-23T00:58:37.538 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-719-g42ddc46e-1focal 2023-06-23T00:58:37.538 INFO:teuthology.task.install:The correct ceph version 17.2.6-719-g42ddc46e-1focal is installed. 2023-06-23T00:58:37.540 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-23T00:58:37.689 DEBUG:teuthology.orchestra.run.smithi149:> dpkg-query -W -f '${Version}' ceph 2023-06-23T00:58:37.714 INFO:teuthology.orchestra.run.smithi149.stdout:17.2.6-719-g42ddc46e-1focal 2023-06-23T00:58:37.714 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-719-g42ddc46e-1focal 2023-06-23T00:58:37.714 INFO:teuthology.task.install:The correct ceph version 17.2.6-719-g42ddc46e-1focal is installed. 2023-06-23T00:58:37.715 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-23T00:58:37.715 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:58:37.716 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T00:58:37.732 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:58:37.733 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T00:58:37.750 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-23T00:58:37.751 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:58:37.751 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T00:58:37.791 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T00:58:37.801 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:58:37.801 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T00:58:37.817 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T00:58:37.827 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-23T00:58:37.828 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:58:37.828 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T00:58:37.843 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T00:58:37.900 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:58:37.900 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T00:58:37.917 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T00:58:37.975 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-23T00:58:37.976 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:58:37.976 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T00:58:37.992 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T00:58:38.050 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:58:38.050 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T00:58:38.066 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T00:58:38.126 INFO:teuthology.run_tasks:Running task ceph... 2023-06-23T00:58:38.210 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-23T00:58:38.210 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2023-06-23T00:58:38.213 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2023-06-23T00:58:38.228 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-23T00:58:38.229 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T00:58:38.231 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T00:58:38.287 INFO:tasks.ceph:Creating extra log directories... 2023-06-23T00:58:38.288 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T00:58:38.290 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T00:58:38.309 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-23T00:58:38.309 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-23T00:58:38.310 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-23T00:58:38.310 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:58:38.311 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T00:58:38.317 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T00:58:38.355 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:58:38.356 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T00:58:38.362 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T00:58:38.407 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-23T00:58:38.407 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'Error loading MDS rank', 'missing journal object', 'Error recovering journal', 'error decoding table object', 'failed to read JournalPointer', 'Corrupt directory entry', 'Corrupt fnode header', 'corrupt sessionmap header', 'Corrupt dentry', 'Scrub error on inode', 'Metadata damage detected', 'MDS_READ_ONLY', 'force file system read-only', 'with standby daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-23T00:58:38.408 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916', 'branch': 'wip-yuri4-testing-2023-06-21-0846-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7311916', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2023-06-21-0846-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'Error loading MDS rank', 'missing journal object', 'Error recovering journal', 'error decoding table object', 'failed to read JournalPointer', 'Corrupt directory entry', 'Corrupt fnode header', 'corrupt sessionmap header', 'Corrupt dentry', 'Scrub error on inode', 'Metadata damage detected', 'MDS_READ_ONLY', 'force file system read-only', 'with standby daemon mds'], 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2023-06-21-0846-quincy', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9037, 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri4-testing-2023-06-21-0846-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c', 'targets': {'smithi097.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=', 'smithi149.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_damage']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '076bbebc42a14f7d568aaa78eabb0038327bcb23', 'timestamp': '2023-06-22_15:25:25', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-23T00:58:38.408 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T00:58:38.411 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T00:58:38.416 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T00:58:38.418 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T00:58:38.432 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:58:38.432 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2023-06-23T00:58:38.438 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-23T00:58:38.439 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2023-06-23T00:58:38.486 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-23T00:58:38.486 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T00:58:38.486 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 6h/6d Inode: 358 Links: 1 2023-06-23T00:58:38.487 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T00:58:38.487 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-06-23 00:53:39.973478047 +0000 2023-06-23T00:58:38.487 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-06-23 00:53:39.625486064 +0000 2023-06-23T00:58:38.487 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-06-23 00:53:39.625486064 +0000 2023-06-23T00:58:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2023-06-23T00:58:38.487 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-23T00:58:38.501 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-06-23T00:58:38.502 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-06-23T00:58:38.502 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000348831 s, 1.5 MB/s 2023-06-23T00:58:38.503 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-23T00:58:38.552 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2023-06-23T00:58:38.558 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-23T00:58:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T00:58:38.559 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 6h/6d Inode: 365 Links: 1 2023-06-23T00:58:38.559 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T00:58:38.559 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-06-23 00:53:40.521465422 +0000 2023-06-23T00:58:38.559 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-06-23 00:53:40.205472702 +0000 2023-06-23T00:58:38.559 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-06-23 00:53:40.205472702 +0000 2023-06-23T00:58:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2023-06-23T00:58:38.560 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-23T00:58:38.572 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-06-23T00:58:38.572 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-06-23T00:58:38.573 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.00038977 s, 1.3 MB/s 2023-06-23T00:58:38.573 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-23T00:58:38.623 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2023-06-23T00:58:38.631 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-23T00:58:38.632 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T00:58:38.632 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 6h/6d Inode: 374 Links: 1 2023-06-23T00:58:38.632 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T00:58:38.632 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-06-23 00:53:41.041453441 +0000 2023-06-23T00:58:38.632 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-06-23 00:53:40.749460169 +0000 2023-06-23T00:58:38.632 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-06-23 00:53:40.749460169 +0000 2023-06-23T00:58:38.633 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2023-06-23T00:58:38.633 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-23T00:58:38.643 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-06-23T00:58:38.644 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-06-23T00:58:38.644 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000391438 s, 1.3 MB/s 2023-06-23T00:58:38.645 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-23T00:58:38.695 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2023-06-23T00:58:38.703 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-23T00:58:38.703 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T00:58:38.703 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-06-23T00:58:38.704 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T00:58:38.704 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-06-23 00:53:41.569441278 +0000 2023-06-23T00:58:38.704 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-06-23 00:53:41.241448834 +0000 2023-06-23T00:58:38.704 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-06-23 00:53:41.241448834 +0000 2023-06-23T00:58:38.704 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2023-06-23T00:58:38.705 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-23T00:58:38.715 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-06-23T00:58:38.715 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-06-23T00:58:38.715 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000409778 s, 1.2 MB/s 2023-06-23T00:58:38.716 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-23T00:58:38.767 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T00:58:38.768 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:58:38.768 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2023-06-23T00:58:38.775 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-23T00:58:38.775 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2023-06-23T00:58:38.782 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-23T00:58:38.782 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T00:58:38.782 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 360 Links: 1 2023-06-23T00:58:38.782 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T00:58:38.782 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-06-23 00:53:39.972664855 +0000 2023-06-23T00:58:38.783 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-06-23 00:53:39.616673067 +0000 2023-06-23T00:58:38.783 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-06-23 00:53:39.616673067 +0000 2023-06-23T00:58:38.783 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-06-23T00:58:38.783 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-23T00:58:38.795 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-06-23T00:58:38.795 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-06-23T00:58:38.795 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000408611 s, 1.3 MB/s 2023-06-23T00:58:38.796 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-23T00:58:38.853 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2023-06-23T00:58:38.861 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-23T00:58:38.862 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T00:58:38.862 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 365 Links: 1 2023-06-23T00:58:38.862 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T00:58:38.862 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-06-23 00:53:40.560651292 +0000 2023-06-23T00:58:38.862 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-06-23 00:53:40.204659504 +0000 2023-06-23T00:58:38.862 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-06-23 00:53:40.204659504 +0000 2023-06-23T00:58:38.863 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-06-23T00:58:38.863 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-23T00:58:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-06-23T00:58:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-06-23T00:58:38.919 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000405068 s, 1.3 MB/s 2023-06-23T00:58:38.920 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-23T00:58:38.929 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2023-06-23T00:58:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-23T00:58:38.936 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T00:58:38.937 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 372 Links: 1 2023-06-23T00:58:38.937 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T00:58:38.937 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-06-23 00:53:41.140637912 +0000 2023-06-23T00:58:38.937 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-06-23 00:53:40.800645754 +0000 2023-06-23T00:58:38.938 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-06-23 00:53:40.800645754 +0000 2023-06-23T00:58:38.938 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-06-23T00:58:38.939 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-23T00:58:38.951 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-06-23T00:58:38.952 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-06-23T00:58:38.952 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000391507 s, 1.3 MB/s 2023-06-23T00:58:38.953 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-23T00:58:39.005 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2023-06-23T00:58:39.012 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-23T00:58:39.012 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T00:58:39.012 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-06-23T00:58:39.012 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T00:58:39.013 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-06-23 00:53:41.696625087 +0000 2023-06-23T00:58:39.013 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-06-23 00:53:41.360632837 +0000 2023-06-23T00:58:39.013 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-06-23 00:53:41.360632837 +0000 2023-06-23T00:58:39.013 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-06-23T00:58:39.014 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-23T00:58:39.067 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-06-23T00:58:39.067 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-06-23T00:58:39.067 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000413486 s, 1.2 MB/s 2023-06-23T00:58:39.068 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-23T00:58:39.076 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T00:58:39.076 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-23T00:58:39.077 INFO:tasks.ceph:Generating config... 2023-06-23T00:58:39.078 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-23T00:58:39.078 INFO:tasks.ceph:[client] debug client = 20 2023-06-23T00:58:39.078 INFO:tasks.ceph:[client] debug ms = 1 2023-06-23T00:58:39.079 INFO:tasks.ceph:[client] pid file = 2023-06-23T00:58:39.079 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-23T00:58:39.079 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-23T00:58:39.079 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-23T00:58:39.080 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-23T00:58:39.080 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-23T00:58:39.080 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-23T00:58:39.080 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-23T00:58:39.080 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-23T00:58:39.080 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-23T00:58:39.081 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-23T00:58:39.081 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-23T00:58:39.081 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-23T00:58:39.081 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-23T00:58:39.081 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-23T00:58:39.082 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-23T00:58:39.082 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-23T00:58:39.083 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-23T00:58:39.083 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-23T00:58:39.083 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-23T00:58:39.083 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-06-23T00:58:39.084 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-06-23T00:58:39.084 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-23T00:58:39.084 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-23T00:58:39.084 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-06-23T00:58:39.085 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-23T00:58:39.085 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-23T00:58:39.085 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-23T00:58:39.085 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-23T00:58:39.085 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-23T00:58:39.085 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-23T00:58:39.086 INFO:tasks.ceph:Setting up mon.a... 2023-06-23T00:58:39.086 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-23T00:58:39.120 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.keyring 2023-06-23T00:58:39.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-23T00:58:39.202 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T00:58:39.217 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.97'), ('mon.b', '172.21.15.149'), ('mon.c', '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]')] 2023-06-23T00:58:39.217 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.97,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-23T00:58:39.218 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:58:39.219 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-23T00:58:39.224 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.97 --add b 172.21.15.149 --addv c '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:58:39.311 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:58:39.312 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: generated fsid 6b52ccf4-99f4-48c9-9a8a-9a183942c228 2023-06-23T00:58:39.312 INFO:teuthology.orchestra.run.smithi097.stdout:setting min_mon_release = octopus 2023-06-23T00:58:39.312 INFO:teuthology.orchestra.run.smithi097.stdout:epoch 0 2023-06-23T00:58:39.312 INFO:teuthology.orchestra.run.smithi097.stdout:fsid 6b52ccf4-99f4-48c9-9a8a-9a183942c228 2023-06-23T00:58:39.312 INFO:teuthology.orchestra.run.smithi097.stdout:last_changed 2023-06-23T00:58:39.310236+0000 2023-06-23T00:58:39.313 INFO:teuthology.orchestra.run.smithi097.stdout:created 2023-06-23T00:58:39.310236+0000 2023-06-23T00:58:39.313 INFO:teuthology.orchestra.run.smithi097.stdout:min_mon_release 15 (octopus) 2023-06-23T00:58:39.313 INFO:teuthology.orchestra.run.smithi097.stdout:election_strategy: 1 2023-06-23T00:58:39.313 INFO:teuthology.orchestra.run.smithi097.stdout:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2023-06-23T00:58:39.313 INFO:teuthology.orchestra.run.smithi097.stdout:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2023-06-23T00:58:39.313 INFO:teuthology.orchestra.run.smithi097.stdout:2: [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] mon.c 2023-06-23T00:58:39.313 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-23T00:58:39.315 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-23T00:58:39.319 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6b52ccf4-99f4-48c9-9a8a-9a183942c228... 2023-06-23T00:58:39.320 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T00:58:39.323 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T00:58:39.355 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2023-06-23T00:58:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2023-06-23T00:58:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T00:58:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2023-06-23T00:58:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2023-06-23T00:58:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2023-06-23T00:58:39.358 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.358 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2023-06-23T00:58:39.358 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2023-06-23T00:58:39.358 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.358 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2023-06-23T00:58:39.358 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2023-06-23T00:58:39.359 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.359 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T00:58:39.359 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2023-06-23T00:58:39.359 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.359 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T00:58:39.359 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T00:58:39.359 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.360 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2023-06-23T00:58:39.360 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.360 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2023-06-23T00:58:39.360 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2023-06-23T00:58:39.360 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2023-06-23T00:58:39.360 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2023-06-23T00:58:39.360 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2023-06-23T00:58:39.361 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2023-06-23T00:58:39.361 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2023-06-23T00:58:39.361 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T00:58:39.361 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T00:58:39.361 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2023-06-23T00:58:39.361 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.361 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T00:58:39.362 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.362 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2023-06-23T00:58:39.362 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.362 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2023-06-23T00:58:39.362 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.362 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2023-06-23T00:58:39.362 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2023-06-23T00:58:39.363 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2023-06-23T00:58:39.363 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.97,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2023-06-23T00:58:39.363 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = 6b52ccf4-99f4-48c9-9a8a-9a183942c228 2023-06-23T00:58:39.363 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.363 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2023-06-23T00:58:39.363 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2023-06-23T00:58:39.363 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.364 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2023-06-23T00:58:39.364 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2023-06-23T00:58:39.364 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2023-06-23T00:58:39.364 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.364 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2023-06-23T00:58:39.364 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2023-06-23T00:58:39.364 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.365 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2023-06-23T00:58:39.365 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2023-06-23T00:58:39.365 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2023-06-23T00:58:39.365 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.365 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2023-06-23T00:58:39.365 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2023-06-23T00:58:39.365 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.365 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2023-06-23T00:58:39.366 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.366 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2023-06-23T00:58:39.366 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.366 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2023-06-23T00:58:39.366 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.366 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2023-06-23T00:58:39.366 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2023-06-23T00:58:39.367 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.367 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2023-06-23T00:58:39.367 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2023-06-23T00:58:39.367 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2023-06-23T00:58:39.367 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2023-06-23T00:58:39.367 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 20 2023-06-23T00:58:39.367 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 20 2023-06-23T00:58:39.367 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-06-23T00:58:39.368 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2023-06-23T00:58:39.368 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 10 2023-06-23T00:58:39.368 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T00:58:39.368 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2023-06-23T00:58:39.368 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2023-06-23T00:58:39.368 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2023-06-23T00:58:39.368 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2023-06-23T00:58:39.368 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2023-06-23T00:58:39.369 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.369 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2023-06-23T00:58:39.369 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-06-23T00:58:39.369 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2023-06-23T00:58:39.369 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2023-06-23T00:58:39.369 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2023-06-23T00:58:39.369 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2023-06-23T00:58:39.369 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2023-06-23T00:58:39.370 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2023-06-23T00:58:39.370 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.370 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2023-06-23T00:58:39.370 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-06-23T00:58:39.370 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2023-06-23T00:58:39.370 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2023-06-23T00:58:39.370 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2023-06-23T00:58:39.371 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2023-06-23T00:58:39.371 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2023-06-23T00:58:39.371 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2023-06-23T00:58:39.371 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2023-06-23T00:58:39.371 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2023-06-23T00:58:39.371 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2023-06-23T00:58:39.371 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.371 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T00:58:39.372 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T00:58:39.372 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T00:58:39.372 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.372 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T00:58:39.372 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T00:58:39.372 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T00:58:39.372 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.373 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2023-06-23T00:58:39.373 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2023-06-23T00:58:39.373 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.373 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2023-06-23T00:58:39.373 INFO:teuthology.orchestra.run.smithi097.stdout: mon op complaint time = 120 2023-06-23T00:58:39.373 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:58:39.374 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2023-06-23T00:58:39.374 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2023-06-23T00:58:39.374 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2023-06-23T00:58:39.374 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2023-06-23T00:58:39.374 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T00:58:39.374 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T00:58:39.375 INFO:teuthology.orchestra.run.smithi097.stdout: client mount timeout = 600 2023-06-23T00:58:39.375 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2023-06-23T00:58:39.375 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-06-23T00:58:39.375 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = "" 2023-06-23T00:58:39.375 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2023-06-23T00:58:39.375 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2023-06-23T00:58:39.375 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2023-06-23T00:58:39.375 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2023-06-23T00:58:39.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2023-06-23T00:58:39.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2023-06-23T00:58:39.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2023-06-23T00:58:39.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2023-06-23T00:58:39.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2023-06-23T00:58:39.376 INFO:teuthology.orchestra.run.smithi097.stdout:[mds] 2023-06-23T00:58:39.376 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds = 20 2023-06-23T00:58:39.377 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-06-23T00:58:39.377 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug frag = True 2023-06-23T00:58:39.377 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug scatterstat = True 2023-06-23T00:58:39.377 INFO:teuthology.orchestra.run.smithi097.stdout: mds op complaint time = 180 2023-06-23T00:58:39.377 INFO:teuthology.orchestra.run.smithi097.stdout: mds verify scatter = True 2023-06-23T00:58:39.377 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2023-06-23T00:58:39.377 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2023-06-23T00:58:39.377 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2023-06-23T00:58:39.379 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2023-06-23T00:58:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2023-06-23T00:58:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T00:58:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2023-06-23T00:58:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.379 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2023-06-23T00:58:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2023-06-23T00:58:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2023-06-23T00:58:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2023-06-23T00:58:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.380 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2023-06-23T00:58:39.381 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2023-06-23T00:58:39.381 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.381 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T00:58:39.381 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2023-06-23T00:58:39.381 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.381 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T00:58:39.382 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T00:58:39.382 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.382 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2023-06-23T00:58:39.382 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.382 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2023-06-23T00:58:39.382 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2023-06-23T00:58:39.383 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2023-06-23T00:58:39.383 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2023-06-23T00:58:39.384 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2023-06-23T00:58:39.384 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2023-06-23T00:58:39.384 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2023-06-23T00:58:39.384 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T00:58:39.384 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T00:58:39.384 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2023-06-23T00:58:39.385 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.385 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T00:58:39.385 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.385 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2023-06-23T00:58:39.385 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.385 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2023-06-23T00:58:39.386 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.386 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2023-06-23T00:58:39.386 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2023-06-23T00:58:39.386 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2023-06-23T00:58:39.386 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.97,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2023-06-23T00:58:39.387 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = 6b52ccf4-99f4-48c9-9a8a-9a183942c228 2023-06-23T00:58:39.387 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.387 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2023-06-23T00:58:39.387 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2023-06-23T00:58:39.387 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.387 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2023-06-23T00:58:39.388 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2023-06-23T00:58:39.388 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2023-06-23T00:58:39.388 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.388 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2023-06-23T00:58:39.389 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2023-06-23T00:58:39.389 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.389 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2023-06-23T00:58:39.390 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2023-06-23T00:58:39.390 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2023-06-23T00:58:39.390 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.390 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2023-06-23T00:58:39.391 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2023-06-23T00:58:39.391 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.391 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2023-06-23T00:58:39.391 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.392 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2023-06-23T00:58:39.392 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.392 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2023-06-23T00:58:39.393 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.393 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2023-06-23T00:58:39.393 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2023-06-23T00:58:39.393 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.394 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2023-06-23T00:58:39.394 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2023-06-23T00:58:39.394 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2023-06-23T00:58:39.394 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2023-06-23T00:58:39.394 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 20 2023-06-23T00:58:39.394 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 20 2023-06-23T00:58:39.394 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-23T00:58:39.395 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2023-06-23T00:58:39.395 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 10 2023-06-23T00:58:39.395 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T00:58:39.395 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2023-06-23T00:58:39.395 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2023-06-23T00:58:39.395 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2023-06-23T00:58:39.395 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2023-06-23T00:58:39.396 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-06-23T00:58:39.396 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.396 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2023-06-23T00:58:39.396 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-23T00:58:39.396 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2023-06-23T00:58:39.396 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-06-23T00:58:39.396 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-06-23T00:58:39.397 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-06-23T00:58:39.397 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-06-23T00:58:39.397 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2023-06-23T00:58:39.397 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.397 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2023-06-23T00:58:39.397 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-23T00:58:39.398 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-06-23T00:58:39.398 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2023-06-23T00:58:39.398 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-06-23T00:58:39.399 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2023-06-23T00:58:39.399 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2023-06-23T00:58:39.399 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-06-23T00:58:39.399 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2023-06-23T00:58:39.400 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2023-06-23T00:58:39.400 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-06-23T00:58:39.400 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.401 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T00:58:39.401 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T00:58:39.401 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T00:58:39.401 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.402 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T00:58:39.402 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T00:58:39.402 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T00:58:39.402 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.403 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2023-06-23T00:58:39.403 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2023-06-23T00:58:39.403 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.403 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2023-06-23T00:58:39.404 INFO:teuthology.orchestra.run.smithi149.stdout: mon op complaint time = 120 2023-06-23T00:58:39.404 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-23T00:58:39.404 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2023-06-23T00:58:39.404 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2023-06-23T00:58:39.404 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2023-06-23T00:58:39.404 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2023-06-23T00:58:39.405 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T00:58:39.405 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T00:58:39.405 INFO:teuthology.orchestra.run.smithi149.stdout: client mount timeout = 600 2023-06-23T00:58:39.405 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2023-06-23T00:58:39.405 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-23T00:58:39.405 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = "" 2023-06-23T00:58:39.405 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-06-23T00:58:39.406 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-06-23T00:58:39.406 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2023-06-23T00:58:39.406 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2023-06-23T00:58:39.406 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2023-06-23T00:58:39.406 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2023-06-23T00:58:39.407 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2023-06-23T00:58:39.407 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2023-06-23T00:58:39.407 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2023-06-23T00:58:39.407 INFO:teuthology.orchestra.run.smithi149.stdout:[mds] 2023-06-23T00:58:39.407 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds = 20 2023-06-23T00:58:39.407 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-23T00:58:39.407 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug frag = True 2023-06-23T00:58:39.408 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug scatterstat = True 2023-06-23T00:58:39.408 INFO:teuthology.orchestra.run.smithi149.stdout: mds op complaint time = 180 2023-06-23T00:58:39.408 INFO:teuthology.orchestra.run.smithi149.stdout: mds verify scatter = True 2023-06-23T00:58:39.408 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-06-23T00:58:39.409 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-06-23T00:58:39.409 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-06-23T00:58:39.409 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-23T00:58:39.410 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-23T00:58:39.466 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-23T00:58:39.466 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:58:39.467 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-23T00:58:39.473 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:58:39.474 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-23T00:58:39.480 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2023-06-23T00:58:39.481 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:58:39.481 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T00:58:39.481 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T00:58:39.549 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:58:39.550 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:58:39.554 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2023-06-23T00:58:39.554 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:58:39.554 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T00:58:39.555 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T00:58:39.581 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:58:39.582 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:58:39.589 INFO:tasks.ceph:Setting up mon nodes... 2023-06-23T00:58:39.589 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-23T00:58:39.589 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-23T00:58:39.633 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-23T00:58:39.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-23T00:58:39.681 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-23T00:58:39.684 INFO:tasks.ceph:Setting up mds nodes... 2023-06-23T00:58:39.684 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-23T00:58:39.731 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-23T00:58:39.734 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-23T00:58:39.747 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-23T00:58:39.788 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-23T00:58:39.791 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-23T00:58:39.851 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-23T00:58:39.896 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-23T00:58:39.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-23T00:58:39.957 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-23T00:58:40.000 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-23T00:58:40.002 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-23T00:58:40.015 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-23T00:58:40.018 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-23T00:58:40.053 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-23T00:58:40.067 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-23T00:58:40.143 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-23T00:58:40.155 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-23T00:58:40.192 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-23T00:58:40.205 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-23T00:58:40.236 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-23T00:58:40.249 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-23T00:58:40.250 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-23T00:58:40.250 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-23T00:58:40.267 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T00:58:40.267 INFO:tasks.ceph:role: osd.0 2023-06-23T00:58:40.268 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com 2023-06-23T00:58:40.268 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-23T00:58:40.794 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T00:58:40.794 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T00:58:40.795 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T00:58:40.795 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 2023-06-23T00:58:40.795 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T00:58:40.795 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-06-23T00:58:40.795 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T00:58:40.795 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T00:58:40.795 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T00:58:40.796 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T00:58:40.797 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-06-23T00:58:40.797 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-23T00:58:40.879 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-23T00:58:40.890 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T00:58:40.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T00:58:40.891 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-23T00:58:40.903 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T00:58:40.903 INFO:tasks.ceph:role: osd.1 2023-06-23T00:58:40.903 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com 2023-06-23T00:58:40.904 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-23T00:58:41.432 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T00:58:41.432 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T00:58:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T00:58:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 2023-06-23T00:58:41.433 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T00:58:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-06-23T00:58:41.434 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T00:58:41.434 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T00:58:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T00:58:41.435 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T00:58:41.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-06-23T00:58:41.436 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-23T00:58:41.487 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-23T00:58:41.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T00:58:41.499 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T00:58:41.500 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-23T00:58:41.511 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T00:58:41.512 INFO:tasks.ceph:role: osd.2 2023-06-23T00:58:41.512 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com 2023-06-23T00:58:41.513 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-23T00:58:42.011 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T00:58:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T00:58:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T00:58:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 2023-06-23T00:58:42.012 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T00:58:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-06-23T00:58:42.012 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T00:58:42.013 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T00:58:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T00:58:42.013 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T00:58:42.014 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-06-23T00:58:42.014 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-23T00:58:42.062 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-23T00:58:42.074 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T00:58:42.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T00:58:42.075 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-23T00:58:42.136 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T00:58:42.136 INFO:tasks.ceph:role: osd.3 2023-06-23T00:58:42.137 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com 2023-06-23T00:58:42.137 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-23T00:58:42.627 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T00:58:42.628 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T00:58:42.628 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T00:58:42.628 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 2023-06-23T00:58:42.628 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T00:58:42.628 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-06-23T00:58:42.628 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T00:58:42.629 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T00:58:42.629 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T00:58:42.629 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T00:58:42.630 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-06-23T00:58:42.630 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-23T00:58:42.688 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-23T00:58:42.700 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T00:58:42.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T00:58:42.702 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:58:42.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:42.765+0000 7f05d91e83c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-23T00:58:42.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:42.765+0000 7f05d91e83c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-23T00:58:42.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:42.765+0000 7f05d91e83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T00:58:42.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:42.765+0000 7f05d91e83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T00:58:42.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:42.765+0000 7f05d91e83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T00:58:42.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:42.765+0000 7f05d91e83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-23T00:58:43.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:43.333+0000 7f05d91e83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:44.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:44.109+0000 7f05d91e83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:44.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:44.897+0000 7f05d91e83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:45.748 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-23T00:58:45.765 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:58:45.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:45.801+0000 7f599da113c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-23T00:58:45.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:45.805+0000 7f599da113c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-23T00:58:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:45.805+0000 7f599da113c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T00:58:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:45.805+0000 7f599da113c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T00:58:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:45.805+0000 7f599da113c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T00:58:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:45.805+0000 7f599da113c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-23T00:58:46.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:46.357+0000 7f599da113c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:47.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:47.141+0000 7f599da113c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:47.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:47.933+0000 7f599da113c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:48.784 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-23T00:58:48.798 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:58:48.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:48.829+0000 7f1bac0253c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-23T00:58:48.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:48.833+0000 7f1bac0253c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-23T00:58:48.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:48.833+0000 7f1bac0253c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T00:58:48.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:48.833+0000 7f1bac0253c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T00:58:48.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:48.833+0000 7f1bac0253c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T00:58:48.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:48.833+0000 7f1bac0253c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-23T00:58:49.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:49.389+0000 7f1bac0253c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:50.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:50.161+0000 7f1bac0253c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:50.953+0000 7f1bac0253c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:51.807 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-23T00:58:51.866 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:58:51.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:51.905+0000 7f70745923c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-23T00:58:51.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:51.905+0000 7f70745923c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-23T00:58:51.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:51.905+0000 7f70745923c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T00:58:51.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:51.905+0000 7f70745923c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T00:58:51.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:51.905+0000 7f70745923c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T00:58:51.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:51.905+0000 7f70745923c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-23T00:58:52.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:52.457+0000 7f70745923c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:53.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:53.245+0000 7f70745923c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:54.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:58:54.041+0000 7f70745923c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:54.899 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-23T00:58:54.916 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-23T00:58:54.933 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T00:58:54.933 INFO:tasks.ceph:role: osd.4 2023-06-23T00:58:54.933 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-23T00:58:54.933 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-23T00:58:55.448 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T00:58:55.449 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T00:58:55.449 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T00:58:55.449 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2023-06-23T00:58:55.449 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T00:58:55.450 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-06-23T00:58:55.450 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T00:58:55.450 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T00:58:55.450 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T00:58:55.450 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T00:58:55.452 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-06-23T00:58:55.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-23T00:58:55.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-23T00:58:55.560 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T00:58:55.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T00:58:55.561 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-23T00:58:55.578 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T00:58:55.578 INFO:tasks.ceph:role: osd.5 2023-06-23T00:58:55.578 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-23T00:58:55.579 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-23T00:58:56.145 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T00:58:56.145 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T00:58:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T00:58:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2023-06-23T00:58:56.146 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T00:58:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-06-23T00:58:56.146 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T00:58:56.146 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T00:58:56.146 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T00:58:56.147 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T00:58:56.147 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-06-23T00:58:56.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-23T00:58:56.181 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-23T00:58:56.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T00:58:56.191 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T00:58:56.191 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-23T00:58:56.203 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T00:58:56.203 INFO:tasks.ceph:role: osd.6 2023-06-23T00:58:56.204 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-23T00:58:56.204 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-23T00:58:56.660 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T00:58:56.661 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T00:58:56.661 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T00:58:56.661 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2023-06-23T00:58:56.661 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T00:58:56.661 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-06-23T00:58:56.661 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T00:58:56.661 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T00:58:56.662 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T00:58:56.662 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T00:58:56.663 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-06-23T00:58:56.663 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-23T00:58:56.720 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-23T00:58:56.731 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T00:58:56.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T00:58:56.733 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-23T00:58:56.743 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T00:58:56.743 INFO:tasks.ceph:role: osd.7 2023-06-23T00:58:56.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-23T00:58:56.744 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-23T00:58:57.294 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T00:58:57.294 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T00:58:57.294 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T00:58:57.295 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2023-06-23T00:58:57.295 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T00:58:57.295 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-06-23T00:58:57.296 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T00:58:57.296 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T00:58:57.296 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T00:58:57.296 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T00:58:57.297 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-06-23T00:58:57.297 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-23T00:58:57.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-23T00:58:57.374 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T00:58:57.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T00:58:57.375 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:58:57.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:58:57.488+0000 7f0172cde3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-23T00:58:57.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:58:57.488+0000 7f0172cde3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-23T00:58:57.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:58:57.488+0000 7f0172cde3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T00:58:57.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:58:57.488+0000 7f0172cde3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T00:58:57.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:58:57.488+0000 7f0172cde3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T00:58:57.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:58:57.496+0000 7f0172cde3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-23T00:58:58.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:58:58.308+0000 7f0172cde3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:59.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:58:59.092+0000 7f0172cde3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:58:59.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:58:59.892+0000 7f0172cde3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:59:00.782 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-23T00:59:00.798 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:59:00.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:00.828+0000 7fdbce7393c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-23T00:59:00.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:00.828+0000 7fdbce7393c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-23T00:59:00.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:00.828+0000 7fdbce7393c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T00:59:00.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:00.828+0000 7fdbce7393c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T00:59:00.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:00.828+0000 7fdbce7393c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T00:59:00.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:00.832+0000 7fdbce7393c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-23T00:59:01.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:01.384+0000 7fdbce7393c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:59:02.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:02.168+0000 7fdbce7393c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:59:02.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:02.948+0000 7fdbce7393c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:59:03.822 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-23T00:59:03.835 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:59:03.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:03.912+0000 7f87ba2ef3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-23T00:59:03.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:03.912+0000 7f87ba2ef3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-23T00:59:03.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:03.912+0000 7f87ba2ef3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T00:59:03.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:03.912+0000 7f87ba2ef3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T00:59:03.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:03.912+0000 7f87ba2ef3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T00:59:03.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:03.912+0000 7f87ba2ef3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-23T00:59:04.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:04.484+0000 7f87ba2ef3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:59:05.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:05.268+0000 7f87ba2ef3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:59:06.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:06.048+0000 7f87ba2ef3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:59:06.917 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-23T00:59:06.934 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:59:06.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:06.964+0000 7f29dd0953c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-23T00:59:06.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:06.964+0000 7f29dd0953c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-23T00:59:06.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:06.964+0000 7f29dd0953c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T00:59:06.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:06.964+0000 7f29dd0953c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T00:59:06.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:06.964+0000 7f29dd0953c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T00:59:06.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:06.968+0000 7f29dd0953c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-23T00:59:07.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:07.524+0000 7f29dd0953c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:59:08.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:08.312+0000 7f29dd0953c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:59:08.409 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T00:59:08.412 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T00:59:09.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:09.104+0000 7f29dd0953c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T00:59:09.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-23T00:59:09.985 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-23T00:59:09.986 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:59:09.986 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-23T00:59:10.003 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:59:10.003 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-23T00:59:10.017 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:59:10.018 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-23T00:59:10.029 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:59:10.029 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-23T00:59:10.087 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:59:10.088 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-23T00:59:10.097 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:59:10.097 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-23T00:59:10.111 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:59:10.112 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-23T00:59:10.166 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:59:10.166 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-23T00:59:10.182 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:59:10.183 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-23T00:59:10.198 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:59:10.198 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-23T00:59:10.209 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:59:10.210 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-23T00:59:10.266 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:59:10.266 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-23T00:59:10.276 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:59:10.276 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-23T00:59:10.287 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:59:10.287 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-23T00:59:10.301 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:59:10.302 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-23T00:59:10.309 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:59:10.310 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-23T00:59:10.317 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:59:10.318 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-23T00:59:10.349 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:59:10.349 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-23T00:59:10.357 INFO:tasks.ceph:Adding keys to all mons... 2023-06-23T00:59:10.357 DEBUG:teuthology.orchestra.run.smithi097:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-23T00:59:10.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-23T00:59:10.370 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.y] 2023-06-23T00:59:10.371 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA/7pRkqLmlJRAAGtc+lyBcMsPZuO4i1G9hnw== 2023-06-23T00:59:10.371 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2023-06-23T00:59:10.371 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA/7pRkKUmCKxAAffgcwnUTfCzcXQNRKvZMzA== 2023-06-23T00:59:10.371 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2023-06-23T00:59:10.371 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA/7pRkh8TsLhAAc19EuVDfE7CZaBLlq2l8UA== 2023-06-23T00:59:10.372 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.0] 2023-06-23T00:59:10.372 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBC7pRkm8u7LRAA4zjBXHNQ6iGIo7SCPEESlQ== 2023-06-23T00:59:10.372 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.1] 2023-06-23T00:59:10.372 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBF7pRk9QYNMBAAfleFm5ve3gLJ85H+uXNxRQ== 2023-06-23T00:59:10.372 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.2] 2023-06-23T00:59:10.372 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBI7pRkkdC3MRAACOMgatCZYT+xd7/HqOBavA== 2023-06-23T00:59:10.372 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.3] 2023-06-23T00:59:10.373 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBL7pRkPEYFNhAArrKF/rM3Lt80lt0lxjj7tA== 2023-06-23T00:59:10.373 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.x] 2023-06-23T00:59:10.373 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA/7pRk+DyMKBAAhAsJfYIh7bZh34P8dOKuXw== 2023-06-23T00:59:10.373 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2023-06-23T00:59:10.373 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA/7pRkwLxgNRAAJA9+6/R0PDpZicwWvsCruQ== 2023-06-23T00:59:10.373 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2023-06-23T00:59:10.373 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA/7pRk9M6LOxAAuvBJ8Q40bxxlTLnIVUJfBA== 2023-06-23T00:59:10.373 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.4] 2023-06-23T00:59:10.374 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBR7pRkplp1HRAAqNwd5UcYcSVLUwAVomM+TQ== 2023-06-23T00:59:10.374 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.5] 2023-06-23T00:59:10.374 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBU7pRk4hnLMRAAC8HhSNG9u8GpwCk2cW1wXQ== 2023-06-23T00:59:10.374 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.6] 2023-06-23T00:59:10.374 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBX7pRkJvKyNhAAXXex52iNQeJHtxBBQmHCpg== 2023-06-23T00:59:10.374 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.7] 2023-06-23T00:59:10.374 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBa7pRkdWqqORAARD4slv52cAKyxsUUsNsiwg== 2023-06-23T00:59:10.375 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2023-06-23T00:59:10.375 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBA7pRkw1UVAxAABvTFwZJJU8l0j9/nj7kUWg== 2023-06-23T00:59:10.375 INFO:teuthology.orchestra.run.smithi097.stdout:[client.2] 2023-06-23T00:59:10.375 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBA7pRk4bx7CBAAYTtJUkfgma/gbZdQqqO3Mg== 2023-06-23T00:59:10.375 INFO:teuthology.orchestra.run.smithi097.stdout:[client.1] 2023-06-23T00:59:10.375 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBA7pRkkSVmCxAAFsEyCdfO5RQ27ZKDw4w8VQ== 2023-06-23T00:59:10.375 INFO:teuthology.orchestra.run.smithi097.stdout:[client.3] 2023-06-23T00:59:10.375 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBA7pRki4YQDhAApp881DqZiw0K4IWHHpOJ+Q== 2023-06-23T00:59:10.377 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2023-06-23T00:59:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA/7pRkqLmlJRAAGtc+lyBcMsPZuO4i1G9hnw== 2023-06-23T00:59:10.377 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2023-06-23T00:59:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA/7pRkKUmCKxAAffgcwnUTfCzcXQNRKvZMzA== 2023-06-23T00:59:10.377 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2023-06-23T00:59:10.377 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA/7pRkh8TsLhAAc19EuVDfE7CZaBLlq2l8UA== 2023-06-23T00:59:10.378 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2023-06-23T00:59:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBC7pRkm8u7LRAA4zjBXHNQ6iGIo7SCPEESlQ== 2023-06-23T00:59:10.378 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2023-06-23T00:59:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBF7pRk9QYNMBAAfleFm5ve3gLJ85H+uXNxRQ== 2023-06-23T00:59:10.378 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2023-06-23T00:59:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBI7pRkkdC3MRAACOMgatCZYT+xd7/HqOBavA== 2023-06-23T00:59:10.378 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2023-06-23T00:59:10.378 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBL7pRkPEYFNhAArrKF/rM3Lt80lt0lxjj7tA== 2023-06-23T00:59:10.379 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2023-06-23T00:59:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA/7pRk+DyMKBAAhAsJfYIh7bZh34P8dOKuXw== 2023-06-23T00:59:10.379 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2023-06-23T00:59:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA/7pRkwLxgNRAAJA9+6/R0PDpZicwWvsCruQ== 2023-06-23T00:59:10.379 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2023-06-23T00:59:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA/7pRk9M6LOxAAuvBJ8Q40bxxlTLnIVUJfBA== 2023-06-23T00:59:10.379 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2023-06-23T00:59:10.379 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBR7pRkplp1HRAAqNwd5UcYcSVLUwAVomM+TQ== 2023-06-23T00:59:10.380 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2023-06-23T00:59:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBU7pRk4hnLMRAAC8HhSNG9u8GpwCk2cW1wXQ== 2023-06-23T00:59:10.380 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2023-06-23T00:59:10.380 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBX7pRkJvKyNhAAXXex52iNQeJHtxBBQmHCpg== 2023-06-23T00:59:10.381 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2023-06-23T00:59:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBa7pRkdWqqORAARD4slv52cAKyxsUUsNsiwg== 2023-06-23T00:59:10.381 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2023-06-23T00:59:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBA7pRkw1UVAxAABvTFwZJJU8l0j9/nj7kUWg== 2023-06-23T00:59:10.381 INFO:teuthology.orchestra.run.smithi149.stdout:[client.2] 2023-06-23T00:59:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBA7pRk4bx7CBAAYTtJUkfgma/gbZdQqqO3Mg== 2023-06-23T00:59:10.381 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2023-06-23T00:59:10.381 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBA7pRkkSVmCxAAFsEyCdfO5RQ27ZKDw4w8VQ== 2023-06-23T00:59:10.382 INFO:teuthology.orchestra.run.smithi149.stdout:[client.3] 2023-06-23T00:59:10.382 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBA7pRki4YQDhAApp881DqZiw0K4IWHHpOJ+Q== 2023-06-23T00:59:10.382 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T00:59:10.421 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T00:59:10.466 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T00:59:10.469 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T00:59:10.514 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T00:59:10.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T00:59:10.562 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:10.565 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:10.651 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:10.654 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:10.699 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:10.702 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:10.747 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:10.750 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:10.795 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T00:59:10.797 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T00:59:10.840 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T00:59:10.881 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T00:59:10.935 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T00:59:10.938 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T00:59:10.988 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:10.991 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:11.034 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:11.077 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:11.123 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:11.126 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:11.172 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:11.174 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T00:59:11.217 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T00:59:11.260 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T00:59:11.310 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T00:59:11.313 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T00:59:11.360 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T00:59:11.362 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T00:59:11.407 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T00:59:11.412 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T00:59:11.457 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-23T00:59:11.458 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-23T00:59:11.472 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T00:59:11.574 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-23T00:59:11.587 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-23T00:59:11.603 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T00:59:11.661 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-23T00:59:11.674 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-23T00:59:11.734 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T00:59:11.789 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-23T00:59:11.803 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:59:11.805 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-23T00:59:11.853 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-23T00:59:11.853 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-23T00:59:11.854 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-23T00:59:11.856 INFO:tasks.ceph.mon.a:Started 2023-06-23T00:59:11.857 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-23T00:59:11.857 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-23T00:59:11.859 INFO:tasks.ceph.mon.b:Started 2023-06-23T00:59:11.860 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-23T00:59:11.860 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-23T00:59:11.862 INFO:tasks.ceph.mon.c:Started 2023-06-23T00:59:11.863 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-23T00:59:11.863 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-23T00:59:11.864 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-23T00:59:11.867 INFO:tasks.ceph.mgr.y:Started 2023-06-23T00:59:11.867 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-23T00:59:11.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-23T00:59:11.871 INFO:tasks.ceph.mgr.x:Started 2023-06-23T00:59:11.871 INFO:tasks.ceph:Setting crush tunables to default 2023-06-23T00:59:11.872 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd crush tunables default 2023-06-23T00:59:11.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.960+0000 7f690874f700 1 Processor -- start 2023-06-23T00:59:11.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.960+0000 7f690874f700 1 -- start start 2023-06-23T00:59:11.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f690874f700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6900155b30 0x7f69000cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:11.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f690874f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69000c8580 0x7f69000cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:11.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f690874f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6900159f60 con 0x7f6900155760 2023-06-23T00:59:11.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f690874f700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69000ae0b0 con 0x7f6900155b30 2023-06-23T00:59:11.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f690874f700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69000cd010 con 0x7f69000c8580 2023-06-23T00:59:11.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f6905cea700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6900155b30 0x7f69000cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:11.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f6906cec700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69000c8580 0x7f69000cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:11.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f69064eb700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6900155760 0x7f69000cc7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.97:52124/0 (socket says 172.21.15.97:52124) 2023-06-23T00:59:11.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f69064eb700 1 -- 172.21.15.97:0/4167411985 learned_addr learned my addr 172.21.15.97:0/4167411985 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:11.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f6906cec700 1 -- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69000c8580 msgr2=0x7f69000cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-23T00:59:11.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f6906cec700 1 -- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69000c8580 msgr2=0x7f69000cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T00:59:11.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f6906cec700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69000c8580 0x7f69000cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T00:59:11.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f6906cec700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69000c8580 0x7f69000cb710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T00:59:11.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f6905cea700 1 -- 172.21.15.97:0/4167411985 >> v2:172.21.15.97:3300/0 conn(0x7f6900155b30 msgr2=0x7f69000cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T00:59:11.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f6905cea700 1 -- 172.21.15.97:0/4167411985 >> v2:172.21.15.97:3300/0 conn(0x7f6900155b30 msgr2=0x7f69000cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T00:59:11.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f6905cea700 1 --2- 172.21.15.97:0/4167411985 >> v2:172.21.15.97:3300/0 conn(0x7f6900155b30 0x7f69000cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T00:59:11.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:11.964+0000 7f6905cea700 1 --2- 172.21.15.97:0/4167411985 >> v2:172.21.15.97:3300/0 conn(0x7f6900155b30 0x7f69000cb1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T00:59:12.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490292118 0 0) 0x7f6900159f60 con 0x7f6900155760 2023-06-23T00:59:12.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68ec003570 con 0x7f6900155760 2023-06-23T00:59:12.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2128307649 0 0) 0x7f68ec003570 con 0x7f6900155760 2023-06-23T00:59:12.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69000c8580 msgr2=0x7f69000cb710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T00:59:12.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69000c8580 0x7f69000cb710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 >> v2:172.21.15.97:3300/0 conn(0x7f6900155b30 msgr2=0x7f69000cb1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T00:59:12.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 --2- 172.21.15.97:0/4167411985 >> v2:172.21.15.97:3300/0 conn(0x7f6900155b30 0x7f69000cb1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6900159630 con 0x7f6900155760 2023-06-23T00:59:12.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1366942832 0 0) 0x7f68fc001470 con 0x7f6900155760 2023-06-23T00:59:12.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 >> v1:172.21.15.149:6789/0 conn(0x7f6900155760 legacy=0x7f69000cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68ec003a60 0x7f68ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69000c8580 0x7f68ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68ec004d50 0x7f68ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69000ae0b0 con 0x7f68ec003a60 2023-06-23T00:59:12.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec00bb10 con 0x7f68ec004d50 2023-06-23T00:59:12.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec00bcd0 con 0x7f69000c8580 2023-06-23T00:59:12.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69064eb700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68ec003a60 0x7f68ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f6906cec700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68ec004d50 0x7f68ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f6905cea700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69000c8580 0x7f68ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69064eb700 1 -- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69000c8580 msgr2=0x7f68ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:12.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69064eb700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69000c8580 0x7f68ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69064eb700 1 -- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68ec004d50 msgr2=0x7f68ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:12.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69064eb700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68ec004d50 0x7f68ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69064eb700 1 -- 172.21.15.97:0/4167411985 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec003570 con 0x7f68ec003a60 2023-06-23T00:59:12.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f6906cec700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68ec004d50 0x7f68ec0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:12.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.008+0000 7f69064eb700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68ec003a60 0x7f68ec003e70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00c3c0 tx=0x7f68fc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f2bbceb648a6e3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.012+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc00cc90 con 0x7f68ec003a60 2023-06-23T00:59:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.016+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc00cdf0 con 0x7f68ec003a60 2023-06-23T00:59:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.016+0000 7f69054e9700 1 -- 172.21.15.97:0/4167411985 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc005b50 con 0x7f68ec003a60 2023-06-23T00:59:12.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.016+0000 7f690874f700 1 -- 172.21.15.97:0/4167411985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68ec003a60 msgr2=0x7f68ec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.016+0000 7f690874f700 1 --2- 172.21.15.97:0/4167411985 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68ec003a60 0x7f68ec003e70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00c3c0 tx=0x7f68fc001e50 comp rx=0 tx=0).stop 2023-06-23T00:59:12.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.016+0000 7f6906cec700 1 -- 172.21.15.97:0/4167411985 reap_dead start 2023-06-23T00:59:12.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.016+0000 7f690874f700 1 -- 172.21.15.97:0/4167411985 shutdown_connections 2023-06-23T00:59:12.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.016+0000 7f690874f700 1 -- 172.21.15.97:0/4167411985 >> 172.21.15.97:0/4167411985 conn(0x7f69000679a0 msgr2=0x7f69000cc020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:12.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.016+0000 7f690874f700 1 -- 172.21.15.97:0/4167411985 shutdown_connections 2023-06-23T00:59:12.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.016+0000 7f690874f700 1 -- 172.21.15.97:0/4167411985 wait complete. 2023-06-23T00:59:12.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.016+0000 7f690874f700 1 Processor -- start 2023-06-23T00:59:12.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.016+0000 7f690874f700 1 -- start start 2023-06-23T00:59:12.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f690874f700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68ec003a60 0x7f69000ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f690874f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6900169110 0x7f6900148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f690874f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6900157f60 0x7f69001684f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f690874f700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69000c5ea0 con 0x7f68ec003a60 2023-06-23T00:59:12.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f690874f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6900156b20 con 0x7f6900157f60 2023-06-23T00:59:12.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f690874f700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6900156d70 con 0x7f6900169110 2023-06-23T00:59:12.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f69064eb700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68ec003a60 0x7f69000ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f69064eb700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68ec003a60 0x7f69000ad760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57042/0 (socket says 172.21.15.97:57042) 2023-06-23T00:59:12.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f69064eb700 1 -- 172.21.15.97:0/668486203 learned_addr learned my addr 172.21.15.97:0/668486203 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:12.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f6905cea700 1 --2- 172.21.15.97:0/668486203 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6900169110 0x7f6900148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f6906cec700 1 --2- 172.21.15.97:0/668486203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6900157f60 0x7f69001684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f69064eb700 1 -- 172.21.15.97:0/668486203 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6900169110 msgr2=0x7f6900148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f69064eb700 1 --2- 172.21.15.97:0/668486203 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6900169110 0x7f6900148460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f69064eb700 1 -- 172.21.15.97:0/668486203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6900157f60 msgr2=0x7f69001684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f69064eb700 1 --2- 172.21.15.97:0/668486203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6900157f60 0x7f69001684f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f69064eb700 1 -- 172.21.15.97:0/668486203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6900157050 con 0x7f68ec003a60 2023-06-23T00:59:12.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f6906cec700 1 --2- 172.21.15.97:0/668486203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6900157f60 0x7f69001684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:12.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.020+0000 7f69064eb700 1 --2- 172.21.15.97:0/668486203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68ec003a60 0x7f69000ad760 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f68fc001760 tx=0x7f68fc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:12.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.024+0000 7f68f67fc700 1 -- 172.21.15.97:0/668486203 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc00cc90 con 0x7f68ec003a60 2023-06-23T00:59:12.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.024+0000 7f68f67fc700 1 -- 172.21.15.97:0/668486203 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc00c9e0 con 0x7f68ec003a60 2023-06-23T00:59:12.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.024+0000 7f690874f700 1 -- 172.21.15.97:0/668486203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69000c5ac0 con 0x7f68ec003a60 2023-06-23T00:59:12.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.024+0000 7f68f67fc700 1 -- 172.21.15.97:0/668486203 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc007530 con 0x7f68ec003a60 2023-06-23T00:59:12.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.024+0000 7f690874f700 1 -- 172.21.15.97:0/668486203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6900148b40 con 0x7f68ec003a60 2023-06-23T00:59:12.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.024+0000 7f68f67fc700 1 -- 172.21.15.97:0/668486203 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f68fc019070 con 0x7f68ec003a60 2023-06-23T00:59:12.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.024+0000 7f68f67fc700 1 -- 172.21.15.97:0/668486203 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f68fc01e400 con 0x7f68ec003a60 2023-06-23T00:59:12.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.024+0000 7f690874f700 1 -- 172.21.15.97:0/668486203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69000c5ea0 con 0x7f68ec003a60 2023-06-23T00:59:12.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.028+0000 7f68f67fc700 1 -- 172.21.15.97:0/668486203 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f68fc02c060 con 0x7f68ec003a60 2023-06-23T00:59:12.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.096+0000 7f690874f700 1 -- 172.21.15.97:0/668486203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f690004bc30 con 0x7f68ec003a60 2023-06-23T00:59:12.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.104+0000 7f68f67fc700 1 -- 172.21.15.97:0/668486203 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f68fc022070 con 0x7f68ec003a60 2023-06-23T00:59:12.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.104+0000 7f690874f700 1 -- 172.21.15.97:0/668486203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68ec003a60 msgr2=0x7f69000ad760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.104+0000 7f690874f700 1 --2- 172.21.15.97:0/668486203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68ec003a60 0x7f69000ad760 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f68fc001760 tx=0x7f68fc015000 comp rx=0 tx=0).stop 2023-06-23T00:59:12.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.104+0000 7f690874f700 1 -- 172.21.15.97:0/668486203 shutdown_connections 2023-06-23T00:59:12.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.104+0000 7f690874f700 1 --2- 172.21.15.97:0/668486203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6900157f60 0x7f69001684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.104+0000 7f690874f700 1 --2- 172.21.15.97:0/668486203 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6900169110 0x7f6900148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.104+0000 7f690874f700 1 --2- 172.21.15.97:0/668486203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68ec003a60 0x7f69000ad760 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.104+0000 7f690874f700 1 -- 172.21.15.97:0/668486203 >> 172.21.15.97:0/668486203 conn(0x7f69000679a0 msgr2=0x7f69001525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:12.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.104+0000 7f690874f700 1 -- 172.21.15.97:0/668486203 shutdown_connections 2023-06-23T00:59:12.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:12.104+0000 7f690874f700 1 -- 172.21.15.97:0/668486203 wait complete. 2023-06-23T00:59:12.114 INFO:teuthology.orchestra.run.smithi097.stderr:adjusted tunables profile to default 2023-06-23T00:59:12.123 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-23T00:59:12.123 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:59:12.124 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-23T00:59:12.140 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:59:12.140 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-23T00:59:12.149 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:59:12.150 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-23T00:59:12.165 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-06-23T00:59:12.166 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-23T00:59:12.180 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:59:12.180 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-23T00:59:12.182 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:12.176+0000 7f790d59e000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-23T00:59:12.195 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:59:12.196 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-23T00:59:12.253 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:59:12.253 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-23T00:59:12.269 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-23T00:59:12.269 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-23T00:59:12.280 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 291bc189-d5fb-482f-92d6-f7ecfb0a388c 0 2023-06-23T00:59:12.379 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:12.372+0000 7f5571182000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-23T00:59:12.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 Processor -- start 2023-06-23T00:59:12.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 -- start start 2023-06-23T00:59:12.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f099406da60 0x7f099406ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f099406b180 0x7f09940ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099406ca70 con 0x7f0994158a40 2023-06-23T00:59:12.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099406ded0 con 0x7f099406b180 2023-06-23T00:59:12.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099406b600 con 0x7f099406da60 2023-06-23T00:59:12.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099259c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0994158a40 0x7f09940c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43584/0 (socket says 172.21.15.149:43584) 2023-06-23T00:59:12.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099259c700 1 -- 172.21.15.149:0/2364680433 learned_addr learned my addr 172.21.15.149:0/2364680433 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-23T00:59:12.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f0991d9b700 1 --2- 172.21.15.149:0/2364680433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f099406da60 0x7f099406ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f0992d9d700 1 --2- 172.21.15.149:0/2364680433 >> v2:172.21.15.97:3300/0 conn(0x7f099406b180 0x7f09940ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099159a700 1 -- 172.21.15.149:0/2364680433 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934401100 0 0) 0x7f099406ca70 con 0x7f0994158a40 2023-06-23T00:59:12.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f0991d9b700 1 -- 172.21.15.149:0/2364680433 >> v2:172.21.15.97:3300/0 conn(0x7f099406b180 msgr2=0x7f09940ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:12.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f0991d9b700 1 --2- 172.21.15.149:0/2364680433 >> v2:172.21.15.97:3300/0 conn(0x7f099406b180 0x7f09940ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f0991d9b700 1 -- 172.21.15.149:0/2364680433 >> v1:172.21.15.149:6789/0 conn(0x7f0994158a40 legacy=0x7f09940c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f0991d9b700 1 -- 172.21.15.149:0/2364680433 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099406cca0 con 0x7f099406da60 2023-06-23T00:59:12.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f0991d9b700 1 --2- 172.21.15.149:0/2364680433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f099406da60 0x7f099406ac40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09880098e0 tx=0x7f09880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f59f2345ef10d251 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:12.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099159a700 1 -- 172.21.15.149:0/2364680433 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988009e80 con 0x7f099406da60 2023-06-23T00:59:12.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099159a700 1 -- 172.21.15.149:0/2364680433 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098800b860 con 0x7f099406da60 2023-06-23T00:59:12.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099159a700 1 -- 172.21.15.149:0/2364680433 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098800bbe0 con 0x7f099406da60 2023-06-23T00:59:12.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 -- 172.21.15.149:0/2364680433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f099406da60 msgr2=0x7f099406ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 --2- 172.21.15.149:0/2364680433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f099406da60 0x7f099406ac40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09880098e0 tx=0x7f09880091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 -- 172.21.15.149:0/2364680433 shutdown_connections 2023-06-23T00:59:12.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 --2- 172.21.15.149:0/2364680433 >> v2:172.21.15.97:3300/0 conn(0x7f099406b180 0x7f09940ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 --2- 172.21.15.149:0/2364680433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f099406da60 0x7f099406ac40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 -- 172.21.15.149:0/2364680433 >> 172.21.15.149:0/2364680433 conn(0x7f09940c9180 msgr2=0x7f09940c9580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:12.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 -- 172.21.15.149:0/2364680433 shutdown_connections 2023-06-23T00:59:12.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.428+0000 7f099359e700 1 -- 172.21.15.149:0/2364680433 wait complete. 2023-06-23T00:59:12.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f099359e700 1 Processor -- start 2023-06-23T00:59:12.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f099359e700 1 -- start start 2023-06-23T00:59:12.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f099359e700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f099406b180 0x7f09940b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f099359e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f099406da60 0x7f09941461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f099359e700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0994158a40 0x7f09940c2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f099359e700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940c81a0 con 0x7f099406b180 2023-06-23T00:59:12.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f099359e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940c7d10 con 0x7f099406da60 2023-06-23T00:59:12.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f099359e700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09940b1e10 con 0x7f0994158a40 2023-06-23T00:59:12.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f0991d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f099406da60 0x7f09941461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f0991d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f099406da60 0x7f09941461b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45062/0 (socket says 172.21.15.149:45062) 2023-06-23T00:59:12.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f0991d9b700 1 -- 172.21.15.149:0/377996707 learned_addr learned my addr 172.21.15.149:0/377996707 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-23T00:59:12.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f0992d9d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0994158a40 0x7f09940c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f099259c700 1 --2- 172.21.15.149:0/377996707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f099406b180 0x7f09940b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f0991d9b700 1 -- 172.21.15.149:0/377996707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0994158a40 msgr2=0x7f09940c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f0991d9b700 1 --2- 172.21.15.149:0/377996707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0994158a40 0x7f09940c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f0991d9b700 1 -- 172.21.15.149:0/377996707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f099406b180 msgr2=0x7f09940b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f0991d9b700 1 --2- 172.21.15.149:0/377996707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f099406b180 0x7f09940b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f0991d9b700 1 -- 172.21.15.149:0/377996707 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009420 con 0x7f099406da60 2023-06-23T00:59:12.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f0991d9b700 1 --2- 172.21.15.149:0/377996707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f099406da60 0x7f09941461b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f098800b5b0 tx=0x7f0988017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f09827fc700 1 -- 172.21.15.149:0/377996707 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098801f070 con 0x7f099406da60 2023-06-23T00:59:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f09827fc700 1 -- 172.21.15.149:0/377996707 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0988000c90 con 0x7f099406da60 2023-06-23T00:59:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f099359e700 1 -- 172.21.15.149:0/377996707 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09941466f0 con 0x7f099406da60 2023-06-23T00:59:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f09827fc700 1 -- 172.21.15.149:0/377996707 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988025420 con 0x7f099406da60 2023-06-23T00:59:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f099359e700 1 -- 172.21.15.149:0/377996707 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09940c73e0 con 0x7f099406da60 2023-06-23T00:59:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f09827fc700 1 -- 172.21.15.149:0/377996707 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0988023070 con 0x7f099406da60 2023-06-23T00:59:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.432+0000 7f09827fc700 1 -- 172.21.15.149:0/377996707 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f098802f440 con 0x7f099406da60 2023-06-23T00:59:12.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.436+0000 7f099359e700 1 -- 172.21.15.149:0/377996707 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0994069ba0 con 0x7f099406da60 2023-06-23T00:59:12.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.440+0000 7f09827fc700 1 -- 172.21.15.149:0/377996707 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f098802a070 con 0x7f099406da60 2023-06-23T00:59:12.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.516+0000 7f099359e700 1 -- 172.21.15.149:0/377996707 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "291bc189-d5fb-482f-92d6-f7ecfb0a388c", "id": 0} v 0) v1 -- 0x7f099404b3f0 con 0x7f099406da60 2023-06-23T00:59:12.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.524+0000 7f09827fc700 1 -- 172.21.15.149:0/377996707 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "291bc189-d5fb-482f-92d6-f7ecfb0a388c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0988015020 con 0x7f099406da60 2023-06-23T00:59:12.529 INFO:teuthology.orchestra.run.smithi149.stdout:0 2023-06-23T00:59:12.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.524+0000 7f099359e700 1 -- 172.21.15.149:0/377996707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f099406da60 msgr2=0x7f09941461b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.524+0000 7f099359e700 1 --2- 172.21.15.149:0/377996707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f099406da60 0x7f09941461b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f098800b5b0 tx=0x7f0988017000 comp rx=0 tx=0).stop 2023-06-23T00:59:12.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.524+0000 7f099359e700 1 -- 172.21.15.149:0/377996707 shutdown_connections 2023-06-23T00:59:12.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.524+0000 7f099359e700 1 --2- 172.21.15.149:0/377996707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0994158a40 0x7f09940c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.524+0000 7f099359e700 1 --2- 172.21.15.149:0/377996707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f099406da60 0x7f09941461b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.524+0000 7f099359e700 1 --2- 172.21.15.149:0/377996707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f099406b180 0x7f09940b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.524+0000 7f099359e700 1 -- 172.21.15.149:0/377996707 >> 172.21.15.149:0/377996707 conn(0x7f09940c9180 msgr2=0x7f0994154a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:12.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.524+0000 7f099359e700 1 -- 172.21.15.149:0/377996707 shutdown_connections 2023-06-23T00:59:12.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.524+0000 7f099359e700 1 -- 172.21.15.149:0/377996707 wait complete. 2023-06-23T00:59:12.543 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 693551b5-827b-4530-80b1-a836095efbf3 1 2023-06-23T00:59:12.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.648+0000 7f60a3510700 1 Processor -- start 2023-06-23T00:59:12.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.648+0000 7f60a3510700 1 -- start start 2023-06-23T00:59:12.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a3510700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 0x7f609c0c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a3510700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f609c155b30 0x7f609c0c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a3510700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c068330 con 0x7f609c155760 2023-06-23T00:59:12.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a3510700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c0c8490 con 0x7f609c155b30 2023-06-23T00:59:12.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a3510700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c06cf80 con 0x7f609c0caf70 2023-06-23T00:59:12.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a0aab700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 0x7f609c0c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a0aab700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 0x7f609c0c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:40768/0 (socket says 172.21.15.149:40768) 2023-06-23T00:59:12.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a0aab700 1 -- 172.21.15.149:0/3448603878 learned_addr learned my addr 172.21.15.149:0/3448603878 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-23T00:59:12.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a1aad700 1 --2- 172.21.15.149:0/3448603878 >> v2:172.21.15.97:3300/0 conn(0x7f609c155b30 0x7f609c0c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a0aab700 1 -- 172.21.15.149:0/3448603878 >> v2:172.21.15.97:3300/0 conn(0x7f609c155b30 msgr2=0x7f609c0c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:12.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a0aab700 1 --2- 172.21.15.149:0/3448603878 >> v2:172.21.15.97:3300/0 conn(0x7f609c155b30 0x7f609c0c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a0aab700 1 -- 172.21.15.149:0/3448603878 >> v1:172.21.15.97:6789/0 conn(0x7f609c155760 legacy=0x7f609c0ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a0aab700 1 -- 172.21.15.149:0/3448603878 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c06db90 con 0x7f609c0caf70 2023-06-23T00:59:12.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a0aab700 1 --2- 172.21.15.149:0/3448603878 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 0x7f609c0c7a10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f608c0099b0 tx=0x7f608c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18e0d43ebd99f262 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:12.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f6093fff700 1 -- 172.21.15.149:0/3448603878 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c00b860 con 0x7f609c0caf70 2023-06-23T00:59:12.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f6093fff700 1 -- 172.21.15.149:0/3448603878 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c00b9c0 con 0x7f609c0caf70 2023-06-23T00:59:12.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f6093fff700 1 -- 172.21.15.149:0/3448603878 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c00bd60 con 0x7f609c0caf70 2023-06-23T00:59:12.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a3510700 1 -- 172.21.15.149:0/3448603878 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 msgr2=0x7f609c0c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a3510700 1 --2- 172.21.15.149:0/3448603878 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 0x7f609c0c7a10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f608c0099b0 tx=0x7f608c009250 comp rx=0 tx=0).stop 2023-06-23T00:59:12.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a3510700 1 -- 172.21.15.149:0/3448603878 shutdown_connections 2023-06-23T00:59:12.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a3510700 1 --2- 172.21.15.149:0/3448603878 >> v2:172.21.15.97:3300/0 conn(0x7f609c155b30 0x7f609c0c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a3510700 1 --2- 172.21.15.149:0/3448603878 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 0x7f609c0c7a10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a3510700 1 -- 172.21.15.149:0/3448603878 >> 172.21.15.149:0/3448603878 conn(0x7f609c0c8b20 msgr2=0x7f609c0c8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:12.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a3510700 1 -- 172.21.15.149:0/3448603878 shutdown_connections 2023-06-23T00:59:12.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.652+0000 7f60a3510700 1 -- 172.21.15.149:0/3448603878 wait complete. 2023-06-23T00:59:12.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a3510700 1 Processor -- start 2023-06-23T00:59:12.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a3510700 1 -- start start 2023-06-23T00:59:12.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a3510700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 0x7f609c1391d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a3510700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f609c155760 0x7f609c1504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a3510700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f609c155b30 0x7f609c0ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a3510700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c14f0f0 con 0x7f609c155760 2023-06-23T00:59:12.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a3510700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c139cb0 con 0x7f609c155b30 2023-06-23T00:59:12.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a3510700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c150ef0 con 0x7f609c0caf70 2023-06-23T00:59:12.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a12ac700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 0x7f609c1391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a12ac700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 0x7f609c1391d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:40782/0 (socket says 172.21.15.149:40782) 2023-06-23T00:59:12.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a12ac700 1 -- 172.21.15.149:0/626994774 learned_addr learned my addr 172.21.15.149:0/626994774 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-23T00:59:12.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a1aad700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f609c155b30 0x7f609c0ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a0aab700 1 --2- 172.21.15.149:0/626994774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f609c155760 0x7f609c1504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a12ac700 1 -- 172.21.15.149:0/626994774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f609c155b30 msgr2=0x7f609c0ac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a12ac700 1 --2- 172.21.15.149:0/626994774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f609c155b30 0x7f609c0ac550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a12ac700 1 -- 172.21.15.149:0/626994774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f609c155760 msgr2=0x7f609c1504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a12ac700 1 --2- 172.21.15.149:0/626994774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f609c155760 0x7f609c1504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a12ac700 1 -- 172.21.15.149:0/626994774 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0094f0 con 0x7f609c0caf70 2023-06-23T00:59:12.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a12ac700 1 --2- 172.21.15.149:0/626994774 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 0x7f609c1391d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f609800ea00 tx=0x7f609800c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:12.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60917fa700 1 -- 172.21.15.149:0/626994774 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980015c0 con 0x7f609c0caf70 2023-06-23T00:59:12.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60917fa700 1 -- 172.21.15.149:0/626994774 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6098001720 con 0x7f609c0caf70 2023-06-23T00:59:12.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a3510700 1 -- 172.21.15.149:0/626994774 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c1511d0 con 0x7f609c0caf70 2023-06-23T00:59:12.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60917fa700 1 -- 172.21.15.149:0/626994774 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098001ae0 con 0x7f609c0caf70 2023-06-23T00:59:12.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60a3510700 1 -- 172.21.15.149:0/626994774 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c151810 con 0x7f609c0caf70 2023-06-23T00:59:12.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60917fa700 1 -- 172.21.15.149:0/626994774 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6098017030 con 0x7f609c0caf70 2023-06-23T00:59:12.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.656+0000 7f60917fa700 1 -- 172.21.15.149:0/626994774 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f6098015070 con 0x7f609c0caf70 2023-06-23T00:59:12.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.660+0000 7f60a3510700 1 -- 172.21.15.149:0/626994774 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c04bc30 con 0x7f609c0caf70 2023-06-23T00:59:12.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.660+0000 7f60917fa700 1 -- 172.21.15.149:0/626994774 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f60980396e0 con 0x7f609c0caf70 2023-06-23T00:59:12.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.736+0000 7f60a3510700 1 -- 172.21.15.149:0/626994774 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "693551b5-827b-4530-80b1-a836095efbf3", "id": 1} v 0) v1 -- 0x7f609c06b750 con 0x7f609c0caf70 2023-06-23T00:59:12.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.744+0000 7f60917fa700 1 -- 172.21.15.149:0/626994774 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "693551b5-827b-4530-80b1-a836095efbf3", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6098028070 con 0x7f609c0caf70 2023-06-23T00:59:12.749 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-06-23T00:59:12.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.744+0000 7f60a3510700 1 -- 172.21.15.149:0/626994774 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 msgr2=0x7f609c1391d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.744+0000 7f60a3510700 1 --2- 172.21.15.149:0/626994774 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 0x7f609c1391d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f609800ea00 tx=0x7f609800c300 comp rx=0 tx=0).stop 2023-06-23T00:59:12.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.744+0000 7f60a3510700 1 -- 172.21.15.149:0/626994774 shutdown_connections 2023-06-23T00:59:12.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.744+0000 7f60a3510700 1 --2- 172.21.15.149:0/626994774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f609c155b30 0x7f609c0ac550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.744+0000 7f60a3510700 1 --2- 172.21.15.149:0/626994774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f609c155760 0x7f609c1504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.744+0000 7f60a3510700 1 --2- 172.21.15.149:0/626994774 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609c0caf70 0x7f609c1391d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.744+0000 7f60a3510700 1 -- 172.21.15.149:0/626994774 >> 172.21.15.149:0/626994774 conn(0x7f609c0c8b20 msgr2=0x7f609c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:12.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.744+0000 7f60a3510700 1 -- 172.21.15.149:0/626994774 shutdown_connections 2023-06-23T00:59:12.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.744+0000 7f60a3510700 1 -- 172.21.15.149:0/626994774 wait complete. 2023-06-23T00:59:12.763 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new a100d026-e382-4e71-bda5-ffa59f6b596b 2 2023-06-23T00:59:12.789 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:12.784+0000 7f790d59e000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-23T00:59:12.846 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:12.844+0000 7f790d59e000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-23T00:59:12.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.860+0000 7f58816a5700 1 Processor -- start 2023-06-23T00:59:12.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.860+0000 7f58816a5700 1 -- start start 2023-06-23T00:59:12.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f587c068d10 0x7f587c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f587c155ab0 0x7f587c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c0cb190 con 0x7f587c1556e0 2023-06-23T00:59:12.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c06e2f0 con 0x7f587c068d10 2023-06-23T00:59:12.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0ca580 con 0x7f587c155ab0 2023-06-23T00:59:12.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f587b7fe700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f587c155ab0 0x7f587c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f587affd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f587c1556e0 0x7f587c068600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43598/0 (socket says 172.21.15.149:43598) 2023-06-23T00:59:12.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f587affd700 1 -- 172.21.15.149:0/2402679987 learned_addr learned my addr 172.21.15.149:0/2402679987 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-23T00:59:12.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f587a7fc700 1 --2- 172.21.15.149:0/2402679987 >> v2:172.21.15.97:3300/0 conn(0x7f587c068d10 0x7f587c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f5879ffb700 1 -- 172.21.15.149:0/2402679987 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452489520 0 0) 0x7f587c0cb190 con 0x7f587c1556e0 2023-06-23T00:59:12.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f587b7fe700 1 -- 172.21.15.149:0/2402679987 >> v2:172.21.15.97:3300/0 conn(0x7f587c068d10 msgr2=0x7f587c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:12.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f587b7fe700 1 --2- 172.21.15.149:0/2402679987 >> v2:172.21.15.97:3300/0 conn(0x7f587c068d10 0x7f587c0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f587b7fe700 1 -- 172.21.15.149:0/2402679987 >> v1:172.21.15.149:6789/0 conn(0x7f587c1556e0 legacy=0x7f587c068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f587b7fe700 1 -- 172.21.15.149:0/2402679987 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0ca860 con 0x7f587c155ab0 2023-06-23T00:59:12.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f587b7fe700 1 --2- 172.21.15.149:0/2402679987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f587c155ab0 0x7f587c0cc190 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f587400d0d0 tx=0x7f587400b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e02a87ee0fddccdf server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:12.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f5879ffb700 1 -- 172.21.15.149:0/2402679987 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874010070 con 0x7f587c155ab0 2023-06-23T00:59:12.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f5879ffb700 1 -- 172.21.15.149:0/2402679987 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587400ddf0 con 0x7f587c155ab0 2023-06-23T00:59:12.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f5879ffb700 1 -- 172.21.15.149:0/2402679987 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400b320 con 0x7f587c155ab0 2023-06-23T00:59:12.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 -- 172.21.15.149:0/2402679987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f587c155ab0 msgr2=0x7f587c0cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 --2- 172.21.15.149:0/2402679987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f587c155ab0 0x7f587c0cc190 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f587400d0d0 tx=0x7f587400b990 comp rx=0 tx=0).stop 2023-06-23T00:59:12.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 -- 172.21.15.149:0/2402679987 shutdown_connections 2023-06-23T00:59:12.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 --2- 172.21.15.149:0/2402679987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f587c155ab0 0x7f587c0cc190 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 --2- 172.21.15.149:0/2402679987 >> v2:172.21.15.97:3300/0 conn(0x7f587c068d10 0x7f587c0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 -- 172.21.15.149:0/2402679987 >> 172.21.15.149:0/2402679987 conn(0x7f587c0c9380 msgr2=0x7f587c0c9780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:12.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 -- 172.21.15.149:0/2402679987 shutdown_connections 2023-06-23T00:59:12.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 -- 172.21.15.149:0/2402679987 wait complete. 2023-06-23T00:59:12.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.864+0000 7f58816a5700 1 Processor -- start 2023-06-23T00:59:12.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f58816a5700 1 -- start start 2023-06-23T00:59:12.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f58816a5700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f587c068d10 0x7f587c151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f58816a5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f587c1556e0 0x7f587c1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f58816a5700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f587c155ab0 0x7f587c13eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:12.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f58816a5700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c14f490 con 0x7f587c155ab0 2023-06-23T00:59:12.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f58816a5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c1542d0 con 0x7f587c1556e0 2023-06-23T00:59:12.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f58816a5700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c1545b0 con 0x7f587c068d10 2023-06-23T00:59:12.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f587affd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f587c068d10 0x7f587c151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f587a7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f587c1556e0 0x7f587c1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f587affd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f587c068d10 0x7f587c151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:40794/0 (socket says 172.21.15.149:40794) 2023-06-23T00:59:12.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f587affd700 1 -- 172.21.15.149:0/2523424963 learned_addr learned my addr 172.21.15.149:0/2523424963 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-23T00:59:12.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f587b7fe700 1 --2- 172.21.15.149:0/2523424963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f587c155ab0 0x7f587c13eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:12.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f587a7fc700 1 -- 172.21.15.149:0/2523424963 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f587c068d10 msgr2=0x7f587c151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f587a7fc700 1 --2- 172.21.15.149:0/2523424963 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f587c068d10 0x7f587c151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f587a7fc700 1 -- 172.21.15.149:0/2523424963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f587c155ab0 msgr2=0x7f587c13eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f587a7fc700 1 --2- 172.21.15.149:0/2523424963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f587c155ab0 0x7f587c13eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f587a7fc700 1 -- 172.21.15.149:0/2523424963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587400bc30 con 0x7f587c1556e0 2023-06-23T00:59:12.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f587a7fc700 1 --2- 172.21.15.149:0/2523424963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f587c1556e0 0x7f587c1537f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f587000d890 tx=0x7f5870008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:12.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f5862ffd700 1 -- 172.21.15.149:0/2523424963 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58700125f0 con 0x7f587c1556e0 2023-06-23T00:59:12.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f5862ffd700 1 -- 172.21.15.149:0/2523424963 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870012750 con 0x7f587c1556e0 2023-06-23T00:59:12.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f58816a5700 1 -- 172.21.15.149:0/2523424963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c154890 con 0x7f587c1556e0 2023-06-23T00:59:12.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f5862ffd700 1 -- 172.21.15.149:0/2523424963 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870012af0 con 0x7f587c1556e0 2023-06-23T00:59:12.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f58816a5700 1 -- 172.21.15.149:0/2523424963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c14da40 con 0x7f587c1556e0 2023-06-23T00:59:12.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f5862ffd700 1 -- 172.21.15.149:0/2523424963 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5870013480 con 0x7f587c1556e0 2023-06-23T00:59:12.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f5862ffd700 1 -- 172.21.15.149:0/2523424963 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f587001d890 con 0x7f587c1556e0 2023-06-23T00:59:12.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.868+0000 7f58816a5700 1 -- 172.21.15.149:0/2523424963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c14f600 con 0x7f587c1556e0 2023-06-23T00:59:12.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.872+0000 7f5862ffd700 1 -- 172.21.15.149:0/2523424963 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f5870012e60 con 0x7f587c1556e0 2023-06-23T00:59:12.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.944+0000 7f58816a5700 1 -- 172.21.15.149:0/2523424963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a100d026-e382-4e71-bda5-ffa59f6b596b", "id": 2} v 0) v1 -- 0x7f587c04bc30 con 0x7f587c1556e0 2023-06-23T00:59:12.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.952+0000 7f5862ffd700 1 -- 172.21.15.149:0/2523424963 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a100d026-e382-4e71-bda5-ffa59f6b596b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f587001d460 con 0x7f587c1556e0 2023-06-23T00:59:12.955 INFO:teuthology.orchestra.run.smithi149.stdout:2 2023-06-23T00:59:12.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.952+0000 7f58816a5700 1 -- 172.21.15.149:0/2523424963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f587c1556e0 msgr2=0x7f587c1537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:12.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.952+0000 7f58816a5700 1 --2- 172.21.15.149:0/2523424963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f587c1556e0 0x7f587c1537f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f587000d890 tx=0x7f5870008040 comp rx=0 tx=0).stop 2023-06-23T00:59:12.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.952+0000 7f58816a5700 1 -- 172.21.15.149:0/2523424963 shutdown_connections 2023-06-23T00:59:12.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.952+0000 7f58816a5700 1 --2- 172.21.15.149:0/2523424963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f587c155ab0 0x7f587c13eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.952+0000 7f58816a5700 1 --2- 172.21.15.149:0/2523424963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f587c1556e0 0x7f587c1537f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.952+0000 7f58816a5700 1 --2- 172.21.15.149:0/2523424963 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f587c068d10 0x7f587c151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:12.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.952+0000 7f58816a5700 1 -- 172.21.15.149:0/2523424963 >> 172.21.15.149:0/2523424963 conn(0x7f587c0c9380 msgr2=0x7f587c068600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:12.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.952+0000 7f58816a5700 1 -- 172.21.15.149:0/2523424963 shutdown_connections 2023-06-23T00:59:12.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:12.952+0000 7f58816a5700 1 -- 172.21.15.149:0/2523424963 wait complete. 2023-06-23T00:59:12.962 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:12.960+0000 7f790d59e000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-23T00:59:12.970 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 91783241-7821-458e-996f-a740274b18ca 3 2023-06-23T00:59:12.971 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:12.964+0000 7f5571182000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-23T00:59:13.026 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:13.020+0000 7f5571182000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-23T00:59:13.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.068+0000 7fd10059f700 1 Processor -- start 2023-06-23T00:59:13.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 -- start start 2023-06-23T00:59:13.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd0f80c81c0 0x7fd0f8067aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0f80c7ac0 0x7fd0f8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f8067610 con 0x7fd0f8158a40 2023-06-23T00:59:13.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f8068520 con 0x7fd0f80c81c0 2023-06-23T00:59:13.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80c8930 con 0x7fd0f80c7ac0 2023-06-23T00:59:13.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd0fdb3a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd0f80c81c0 0x7fd0f8067aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd0feb3c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0f80c7ac0 0x7fd0f8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd0fdb3a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd0f80c81c0 0x7fd0f8067aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45086/0 (socket says 172.21.15.149:45086) 2023-06-23T00:59:13.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd0fdb3a700 1 -- 172.21.15.149:0/3920922406 learned_addr learned my addr 172.21.15.149:0/3920922406 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-23T00:59:13.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd0fdb3a700 1 -- 172.21.15.149:0/3920922406 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0f80c7ac0 msgr2=0x7fd0f8067fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:13.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd0fdb3a700 1 --2- 172.21.15.149:0/3920922406 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0f80c7ac0 0x7fd0f8067fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd0fdb3a700 1 -- 172.21.15.149:0/3920922406 >> v1:172.21.15.97:6789/0 conn(0x7fd0f8158a40 legacy=0x7fd0f806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd0fdb3a700 1 -- 172.21.15.149:0/3920922406 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8067000 con 0x7fd0f80c81c0 2023-06-23T00:59:13.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd0feb3c700 1 --2- 172.21.15.149:0/3920922406 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0f80c7ac0 0x7fd0f8067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:13.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd0fdb3a700 1 --2- 172.21.15.149:0/3920922406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f80c81c0 0x7fd0f8067aa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80099b0 tx=0x7fd0e8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=311ef12a085ae9d3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:13.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd0fd339700 1 -- 172.21.15.149:0/3920922406 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8009ea0 con 0x7fd0f80c81c0 2023-06-23T00:59:13.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd0fd339700 1 -- 172.21.15.149:0/3920922406 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e800b860 con 0x7fd0f80c81c0 2023-06-23T00:59:13.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd0fd339700 1 -- 172.21.15.149:0/3920922406 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e800bc00 con 0x7fd0f80c81c0 2023-06-23T00:59:13.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 -- 172.21.15.149:0/3920922406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f80c81c0 msgr2=0x7fd0f8067aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 --2- 172.21.15.149:0/3920922406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f80c81c0 0x7fd0f8067aa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80099b0 tx=0x7fd0e8009250 comp rx=0 tx=0).stop 2023-06-23T00:59:13.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 -- 172.21.15.149:0/3920922406 shutdown_connections 2023-06-23T00:59:13.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 --2- 172.21.15.149:0/3920922406 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0f80c7ac0 0x7fd0f8067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 --2- 172.21.15.149:0/3920922406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f80c81c0 0x7fd0f8067aa0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 -- 172.21.15.149:0/3920922406 >> 172.21.15.149:0/3920922406 conn(0x7fd0f80c8b20 msgr2=0x7fd0f80c8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:13.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 -- 172.21.15.149:0/3920922406 shutdown_connections 2023-06-23T00:59:13.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.072+0000 7fd10059f700 1 -- 172.21.15.149:0/3920922406 wait complete. 2023-06-23T00:59:13.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd10059f700 1 Processor -- start 2023-06-23T00:59:13.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd10059f700 1 -- start start 2023-06-23T00:59:13.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd10059f700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0f80c7ac0 0x7fd0f816a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd10059f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f80c81c0 0x7fd0f815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd10059f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0f8158a40 0x7fd0f816c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd10059f700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f8151860 con 0x7fd0f80c7ac0 2023-06-23T00:59:13.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd10059f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f8151b40 con 0x7fd0f80c81c0 2023-06-23T00:59:13.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd10059f700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f8151e20 con 0x7fd0f8158a40 2023-06-23T00:59:13.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd0fdb3a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f80c81c0 0x7fd0f815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd0fdb3a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f80c81c0 0x7fd0f815d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45098/0 (socket says 172.21.15.149:45098) 2023-06-23T00:59:13.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd0fdb3a700 1 -- 172.21.15.149:0/3925213480 learned_addr learned my addr 172.21.15.149:0/3925213480 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-23T00:59:13.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd0feb3c700 1 --2- 172.21.15.149:0/3925213480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0f8158a40 0x7fd0f816c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd0fe33b700 1 --2- 172.21.15.149:0/3925213480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0f80c7ac0 0x7fd0f816a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd0fdb3a700 1 -- 172.21.15.149:0/3925213480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0f8158a40 msgr2=0x7fd0f816c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd0fdb3a700 1 --2- 172.21.15.149:0/3925213480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0f8158a40 0x7fd0f816c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd0fdb3a700 1 -- 172.21.15.149:0/3925213480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0f80c7ac0 msgr2=0x7fd0f816a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd0fdb3a700 1 --2- 172.21.15.149:0/3925213480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0f80c7ac0 0x7fd0f816a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.076+0000 7fd0fdb3a700 1 -- 172.21.15.149:0/3925213480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f0009a20 con 0x7fd0f80c81c0 2023-06-23T00:59:13.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.080+0000 7fd0fdb3a700 1 --2- 172.21.15.149:0/3925213480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f80c81c0 0x7fd0f815d0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8069bb0 tx=0x7fd0e8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:13.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.080+0000 7fd0ee7fc700 1 -- 172.21.15.149:0/3925213480 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e800bbe0 con 0x7fd0f80c81c0 2023-06-23T00:59:13.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.080+0000 7fd0ee7fc700 1 -- 172.21.15.149:0/3925213480 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e8011420 con 0x7fd0f80c81c0 2023-06-23T00:59:13.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.080+0000 7fd0ee7fc700 1 -- 172.21.15.149:0/3925213480 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e80117c0 con 0x7fd0f80c81c0 2023-06-23T00:59:13.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.080+0000 7fd10059f700 1 -- 172.21.15.149:0/3925213480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e80094f0 con 0x7fd0f80c81c0 2023-06-23T00:59:13.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.080+0000 7fd10059f700 1 -- 172.21.15.149:0/3925213480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f81523e0 con 0x7fd0f80c81c0 2023-06-23T00:59:13.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.080+0000 7fd0ee7fc700 1 -- 172.21.15.149:0/3925213480 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd0e8011bf0 con 0x7fd0f80c81c0 2023-06-23T00:59:13.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.080+0000 7fd0ee7fc700 1 -- 172.21.15.149:0/3925213480 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fd0e8023890 con 0x7fd0f80c81c0 2023-06-23T00:59:13.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.080+0000 7fd10059f700 1 -- 172.21.15.149:0/3925213480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f8152600 con 0x7fd0f80c81c0 2023-06-23T00:59:13.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.084+0000 7fd0ee7fc700 1 -- 172.21.15.149:0/3925213480 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fd0e8028070 con 0x7fd0f80c81c0 2023-06-23T00:59:13.132 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:13.124+0000 7f5571182000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-23T00:59:13.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.156+0000 7fd10059f700 1 -- 172.21.15.149:0/3925213480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "91783241-7821-458e-996f-a740274b18ca", "id": 3} v 0) v1 -- 0x7fd0f804bc30 con 0x7fd0f80c81c0 2023-06-23T00:59:13.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.168+0000 7fd0ee7fc700 1 -- 172.21.15.149:0/3925213480 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "91783241-7821-458e-996f-a740274b18ca", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd0e8015020 con 0x7fd0f80c81c0 2023-06-23T00:59:13.172 INFO:teuthology.orchestra.run.smithi149.stdout:3 2023-06-23T00:59:13.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.168+0000 7fd10059f700 1 -- 172.21.15.149:0/3925213480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f80c81c0 msgr2=0x7fd0f815d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.168+0000 7fd10059f700 1 --2- 172.21.15.149:0/3925213480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f80c81c0 0x7fd0f815d0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8069bb0 tx=0x7fd0e8017000 comp rx=0 tx=0).stop 2023-06-23T00:59:13.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.168+0000 7fd10059f700 1 -- 172.21.15.149:0/3925213480 shutdown_connections 2023-06-23T00:59:13.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.168+0000 7fd10059f700 1 --2- 172.21.15.149:0/3925213480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0f8158a40 0x7fd0f816c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.168+0000 7fd10059f700 1 --2- 172.21.15.149:0/3925213480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0f80c81c0 0x7fd0f815d0a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.168+0000 7fd10059f700 1 --2- 172.21.15.149:0/3925213480 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0f80c7ac0 0x7fd0f816a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.168+0000 7fd10059f700 1 -- 172.21.15.149:0/3925213480 >> 172.21.15.149:0/3925213480 conn(0x7fd0f80c8b20 msgr2=0x7fd0f80679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:13.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.168+0000 7fd10059f700 1 -- 172.21.15.149:0/3925213480 shutdown_connections 2023-06-23T00:59:13.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.168+0000 7fd10059f700 1 -- 172.21.15.149:0/3925213480 wait complete. 2023-06-23T00:59:13.185 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 67c375d3-ec8f-4d1a-bea7-e47896705fb2 4 2023-06-23T00:59:13.194 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:13.192+0000 7f790d59e000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-23T00:59:13.244 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:13.240+0000 7f790d59e000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-23T00:59:13.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5e0e04700 1 Processor -- start 2023-06-23T00:59:13.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5e0e04700 1 -- start start 2023-06-23T00:59:13.290 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5e0e04700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc0b14c0 0x7fa5dc0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5e0e04700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5dc0ca600 con 0x7fa5dc157060 2023-06-23T00:59:13.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5e0e04700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5dc157560 con 0x7fa5dc151240 2023-06-23T00:59:13.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5e0e04700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc157840 con 0x7fa5dc0b14c0 2023-06-23T00:59:13.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5db7fe700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc0b14c0 0x7fa5dc0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5dbfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa5dc151240 0x7fa5dc0caac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43604/0 (socket says 172.21.15.149:43604) 2023-06-23T00:59:13.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5dbfff700 1 -- 172.21.15.149:0/777960676 learned_addr learned my addr 172.21.15.149:0/777960676 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-23T00:59:13.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5db7fe700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc0b14c0 0x7fa5dc0b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:40832/0 (socket says 172.21.15.149:40832) 2023-06-23T00:59:13.292 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5da7fc700 1 -- 172.21.15.149:0/777960676 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889147387 0 0) 0x7fa5dc157560 con 0x7fa5dc151240 2023-06-23T00:59:13.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5da7fc700 1 -- 172.21.15.149:0/777960676 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5c4003570 con 0x7fa5dc151240 2023-06-23T00:59:13.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5db7fe700 1 -- 172.21.15.149:0/777960676 >> v1:172.21.15.149:6789/0 conn(0x7fa5dc151240 legacy=0x7fa5dc0caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5db7fe700 1 -- 172.21.15.149:0/777960676 >> v1:172.21.15.97:6789/0 conn(0x7fa5dc157060 legacy=0x7fa5dc150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5db7fe700 1 -- 172.21.15.149:0/777960676 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc157b20 con 0x7fa5dc0b14c0 2023-06-23T00:59:13.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5db7fe700 1 --2- 172.21.15.149:0/777960676 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc0b14c0 0x7fa5dc0b1890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009910 tx=0x7fa5cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88d3b9ece55a5d67 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:13.293 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.284+0000 7fa5da7fc700 1 -- 172.21.15.149:0/777960676 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc00b680 con 0x7fa5dc0b14c0 2023-06-23T00:59:13.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5da7fc700 1 -- 172.21.15.149:0/777960676 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc00b7e0 con 0x7fa5dc0b14c0 2023-06-23T00:59:13.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5da7fc700 1 -- 172.21.15.149:0/777960676 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc00bba0 con 0x7fa5dc0b14c0 2023-06-23T00:59:13.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 -- 172.21.15.149:0/777960676 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc0b14c0 msgr2=0x7fa5dc0b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 --2- 172.21.15.149:0/777960676 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc0b14c0 0x7fa5dc0b1890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009910 tx=0x7fa5cc0091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 -- 172.21.15.149:0/777960676 shutdown_connections 2023-06-23T00:59:13.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 --2- 172.21.15.149:0/777960676 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc0b14c0 0x7fa5dc0b1890 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 -- 172.21.15.149:0/777960676 >> 172.21.15.149:0/777960676 conn(0x7fa5dc06c1d0 msgr2=0x7fa5dc06c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:13.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 -- 172.21.15.149:0/777960676 shutdown_connections 2023-06-23T00:59:13.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 -- 172.21.15.149:0/777960676 wait complete. 2023-06-23T00:59:13.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 Processor -- start 2023-06-23T00:59:13.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 -- start start 2023-06-23T00:59:13.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5dc0b14c0 0x7fa5dc142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc151240 0x7fa5dc068070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5dc157060 0x7fa5dc0685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc068ec0 con 0x7fa5dc0b14c0 2023-06-23T00:59:13.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc143730 con 0x7fa5dc157060 2023-06-23T00:59:13.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5e0e04700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc068be0 con 0x7fa5dc151240 2023-06-23T00:59:13.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.288+0000 7fa5daffd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc151240 0x7fa5dc068070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.298 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5daffd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc151240 0x7fa5dc068070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:40842/0 (socket says 172.21.15.149:40842) 2023-06-23T00:59:13.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5daffd700 1 -- 172.21.15.149:0/3511256932 learned_addr learned my addr 172.21.15.149:0/3511256932 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-23T00:59:13.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5dbfff700 1 --2- 172.21.15.149:0/3511256932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5dc157060 0x7fa5dc0685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5db7fe700 1 --2- 172.21.15.149:0/3511256932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5dc0b14c0 0x7fa5dc142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5daffd700 1 -- 172.21.15.149:0/3511256932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5dc157060 msgr2=0x7fa5dc0685b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5daffd700 1 --2- 172.21.15.149:0/3511256932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5dc157060 0x7fa5dc0685b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5daffd700 1 -- 172.21.15.149:0/3511256932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5dc0b14c0 msgr2=0x7fa5dc142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5daffd700 1 --2- 172.21.15.149:0/3511256932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5dc0b14c0 0x7fa5dc142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5daffd700 1 -- 172.21.15.149:0/3511256932 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc009420 con 0x7fa5dc151240 2023-06-23T00:59:13.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5daffd700 1 --2- 172.21.15.149:0/3511256932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc151240 0x7fa5dc068070 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000c590 tx=0x7fa5d0007f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:13.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5c37fe700 1 -- 172.21.15.149:0/3511256932 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0011590 con 0x7fa5dc151240 2023-06-23T00:59:13.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5c37fe700 1 -- 172.21.15.149:0/3511256932 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d0011710 con 0x7fa5dc151240 2023-06-23T00:59:13.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5e0e04700 1 -- 172.21.15.149:0/3511256932 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5dc169780 con 0x7fa5dc151240 2023-06-23T00:59:13.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5c37fe700 1 -- 172.21.15.149:0/3511256932 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0011ad0 con 0x7fa5dc151240 2023-06-23T00:59:13.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5e0e04700 1 -- 172.21.15.149:0/3511256932 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5dc169d40 con 0x7fa5dc151240 2023-06-23T00:59:13.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5c37fe700 1 -- 172.21.15.149:0/3511256932 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa5d001c6c0 con 0x7fa5dc151240 2023-06-23T00:59:13.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5c37fe700 1 -- 172.21.15.149:0/3511256932 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fa5d0012420 con 0x7fa5dc151240 2023-06-23T00:59:13.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.292+0000 7fa5e0e04700 1 -- 172.21.15.149:0/3511256932 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5dc169f60 con 0x7fa5dc151240 2023-06-23T00:59:13.302 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.296+0000 7fa5c37fe700 1 -- 172.21.15.149:0/3511256932 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fa5d0017070 con 0x7fa5dc151240 2023-06-23T00:59:13.351 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:13.344+0000 7f5571182000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-23T00:59:13.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.368+0000 7fa5e0e04700 1 -- 172.21.15.149:0/3511256932 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "67c375d3-ec8f-4d1a-bea7-e47896705fb2", "id": 4} v 0) v1 -- 0x7fa5dc04b3f0 con 0x7fa5dc151240 2023-06-23T00:59:13.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.380+0000 7fa5c37fe700 1 -- 172.21.15.149:0/3511256932 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "67c375d3-ec8f-4d1a-bea7-e47896705fb2", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa5d001c970 con 0x7fa5dc151240 2023-06-23T00:59:13.383 INFO:teuthology.orchestra.run.smithi149.stdout:4 2023-06-23T00:59:13.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.380+0000 7fa5e0e04700 1 -- 172.21.15.149:0/3511256932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc151240 msgr2=0x7fa5dc068070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.380+0000 7fa5e0e04700 1 --2- 172.21.15.149:0/3511256932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc151240 0x7fa5dc068070 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000c590 tx=0x7fa5d0007f50 comp rx=0 tx=0).stop 2023-06-23T00:59:13.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.380+0000 7fa5e0e04700 1 -- 172.21.15.149:0/3511256932 shutdown_connections 2023-06-23T00:59:13.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.380+0000 7fa5e0e04700 1 --2- 172.21.15.149:0/3511256932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5dc157060 0x7fa5dc0685b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.380+0000 7fa5e0e04700 1 --2- 172.21.15.149:0/3511256932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5dc151240 0x7fa5dc068070 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.380+0000 7fa5e0e04700 1 --2- 172.21.15.149:0/3511256932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5dc0b14c0 0x7fa5dc142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.380+0000 7fa5e0e04700 1 -- 172.21.15.149:0/3511256932 >> 172.21.15.149:0/3511256932 conn(0x7fa5dc06c1d0 msgr2=0x7fa5dc14e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:13.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.380+0000 7fa5e0e04700 1 -- 172.21.15.149:0/3511256932 shutdown_connections 2023-06-23T00:59:13.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.380+0000 7fa5e0e04700 1 -- 172.21.15.149:0/3511256932 wait complete. 2023-06-23T00:59:13.396 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 9de42b7c-cf51-4adf-9cc1-11c8d9863574 5 2023-06-23T00:59:13.399 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:13.392+0000 7f5571182000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-23T00:59:13.429 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:13.424+0000 7f790d59e000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-23T00:59:13.494 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:13.492+0000 7f790d59e000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-23T00:59:13.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.532+0000 7f1cd6034700 1 Processor -- start 2023-06-23T00:59:13.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.532+0000 7f1cd6034700 1 -- start start 2023-06-23T00:59:13.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.532+0000 7f1cd6034700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1cd0154dc0 0x7f1cd0155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.532+0000 7f1cd6034700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cd01593a0 0x7f1cd00c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.532+0000 7f1cd6034700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd00ca040 con 0x7f1cd00b0970 2023-06-23T00:59:13.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.532+0000 7f1cd6034700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd00c91e0 con 0x7f1cd0154dc0 2023-06-23T00:59:13.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.532+0000 7f1cd6034700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd00b0da0 con 0x7f1cd01593a0 2023-06-23T00:59:13.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.532+0000 7f1cd4831700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1cd00b0970 0x7f1cd0158c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43608/0 (socket says 172.21.15.149:43608) 2023-06-23T00:59:13.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.532+0000 7f1cd4831700 1 -- 172.21.15.149:0/4280170205 learned_addr learned my addr 172.21.15.149:0/4280170205 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-23T00:59:13.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.532+0000 7f1cd5833700 1 --2- 172.21.15.149:0/4280170205 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cd01593a0 0x7f1cd00c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.532+0000 7f1cd5032700 1 --2- 172.21.15.149:0/4280170205 >> v2:172.21.15.97:3300/0 conn(0x7f1cd0154dc0 0x7f1cd0155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cc3fff700 1 -- 172.21.15.149:0/4280170205 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716914678 0 0) 0x7f1cd00ca040 con 0x7f1cd00b0970 2023-06-23T00:59:13.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cc3fff700 1 -- 172.21.15.149:0/4280170205 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cbc003570 con 0x7f1cd00b0970 2023-06-23T00:59:13.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd5833700 1 -- 172.21.15.149:0/4280170205 >> v2:172.21.15.97:3300/0 conn(0x7f1cd0154dc0 msgr2=0x7f1cd0155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:13.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd5833700 1 --2- 172.21.15.149:0/4280170205 >> v2:172.21.15.97:3300/0 conn(0x7f1cd0154dc0 0x7f1cd0155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd5833700 1 -- 172.21.15.149:0/4280170205 >> v1:172.21.15.149:6789/0 conn(0x7f1cd00b0970 legacy=0x7f1cd0158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd5833700 1 -- 172.21.15.149:0/4280170205 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd00c9430 con 0x7f1cd01593a0 2023-06-23T00:59:13.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd5833700 1 --2- 172.21.15.149:0/4280170205 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cd01593a0 0x7f1cd00c8ca0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800af70 tx=0x7f1cc800a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a51183432d3df0e0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:13.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cc3fff700 1 -- 172.21.15.149:0/4280170205 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc800f070 con 0x7f1cd01593a0 2023-06-23T00:59:13.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cc3fff700 1 -- 172.21.15.149:0/4280170205 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc800a2e0 con 0x7f1cd01593a0 2023-06-23T00:59:13.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cc3fff700 1 -- 172.21.15.149:0/4280170205 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc800cc50 con 0x7f1cd01593a0 2023-06-23T00:59:13.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd6034700 1 -- 172.21.15.149:0/4280170205 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cd01593a0 msgr2=0x7f1cd00c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd6034700 1 --2- 172.21.15.149:0/4280170205 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cd01593a0 0x7f1cd00c8ca0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800af70 tx=0x7f1cc800a890 comp rx=0 tx=0).stop 2023-06-23T00:59:13.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd6034700 1 -- 172.21.15.149:0/4280170205 shutdown_connections 2023-06-23T00:59:13.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd6034700 1 --2- 172.21.15.149:0/4280170205 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cd01593a0 0x7f1cd00c8ca0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd6034700 1 --2- 172.21.15.149:0/4280170205 >> v2:172.21.15.97:3300/0 conn(0x7f1cd0154dc0 0x7f1cd0155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd6034700 1 -- 172.21.15.149:0/4280170205 >> 172.21.15.149:0/4280170205 conn(0x7f1cd006c1d0 msgr2=0x7f1cd006c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:13.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd6034700 1 -- 172.21.15.149:0/4280170205 shutdown_connections 2023-06-23T00:59:13.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd6034700 1 -- 172.21.15.149:0/4280170205 wait complete. 2023-06-23T00:59:13.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd6034700 1 Processor -- start 2023-06-23T00:59:13.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.536+0000 7f1cd6034700 1 -- start start 2023-06-23T00:59:13.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd6034700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00b0970 0x7f1cd01582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd6034700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cd0154dc0 0x7f1cd013f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd6034700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cd01593a0 0x7f1cd00af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd6034700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd0158810 con 0x7f1cd00b0970 2023-06-23T00:59:13.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd6034700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd00c7da0 con 0x7f1cd0154dc0 2023-06-23T00:59:13.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd6034700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd0157e40 con 0x7f1cd01593a0 2023-06-23T00:59:13.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd4831700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cd0154dc0 0x7f1cd013f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd5833700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cd01593a0 0x7f1cd00af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd4831700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cd0154dc0 0x7f1cd013f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45122/0 (socket says 172.21.15.149:45122) 2023-06-23T00:59:13.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd4831700 1 -- 172.21.15.149:0/3669880477 learned_addr learned my addr 172.21.15.149:0/3669880477 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-23T00:59:13.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd5032700 1 --2- 172.21.15.149:0/3669880477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00b0970 0x7f1cd01582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd4831700 1 -- 172.21.15.149:0/3669880477 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cd01593a0 msgr2=0x7f1cd00af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd4831700 1 --2- 172.21.15.149:0/3669880477 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cd01593a0 0x7f1cd00af960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd4831700 1 -- 172.21.15.149:0/3669880477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00b0970 msgr2=0x7f1cd01582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd4831700 1 --2- 172.21.15.149:0/3669880477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00b0970 0x7f1cd01582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd4831700 1 -- 172.21.15.149:0/3669880477 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc800ab30 con 0x7f1cd0154dc0 2023-06-23T00:59:13.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd5032700 1 --2- 172.21.15.149:0/3669880477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00b0970 0x7f1cd01582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:13.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd4831700 1 --2- 172.21.15.149:0/3669880477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cd0154dc0 0x7f1cd013f290 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400c7f0 tx=0x7f1cc4007dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:13.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cc17fa700 1 -- 172.21.15.149:0/3669880477 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4005c00 con 0x7f1cd0154dc0 2023-06-23T00:59:13.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cc17fa700 1 -- 172.21.15.149:0/3669880477 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc4005d60 con 0x7f1cd0154dc0 2023-06-23T00:59:13.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd6034700 1 -- 172.21.15.149:0/3669880477 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd013f7d0 con 0x7f1cd0154dc0 2023-06-23T00:59:13.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cc17fa700 1 -- 172.21.15.149:0/3669880477 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40072e0 con 0x7f1cd0154dc0 2023-06-23T00:59:13.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd6034700 1 -- 172.21.15.149:0/3669880477 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd01572e0 con 0x7f1cd0154dc0 2023-06-23T00:59:13.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cc17fa700 1 -- 172.21.15.149:0/3669880477 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1cc401c6c0 con 0x7f1cd0154dc0 2023-06-23T00:59:13.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cc17fa700 1 -- 172.21.15.149:0/3669880477 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f1cc4007710 con 0x7f1cd0154dc0 2023-06-23T00:59:13.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.540+0000 7f1cd6034700 1 -- 172.21.15.149:0/3669880477 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd0157f80 con 0x7f1cd0154dc0 2023-06-23T00:59:13.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.544+0000 7f1cc17fa700 1 -- 172.21.15.149:0/3669880477 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f1cc4021060 con 0x7f1cd0154dc0 2023-06-23T00:59:13.557 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:13.552+0000 7f790d59e000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-23T00:59:13.577 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:13.572+0000 7f5571182000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-23T00:59:13.629 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.623+0000 7f1cd6034700 1 -- 172.21.15.149:0/3669880477 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9de42b7c-cf51-4adf-9cc1-11c8d9863574", "id": 5} v 0) v1 -- 0x7f1cd004b420 con 0x7f1cd0154dc0 2023-06-23T00:59:13.636 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:13.632+0000 7f5571182000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-23T00:59:13.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.631+0000 7f1cc17fa700 1 -- 172.21.15.149:0/3669880477 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9de42b7c-cf51-4adf-9cc1-11c8d9863574", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1cc4017070 con 0x7f1cd0154dc0 2023-06-23T00:59:13.638 INFO:teuthology.orchestra.run.smithi149.stdout:5 2023-06-23T00:59:13.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.635+0000 7f1cd6034700 1 -- 172.21.15.149:0/3669880477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cd0154dc0 msgr2=0x7f1cd013f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.635+0000 7f1cd6034700 1 --2- 172.21.15.149:0/3669880477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cd0154dc0 0x7f1cd013f290 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400c7f0 tx=0x7f1cc4007dd0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.635+0000 7f1cd6034700 1 -- 172.21.15.149:0/3669880477 shutdown_connections 2023-06-23T00:59:13.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.635+0000 7f1cd6034700 1 --2- 172.21.15.149:0/3669880477 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1cd01593a0 0x7f1cd00af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.635+0000 7f1cd6034700 1 --2- 172.21.15.149:0/3669880477 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cd0154dc0 0x7f1cd013f290 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.635+0000 7f1cd6034700 1 --2- 172.21.15.149:0/3669880477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00b0970 0x7f1cd01582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.635+0000 7f1cd6034700 1 -- 172.21.15.149:0/3669880477 >> 172.21.15.149:0/3669880477 conn(0x7f1cd006c1d0 msgr2=0x7f1cd0158c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:13.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.635+0000 7f1cd6034700 1 -- 172.21.15.149:0/3669880477 shutdown_connections 2023-06-23T00:59:13.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.635+0000 7f1cd6034700 1 -- 172.21.15.149:0/3669880477 wait complete. 2023-06-23T00:59:13.651 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new ffa4ef96-2528-45cb-b2c9-a6c671b234e5 6 2023-06-23T00:59:13.697 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:13.692+0000 7f5571182000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-23T00:59:13.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.747+0000 7fe885e81700 1 Processor -- start 2023-06-23T00:59:13.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.747+0000 7fe885e81700 1 -- start start 2023-06-23T00:59:13.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.747+0000 7fe885e81700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe880156a60 0x7fe88006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.747+0000 7fe885e81700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe880156e30 0x7fe8800686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.747+0000 7fe885e81700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8800c7aa0 con 0x7fe88006d800 2023-06-23T00:59:13.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.747+0000 7fe885e81700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88006dd50 con 0x7fe880156e30 2023-06-23T00:59:13.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.747+0000 7fe885e81700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800c7190 con 0x7fe880156a60 2023-06-23T00:59:13.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.747+0000 7fe884e7f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe880156a60 0x7fe88006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe877fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe880156e30 0x7fe8800686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe884e7f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe880156a60 0x7fe88006d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:40870/0 (socket says 172.21.15.149:40870) 2023-06-23T00:59:13.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe884e7f700 1 -- 172.21.15.149:0/3360282715 learned_addr learned my addr 172.21.15.149:0/3360282715 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-23T00:59:13.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe877fff700 1 -- 172.21.15.149:0/3360282715 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe880156a60 msgr2=0x7fe88006d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:13.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe877fff700 1 --2- 172.21.15.149:0/3360282715 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe880156a60 0x7fe88006d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe877fff700 1 -- 172.21.15.149:0/3360282715 >> v1:172.21.15.97:6789/0 conn(0x7fe88006d800 legacy=0x7fe88015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe877fff700 1 -- 172.21.15.149:0/3360282715 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8800c7450 con 0x7fe880156e30 2023-06-23T00:59:13.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe877fff700 1 --2- 172.21.15.149:0/3360282715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe880156e30 0x7fe8800686a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe8700098e0 tx=0x7fe8700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e37721e2b6ca6e6e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:13.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe8777fe700 1 -- 172.21.15.149:0/3360282715 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000b640 con 0x7fe880156e30 2023-06-23T00:59:13.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe8777fe700 1 -- 172.21.15.149:0/3360282715 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87000b7a0 con 0x7fe880156e30 2023-06-23T00:59:13.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe8777fe700 1 -- 172.21.15.149:0/3360282715 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000bb40 con 0x7fe880156e30 2023-06-23T00:59:13.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe885e81700 1 -- 172.21.15.149:0/3360282715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe880156e30 msgr2=0x7fe8800686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe885e81700 1 --2- 172.21.15.149:0/3360282715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe880156e30 0x7fe8800686a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe8700098e0 tx=0x7fe8700091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe885e81700 1 -- 172.21.15.149:0/3360282715 shutdown_connections 2023-06-23T00:59:13.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe885e81700 1 --2- 172.21.15.149:0/3360282715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe880156e30 0x7fe8800686a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe885e81700 1 --2- 172.21.15.149:0/3360282715 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe880156a60 0x7fe88006d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe885e81700 1 -- 172.21.15.149:0/3360282715 >> 172.21.15.149:0/3360282715 conn(0x7fe88006ae80 msgr2=0x7fe88006b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:13.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe885e81700 1 -- 172.21.15.149:0/3360282715 shutdown_connections 2023-06-23T00:59:13.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe885e81700 1 -- 172.21.15.149:0/3360282715 wait complete. 2023-06-23T00:59:13.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe885e81700 1 Processor -- start 2023-06-23T00:59:13.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.751+0000 7fe885e81700 1 -- start start 2023-06-23T00:59:13.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885e81700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe88006d800 0x7fe8801572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885e81700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe880156a60 0x7fe8801577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885e81700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe880156e30 0x7fe880167050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885e81700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88014f7b0 con 0x7fe880156a60 2023-06-23T00:59:13.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885e81700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88015a570 con 0x7fe880156e30 2023-06-23T00:59:13.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885e81700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800affc0 con 0x7fe88006d800 2023-06-23T00:59:13.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885680700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe880156e30 0x7fe880167050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe884e7f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe88006d800 0x7fe8801572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885680700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe880156e30 0x7fe880167050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45146/0 (socket says 172.21.15.149:45146) 2023-06-23T00:59:13.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885680700 1 -- 172.21.15.149:0/850643722 learned_addr learned my addr 172.21.15.149:0/850643722 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-23T00:59:13.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe877fff700 1 --2- 172.21.15.149:0/850643722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe880156a60 0x7fe8801577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885680700 1 -- 172.21.15.149:0/850643722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe88006d800 msgr2=0x7fe8801572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885680700 1 --2- 172.21.15.149:0/850643722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe88006d800 0x7fe8801572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885680700 1 -- 172.21.15.149:0/850643722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe880156a60 msgr2=0x7fe8801577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885680700 1 --2- 172.21.15.149:0/850643722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe880156a60 0x7fe8801577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885680700 1 -- 172.21.15.149:0/850643722 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe870009420 con 0x7fe880156e30 2023-06-23T00:59:13.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885680700 1 --2- 172.21.15.149:0/850643722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe880156e30 0x7fe880167050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c810 tx=0x7fe878001650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:13.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe874ff9700 1 -- 172.21.15.149:0/850643722 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878012630 con 0x7fe880156e30 2023-06-23T00:59:13.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe874ff9700 1 -- 172.21.15.149:0/850643722 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8780127b0 con 0x7fe880156e30 2023-06-23T00:59:13.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe874ff9700 1 -- 172.21.15.149:0/850643722 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878012b70 con 0x7fe880156e30 2023-06-23T00:59:13.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885e81700 1 -- 172.21.15.149:0/850643722 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe880159a70 con 0x7fe880156e30 2023-06-23T00:59:13.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885e81700 1 -- 172.21.15.149:0/850643722 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe880159d80 con 0x7fe880156e30 2023-06-23T00:59:13.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe874ff9700 1 -- 172.21.15.149:0/850643722 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe878003030 con 0x7fe880156e30 2023-06-23T00:59:13.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe874ff9700 1 -- 172.21.15.149:0/850643722 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fe87801a3a0 con 0x7fe880156e30 2023-06-23T00:59:13.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.755+0000 7fe885e81700 1 -- 172.21.15.149:0/850643722 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88015a3b0 con 0x7fe880156e30 2023-06-23T00:59:13.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.759+0000 7fe874ff9700 1 -- 172.21.15.149:0/850643722 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fe87801b400 con 0x7fe880156e30 2023-06-23T00:59:13.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.835+0000 7fe885e81700 1 -- 172.21.15.149:0/850643722 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ffa4ef96-2528-45cb-b2c9-a6c671b234e5", "id": 6} v 0) v1 -- 0x7fe8800b0100 con 0x7fe880156e30 2023-06-23T00:59:13.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.847+0000 7fe874ff9700 1 -- 172.21.15.149:0/850643722 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ffa4ef96-2528-45cb-b2c9-a6c671b234e5", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe87801b9a0 con 0x7fe880156e30 2023-06-23T00:59:13.852 INFO:teuthology.orchestra.run.smithi149.stdout:6 2023-06-23T00:59:13.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.847+0000 7fe885e81700 1 -- 172.21.15.149:0/850643722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe880156e30 msgr2=0x7fe880167050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.847+0000 7fe885e81700 1 --2- 172.21.15.149:0/850643722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe880156e30 0x7fe880167050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c810 tx=0x7fe878001650 comp rx=0 tx=0).stop 2023-06-23T00:59:13.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.847+0000 7fe885e81700 1 -- 172.21.15.149:0/850643722 shutdown_connections 2023-06-23T00:59:13.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.847+0000 7fe885e81700 1 --2- 172.21.15.149:0/850643722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe880156e30 0x7fe880167050 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.847+0000 7fe885e81700 1 --2- 172.21.15.149:0/850643722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe880156a60 0x7fe8801577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.847+0000 7fe885e81700 1 --2- 172.21.15.149:0/850643722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe88006d800 0x7fe8801572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.847+0000 7fe885e81700 1 -- 172.21.15.149:0/850643722 >> 172.21.15.149:0/850643722 conn(0x7fe88006ae80 msgr2=0x7fe8800aba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:13.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.847+0000 7fe885e81700 1 -- 172.21.15.149:0/850643722 shutdown_connections 2023-06-23T00:59:13.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.847+0000 7fe885e81700 1 -- 172.21.15.149:0/850643722 wait complete. 2023-06-23T00:59:13.865 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new de849aa4-8494-4aeb-b1b6-6dd30458923c 7 2023-06-23T00:59:13.967 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:13.963+0000 7f790d59e000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-23T00:59:13.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.963+0000 7fc6550ef700 1 Processor -- start 2023-06-23T00:59:13.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.963+0000 7fc6550ef700 1 -- start start 2023-06-23T00:59:13.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.963+0000 7fc6550ef700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc650158a40 0x7fc65006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.963+0000 7fc6550ef700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c81c0 0x7fc650067aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.963+0000 7fc6550ef700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc650067610 con 0x7fc6500c7ac0 2023-06-23T00:59:13.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.963+0000 7fc6550ef700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6500c8930 con 0x7fc650158a40 2023-06-23T00:59:13.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.963+0000 7fc6550ef700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc650067000 con 0x7fc6500c81c0 2023-06-23T00:59:13.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.963+0000 7fc64ed9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc650158a40 0x7fc65006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.963+0000 7fc64e59c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c81c0 0x7fc650067aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.963+0000 7fc64ed9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc650158a40 0x7fc65006c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45150/0 (socket says 172.21.15.149:45150) 2023-06-23T00:59:13.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.963+0000 7fc64e59c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c81c0 0x7fc650067aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:40880/0 (socket says 172.21.15.149:40880) 2023-06-23T00:59:13.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.963+0000 7fc64ed9d700 1 -- 172.21.15.149:0/4178445248 learned_addr learned my addr 172.21.15.149:0/4178445248 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-23T00:59:13.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc64ed9d700 1 -- 172.21.15.149:0/4178445248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c81c0 msgr2=0x7fc650067aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:13.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc64ed9d700 1 --2- 172.21.15.149:0/4178445248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c81c0 0x7fc650067aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc64ed9d700 1 -- 172.21.15.149:0/4178445248 >> v1:172.21.15.149:6789/0 conn(0x7fc6500c7ac0 legacy=0x7fc65015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc64ed9d700 1 -- 172.21.15.149:0/4178445248 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6500c8650 con 0x7fc650158a40 2023-06-23T00:59:13.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc64e59c700 1 --2- 172.21.15.149:0/4178445248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c81c0 0x7fc650067aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:13.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc64ed9d700 1 --2- 172.21.15.149:0/4178445248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc650158a40 0x7fc65006c1d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc6400099b0 tx=0x7fc640009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2077cc1fb015c435 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:13.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc64dd9b700 1 -- 172.21.15.149:0/4178445248 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640009ea0 con 0x7fc650158a40 2023-06-23T00:59:13.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc64dd9b700 1 -- 172.21.15.149:0/4178445248 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64000b860 con 0x7fc650158a40 2023-06-23T00:59:13.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc64dd9b700 1 -- 172.21.15.149:0/4178445248 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64000bc00 con 0x7fc650158a40 2023-06-23T00:59:13.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc6550ef700 1 -- 172.21.15.149:0/4178445248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc650158a40 msgr2=0x7fc65006c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc6550ef700 1 --2- 172.21.15.149:0/4178445248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc650158a40 0x7fc65006c1d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc6400099b0 tx=0x7fc640009250 comp rx=0 tx=0).stop 2023-06-23T00:59:13.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc6550ef700 1 -- 172.21.15.149:0/4178445248 shutdown_connections 2023-06-23T00:59:13.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc6550ef700 1 --2- 172.21.15.149:0/4178445248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c81c0 0x7fc650067aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc6550ef700 1 --2- 172.21.15.149:0/4178445248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc650158a40 0x7fc65006c1d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc6550ef700 1 -- 172.21.15.149:0/4178445248 >> 172.21.15.149:0/4178445248 conn(0x7fc6500c8b20 msgr2=0x7fc6500c8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:13.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc6550ef700 1 -- 172.21.15.149:0/4178445248 shutdown_connections 2023-06-23T00:59:13.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc6550ef700 1 -- 172.21.15.149:0/4178445248 wait complete. 2023-06-23T00:59:13.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.967+0000 7fc6550ef700 1 Processor -- start 2023-06-23T00:59:13.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc6550ef700 1 -- start start 2023-06-23T00:59:13.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc6550ef700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c7ac0 0x7fc650143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc6550ef700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6500c81c0 0x7fc6500c3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc6550ef700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc650158a40 0x7fc6500c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:13.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc6550ef700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65015ab60 con 0x7fc6500c81c0 2023-06-23T00:59:13.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc6550ef700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc650159f50 con 0x7fc650158a40 2023-06-23T00:59:13.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc6550ef700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65015a230 con 0x7fc6500c7ac0 2023-06-23T00:59:13.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc64ed9d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c7ac0 0x7fc650143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc64f59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc650158a40 0x7fc6500c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc64ed9d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c7ac0 0x7fc650143cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:40894/0 (socket says 172.21.15.149:40894) 2023-06-23T00:59:13.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc64ed9d700 1 -- 172.21.15.149:0/1813556264 learned_addr learned my addr 172.21.15.149:0/1813556264 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-23T00:59:13.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc64e59c700 1 --2- 172.21.15.149:0/1813556264 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6500c81c0 0x7fc6500c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:13.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc64f59e700 1 -- 172.21.15.149:0/1813556264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c7ac0 msgr2=0x7fc650143cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc64f59e700 1 --2- 172.21.15.149:0/1813556264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c7ac0 0x7fc650143cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc64f59e700 1 -- 172.21.15.149:0/1813556264 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6500c81c0 msgr2=0x7fc6500c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:13.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc64f59e700 1 --2- 172.21.15.149:0/1813556264 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6500c81c0 0x7fc6500c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:13.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc64f59e700 1 -- 172.21.15.149:0/1813556264 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc644009420 con 0x7fc650158a40 2023-06-23T00:59:13.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc64ed9d700 1 --2- 172.21.15.149:0/1813556264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c7ac0 0x7fc650143cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:13.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc64e59c700 1 --2- 172.21.15.149:0/1813556264 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6500c81c0 0x7fc6500c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:13.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc64f59e700 1 --2- 172.21.15.149:0/1813556264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc650158a40 0x7fc6500c58b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc65006ba90 tx=0x7fc648001690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:13.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc636ffd700 1 -- 172.21.15.149:0/1813556264 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648012630 con 0x7fc650158a40 2023-06-23T00:59:13.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc636ffd700 1 -- 172.21.15.149:0/1813556264 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc648012790 con 0x7fc650158a40 2023-06-23T00:59:13.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc6550ef700 1 -- 172.21.15.149:0/1813556264 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6400094f0 con 0x7fc650158a40 2023-06-23T00:59:13.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc636ffd700 1 -- 172.21.15.149:0/1813556264 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648012b50 con 0x7fc650158a40 2023-06-23T00:59:13.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc6550ef700 1 -- 172.21.15.149:0/1813556264 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65015a7f0 con 0x7fc650158a40 2023-06-23T00:59:13.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc636ffd700 1 -- 172.21.15.149:0/1813556264 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc64801b400 con 0x7fc650158a40 2023-06-23T00:59:13.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.971+0000 7fc636ffd700 1 -- 172.21.15.149:0/1813556264 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fc6480119f0 con 0x7fc650158a40 2023-06-23T00:59:13.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.975+0000 7fc6550ef700 1 -- 172.21.15.149:0/1813556264 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65004bc30 con 0x7fc650158a40 2023-06-23T00:59:13.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:13.975+0000 7fc636ffd700 1 -- 172.21.15.149:0/1813556264 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fc648011d10 con 0x7fc650158a40 2023-06-23T00:59:14.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:14.051+0000 7fc6550ef700 1 -- 172.21.15.149:0/1813556264 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "de849aa4-8494-4aeb-b1b6-6dd30458923c", "id": 7} v 0) v1 -- 0x7fc6500672a0 con 0x7fc650158a40 2023-06-23T00:59:14.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:14.063+0000 7fc636ffd700 1 -- 172.21.15.149:0/1813556264 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "de849aa4-8494-4aeb-b1b6-6dd30458923c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc64801b7f0 con 0x7fc650158a40 2023-06-23T00:59:14.067 INFO:teuthology.orchestra.run.smithi149.stdout:7 2023-06-23T00:59:14.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:14.063+0000 7fc6550ef700 1 -- 172.21.15.149:0/1813556264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc650158a40 msgr2=0x7fc6500c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:14.063+0000 7fc6550ef700 1 --2- 172.21.15.149:0/1813556264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc650158a40 0x7fc6500c58b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc65006ba90 tx=0x7fc648001690 comp rx=0 tx=0).stop 2023-06-23T00:59:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:14.063+0000 7fc6550ef700 1 -- 172.21.15.149:0/1813556264 shutdown_connections 2023-06-23T00:59:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:14.063+0000 7fc6550ef700 1 --2- 172.21.15.149:0/1813556264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc650158a40 0x7fc6500c58b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:14.063+0000 7fc6550ef700 1 --2- 172.21.15.149:0/1813556264 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6500c81c0 0x7fc6500c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:14.063+0000 7fc6550ef700 1 --2- 172.21.15.149:0/1813556264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6500c7ac0 0x7fc650143cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:14.063+0000 7fc6550ef700 1 -- 172.21.15.149:0/1813556264 >> 172.21.15.149:0/1813556264 conn(0x7fc6500c8b20 msgr2=0x7fc6500b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:14.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:14.063+0000 7fc6550ef700 1 -- 172.21.15.149:0/1813556264 shutdown_connections 2023-06-23T00:59:14.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-23T00:59:14.063+0000 7fc6550ef700 1 -- 172.21.15.149:0/1813556264 wait complete. 2023-06-23T00:59:14.079 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-23T00:59:14.079 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-23T00:59:14.081 INFO:tasks.ceph.osd.0:Started 2023-06-23T00:59:14.082 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-23T00:59:14.082 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-23T00:59:14.084 INFO:tasks.ceph.osd.1:Started 2023-06-23T00:59:14.085 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-23T00:59:14.085 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-23T00:59:14.086 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:14.083+0000 7f790d59e000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-23T00:59:14.087 INFO:tasks.ceph.osd.2:Started 2023-06-23T00:59:14.087 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-23T00:59:14.088 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-23T00:59:14.089 INFO:tasks.ceph.osd.3:Started 2023-06-23T00:59:14.090 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-23T00:59:14.090 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-23T00:59:14.092 INFO:tasks.ceph.osd.4:Started 2023-06-23T00:59:14.093 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-23T00:59:14.093 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-23T00:59:14.096 INFO:tasks.ceph.osd.5:Started 2023-06-23T00:59:14.096 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-23T00:59:14.097 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-23T00:59:14.098 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:14.088+0000 7f5571182000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-23T00:59:14.099 INFO:tasks.ceph.osd.6:Started 2023-06-23T00:59:14.099 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-23T00:59:14.100 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-23T00:59:14.102 INFO:tasks.ceph.osd.7:Started 2023-06-23T00:59:14.102 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T00:59:14.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c14e21700 1 Processor -- start 2023-06-23T00:59:14.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c14e21700 1 -- start start 2023-06-23T00:59:14.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c14e21700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014c920 0x7f7c100c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:14.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c14e21700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c100ae870 con 0x7f7c10159a50 2023-06-23T00:59:14.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c14e21700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c100ae2b0 con 0x7f7c1014c550 2023-06-23T00:59:14.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c14e21700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100c87a0 con 0x7f7c1014c920 2023-06-23T00:59:14.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0effd700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7c10159a50 0x7f7c1006aa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:37276/0 (socket says 172.21.15.97:37276) 2023-06-23T00:59:14.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0effd700 1 -- 172.21.15.97:0/2107409809 learned_addr learned my addr 172.21.15.97:0/2107409809 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:14.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0ffff700 1 --2- 172.21.15.97:0/2107409809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014c920 0x7f7c100c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:14.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464488850 0 0) 0x7f7c04001110 con 0x7f7c10159a50 2023-06-23T00:59:14.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf8003570 con 0x7f7c10159a50 2023-06-23T00:59:14.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194895305 0 0) 0x7f7c100ae2b0 con 0x7f7c1014c550 2023-06-23T00:59:14.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c04001110 con 0x7f7c1014c550 2023-06-23T00:59:14.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 465839491 0 0) 0x7f7bf8003570 con 0x7f7c10159a50 2023-06-23T00:59:14.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014c920 msgr2=0x7f7c100c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:14.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0e7fc700 1 --2- 172.21.15.97:0/2107409809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014c920 0x7f7c100c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:14.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 >> v1:172.21.15.149:6789/0 conn(0x7f7c1014c550 legacy=0x7f7c10159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:14.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100ae590 con 0x7f7c10159a50 2023-06-23T00:59:14.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1366942832 0 0) 0x7f7c04001600 con 0x7f7c10159a50 2023-06-23T00:59:14.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 >> v1:172.21.15.97:6789/0 conn(0x7f7c10159a50 legacy=0x7f7c1006aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:14.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.192+0000 7f7c0e7fc700 1 --2- 172.21.15.97:0/2107409809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014c920 0x7f7bf8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:14.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0e7fc700 1 --2- 172.21.15.97:0/2107409809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bf8004180 0x7f7bf8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:14.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0e7fc700 1 --2- 172.21.15.97:0/2107409809 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bf8004d50 0x7f7bf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:14.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100c87a0 con 0x7f7bf8004d50 2023-06-23T00:59:14.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf800ddb0 con 0x7f7bf8004180 2023-06-23T00:59:14.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf800df70 con 0x7f7c1014c920 2023-06-23T00:59:14.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0f7fe700 1 --2- 172.21.15.97:0/2107409809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014c920 0x7f7bf8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:14.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0effd700 1 --2- 172.21.15.97:0/2107409809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bf8004180 0x7f7bf8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:14.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0ffff700 1 --2- 172.21.15.97:0/2107409809 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bf8004d50 0x7f7bf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:14.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0f7fe700 1 -- 172.21.15.97:0/2107409809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bf8004180 msgr2=0x7f7bf8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:14.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0f7fe700 1 --2- 172.21.15.97:0/2107409809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bf8004180 0x7f7bf8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:14.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0f7fe700 1 -- 172.21.15.97:0/2107409809 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bf8004d50 msgr2=0x7f7bf80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:14.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0f7fe700 1 --2- 172.21.15.97:0/2107409809 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bf8004d50 0x7f7bf80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:14.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0f7fe700 1 -- 172.21.15.97:0/2107409809 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8003570 con 0x7f7c1014c920 2023-06-23T00:59:14.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0f7fe700 1 --2- 172.21.15.97:0/2107409809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014c920 0x7f7bf8003c20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7c08002120 tx=0x7f7c080017a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25835a550f324559 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:14.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08001ab0 con 0x7f7c1014c920 2023-06-23T00:59:14.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800c980 con 0x7f7c1014c920 2023-06-23T00:59:14.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0e7fc700 1 -- 172.21.15.97:0/2107409809 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800cd20 con 0x7f7c1014c920 2023-06-23T00:59:14.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c14e21700 1 -- 172.21.15.97:0/2107409809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014c920 msgr2=0x7f7bf8003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:14.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c14e21700 1 --2- 172.21.15.97:0/2107409809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014c920 0x7f7bf8003c20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7c08002120 tx=0x7f7c080017a0 comp rx=0 tx=0).stop 2023-06-23T00:59:14.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c0ffff700 1 -- 172.21.15.97:0/2107409809 reap_dead start 2023-06-23T00:59:14.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c14e21700 1 -- 172.21.15.97:0/2107409809 shutdown_connections 2023-06-23T00:59:14.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c14e21700 1 -- 172.21.15.97:0/2107409809 >> 172.21.15.97:0/2107409809 conn(0x7f7c100cc9b0 msgr2=0x7f7c100c8910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:14.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c14e21700 1 -- 172.21.15.97:0/2107409809 shutdown_connections 2023-06-23T00:59:14.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c14e21700 1 -- 172.21.15.97:0/2107409809 wait complete. 2023-06-23T00:59:14.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c14e21700 1 Processor -- start 2023-06-23T00:59:14.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.196+0000 7f7c14e21700 1 -- start start 2023-06-23T00:59:14.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c14e21700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c1014c920 0x7f7c10158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:14.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c14e21700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c10158590 0x7f7c1014e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:14.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c14e21700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014eb50 0x7f7c1013e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:14.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c14e21700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10168d20 con 0x7f7c1014c920 2023-06-23T00:59:14.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c14e21700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10168150 con 0x7f7c10158590 2023-06-23T00:59:14.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c14e21700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c101683f0 con 0x7f7c1014eb50 2023-06-23T00:59:14.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c0f7fe700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c1014c920 0x7f7c10158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:14.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c0f7fe700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c1014c920 0x7f7c10158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57108/0 (socket says 172.21.15.97:57108) 2023-06-23T00:59:14.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c0f7fe700 1 -- 172.21.15.97:0/658990864 learned_addr learned my addr 172.21.15.97:0/658990864 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:14.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c0ffff700 1 --2- 172.21.15.97:0/658990864 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014eb50 0x7f7c1013e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:14.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c0effd700 1 --2- 172.21.15.97:0/658990864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c10158590 0x7f7c1014e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:14.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c0f7fe700 1 -- 172.21.15.97:0/658990864 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014eb50 msgr2=0x7f7c1013e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:14.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c0f7fe700 1 --2- 172.21.15.97:0/658990864 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014eb50 0x7f7c1013e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:14.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c0f7fe700 1 -- 172.21.15.97:0/658990864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c10158590 msgr2=0x7f7c1014e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:14.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c0f7fe700 1 --2- 172.21.15.97:0/658990864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c10158590 0x7f7c1014e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:14.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c0f7fe700 1 -- 172.21.15.97:0/658990864 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c101686d0 con 0x7f7c1014c920 2023-06-23T00:59:14.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c0f7fe700 1 --2- 172.21.15.97:0/658990864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c1014c920 0x7f7c10158050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800c6a0 tx=0x7f7c08016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:14.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7bf77fe700 1 -- 172.21.15.97:0/658990864 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800c6d0 con 0x7f7c1014c920 2023-06-23T00:59:14.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7bf77fe700 1 -- 172.21.15.97:0/658990864 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08023070 con 0x7f7c1014c920 2023-06-23T00:59:14.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7bf77fe700 1 -- 172.21.15.97:0/658990864 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08012e30 con 0x7f7c1014c920 2023-06-23T00:59:14.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c14e21700 1 -- 172.21.15.97:0/658990864 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c101689b0 con 0x7f7c1014c920 2023-06-23T00:59:14.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c14e21700 1 -- 172.21.15.97:0/658990864 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c100c3780 con 0x7f7c1014c920 2023-06-23T00:59:14.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7bf77fe700 1 -- 172.21.15.97:0/658990864 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7c08003030 con 0x7f7c1014c920 2023-06-23T00:59:14.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7bf77fe700 1 -- 172.21.15.97:0/658990864 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f7c08006db0 con 0x7f7c1014c920 2023-06-23T00:59:14.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.200+0000 7f7c14e21700 1 -- 172.21.15.97:0/658990864 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1006f8b0 con 0x7f7c1014c920 2023-06-23T00:59:14.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.204+0000 7f7bf77fe700 1 -- 172.21.15.97:0/658990864 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f7c1006f8b0 con 0x7f7c1014c920 2023-06-23T00:59:14.241 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:14.236+0000 7f5571182000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-23T00:59:14.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.272+0000 7f7c14e21700 1 -- 172.21.15.97:0/658990864 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c100c3970 con 0x7f7c1014c920 2023-06-23T00:59:14.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.272+0000 7f7bf77fe700 1 -- 172.21.15.97:0/658990864 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f7c0802d060 con 0x7f7c1014c920 2023-06-23T00:59:14.278 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:59:14.278 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":10,"fsid":"6b52ccf4-99f4-48c9-9a8a-9a183942c228","created":"2023-06-23T00:59:11.989322+0000","modified":"2023-06-23T00:59:14.057374+0000","last_up_change":"0.000000","last_in_change":"2023-06-23T00:59:14.057374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"291bc189-d5fb-482f-92d6-f7ecfb0a388c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"693551b5-827b-4530-80b1-a836095efbf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a100d026-e382-4e71-bda5-ffa59f6b596b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"91783241-7821-458e-996f-a740274b18ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"67c375d3-ec8f-4d1a-bea7-e47896705fb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9de42b7c-cf51-4adf-9cc1-11c8d9863574","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ffa4ef96-2528-45cb-b2c9-a6c671b234e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"de849aa4-8494-4aeb-b1b6-6dd30458923c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T00:59:14.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.272+0000 7f7c14e21700 1 -- 172.21.15.97:0/658990864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c1014c920 msgr2=0x7f7c10158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:14.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.272+0000 7f7c14e21700 1 --2- 172.21.15.97:0/658990864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c1014c920 0x7f7c10158050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800c6a0 tx=0x7f7c08016000 comp rx=0 tx=0).stop 2023-06-23T00:59:14.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.272+0000 7f7c14e21700 1 -- 172.21.15.97:0/658990864 shutdown_connections 2023-06-23T00:59:14.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.272+0000 7f7c14e21700 1 --2- 172.21.15.97:0/658990864 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c1014eb50 0x7f7c1013e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:14.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.272+0000 7f7c14e21700 1 --2- 172.21.15.97:0/658990864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c10158590 0x7f7c1014e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:14.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.272+0000 7f7c14e21700 1 --2- 172.21.15.97:0/658990864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c1014c920 0x7f7c10158050 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:14.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.272+0000 7f7c14e21700 1 -- 172.21.15.97:0/658990864 >> 172.21.15.97:0/658990864 conn(0x7f7c100cc9b0 msgr2=0x7f7c10155bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:14.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.272+0000 7f7c14e21700 1 -- 172.21.15.97:0/658990864 shutdown_connections 2023-06-23T00:59:14.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:14.272+0000 7f7c14e21700 1 -- 172.21.15.97:0/658990864 wait complete. 2023-06-23T00:59:14.290 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-23T00:59:14.291 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-23T00:59:14.420 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:14.415+0000 7f790d59e000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-23T00:59:14.446 INFO:tasks.ceph.osd.0.smithi097.stderr:2023-06-23T00:59:14.440+0000 7f3c35f543c0 -1 Falling back to public interface 2023-06-23T00:59:14.461 INFO:tasks.ceph.osd.3.smithi097.stderr:2023-06-23T00:59:14.456+0000 7f9cd0ba13c0 -1 Falling back to public interface 2023-06-23T00:59:14.470 INFO:tasks.ceph.osd.1.smithi097.stderr:2023-06-23T00:59:14.464+0000 7f69cb4513c0 -1 Falling back to public interface 2023-06-23T00:59:14.477 INFO:tasks.ceph.osd.2.smithi097.stderr:2023-06-23T00:59:14.472+0000 7fadff6183c0 -1 Falling back to public interface 2023-06-23T00:59:14.563 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:14.556+0000 7f5571182000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-23T00:59:14.584 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:14.579+0000 7f790d59e000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-23T00:59:14.648 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:14.643+0000 7f790d59e000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-23T00:59:14.699 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:14.695+0000 7f790d59e000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-23T00:59:14.707 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-06-23T00:59:14.703+0000 7f06651db3c0 -1 Falling back to public interface 2023-06-23T00:59:14.708 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-06-23T00:59:14.703+0000 7f75183453c0 -1 Falling back to public interface 2023-06-23T00:59:14.720 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-06-23T00:59:14.715+0000 7fd61043f3c0 -1 Falling back to public interface 2023-06-23T00:59:14.726 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:14.720+0000 7f5571182000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-23T00:59:14.731 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-06-23T00:59:14.727+0000 7faab09f13c0 -1 Falling back to public interface 2023-06-23T00:59:14.761 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:14.755+0000 7f790d59e000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-23T00:59:14.792 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:14.784+0000 7f5571182000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-23T00:59:14.843 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:14.836+0000 7f5571182000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-23T00:59:14.901 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:14.896+0000 7f5571182000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-23T00:59:15.069 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:15.063+0000 7f790d59e000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-23T00:59:15.096 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-23T00:59:15.133 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:15.127+0000 7f790d59e000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-23T00:59:15.178 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:15.172+0000 7f5571182000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-23T00:59:15.190 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.184+0000 7f694cb62700 1 Processor -- start 2023-06-23T00:59:15.191 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.184+0000 7f694cb62700 1 -- start start 2023-06-23T00:59:15.191 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.184+0000 7f694cb62700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6948067ee0 0x7f694806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:15.192 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.184+0000 7f694cb62700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694806a0f0 con 0x7f69481568d0 2023-06-23T00:59:15.192 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.184+0000 7f694cb62700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69480c97f0 con 0x7f69480ab5d0 2023-06-23T00:59:15.192 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.184+0000 7f694cb62700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69480af4d0 con 0x7f6948067ee0 2023-06-23T00:59:15.192 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.184+0000 7f6947fff700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6948067ee0 0x7f694806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:15.192 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.184+0000 7f69477fe700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f69481568d0 0x7f69480aedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:37278/0 (socket says 172.21.15.97:37278) 2023-06-23T00:59:15.192 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.184+0000 7f69477fe700 1 -- 172.21.15.97:0/3129407964 learned_addr learned my addr 172.21.15.97:0/3129407964 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:15.193 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.184+0000 7f6947fff700 1 --2- 172.21.15.97:0/3129407964 >> v2:172.21.15.97:3300/0 conn(0x7f6948067ee0 0x7f694806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57112/0 (socket says 172.21.15.97:57112) 2023-06-23T00:59:15.194 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f6947fff700 1 -- 172.21.15.97:0/3129407964 >> v1:172.21.15.149:6789/0 conn(0x7f69480ab5d0 legacy=0x7f69480add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:15.194 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f6947fff700 1 -- 172.21.15.97:0/3129407964 >> v1:172.21.15.97:6789/0 conn(0x7f69481568d0 legacy=0x7f69480aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:15.194 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f69467fc700 1 -- 172.21.15.97:0/3129407964 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570645331 0 0) 0x7f694806a0f0 con 0x7f69481568d0 2023-06-23T00:59:15.194 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f6947fff700 1 -- 172.21.15.97:0/3129407964 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69480697c0 con 0x7f6948067ee0 2023-06-23T00:59:15.194 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f6947fff700 1 --2- 172.21.15.97:0/3129407964 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6948067ee0 0x7f694806a580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6940009e60 tx=0x7f6940009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12f8ad40bcc66d0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:15.194 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f69467fc700 1 -- 172.21.15.97:0/3129407964 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000e070 con 0x7f6948067ee0 2023-06-23T00:59:15.194 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f69467fc700 1 -- 172.21.15.97:0/3129407964 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694000bc30 con 0x7f6948067ee0 2023-06-23T00:59:15.195 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f69467fc700 1 -- 172.21.15.97:0/3129407964 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940012430 con 0x7f6948067ee0 2023-06-23T00:59:15.195 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f694cb62700 1 -- 172.21.15.97:0/3129407964 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6948067ee0 msgr2=0x7f694806a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:15.195 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f694cb62700 1 --2- 172.21.15.97:0/3129407964 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6948067ee0 0x7f694806a580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6940009e60 tx=0x7f6940009780 comp rx=0 tx=0).stop 2023-06-23T00:59:15.195 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f694cb62700 1 -- 172.21.15.97:0/3129407964 shutdown_connections 2023-06-23T00:59:15.195 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f694cb62700 1 --2- 172.21.15.97:0/3129407964 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6948067ee0 0x7f694806a580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:15.195 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f694cb62700 1 -- 172.21.15.97:0/3129407964 >> 172.21.15.97:0/3129407964 conn(0x7f69480c89c0 msgr2=0x7f69480c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:15.195 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f694cb62700 1 -- 172.21.15.97:0/3129407964 shutdown_connections 2023-06-23T00:59:15.196 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f694cb62700 1 -- 172.21.15.97:0/3129407964 wait complete. 2023-06-23T00:59:15.197 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f694cb62700 1 Processor -- start 2023-06-23T00:59:15.197 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.188+0000 7f694cb62700 1 -- start start 2023-06-23T00:59:15.197 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f694cb62700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6948067ee0 0x7f6948156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:15.198 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f694cb62700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69480ab5d0 0x7f694815b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:15.198 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f694cb62700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69481568d0 0x7f6948151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:15.198 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f694cb62700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69480c0e70 con 0x7f69480ab5d0 2023-06-23T00:59:15.198 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f694cb62700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69480c1000 con 0x7f69481568d0 2023-06-23T00:59:15.198 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f694cb62700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694815bcd0 con 0x7f6948067ee0 2023-06-23T00:59:15.198 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f6946ffd700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69480ab5d0 0x7f694815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:15.198 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f6946ffd700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69480ab5d0 0x7f694815b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57114/0 (socket says 172.21.15.97:57114) 2023-06-23T00:59:15.199 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f6946ffd700 1 -- 172.21.15.97:0/1398241598 learned_addr learned my addr 172.21.15.97:0/1398241598 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:15.199 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f6947fff700 1 --2- 172.21.15.97:0/1398241598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69481568d0 0x7f6948151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:15.199 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f69477fe700 1 --2- 172.21.15.97:0/1398241598 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6948067ee0 0x7f6948156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:15.199 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f6946ffd700 1 -- 172.21.15.97:0/1398241598 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6948067ee0 msgr2=0x7f6948156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:15.199 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f6946ffd700 1 --2- 172.21.15.97:0/1398241598 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6948067ee0 0x7f6948156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:15.199 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f6946ffd700 1 -- 172.21.15.97:0/1398241598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69481568d0 msgr2=0x7f6948151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:15.199 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f6946ffd700 1 --2- 172.21.15.97:0/1398241598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69481568d0 0x7f6948151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:15.199 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f6946ffd700 1 -- 172.21.15.97:0/1398241598 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6940009a20 con 0x7f69480ab5d0 2023-06-23T00:59:15.200 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f6946ffd700 1 --2- 172.21.15.97:0/1398241598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69480ab5d0 0x7f694815b790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f693c00c7f0 tx=0x7f693c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:15.200 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f692f7fe700 1 -- 172.21.15.97:0/1398241598 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c011590 con 0x7f69480ab5d0 2023-06-23T00:59:15.200 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f692f7fe700 1 -- 172.21.15.97:0/1398241598 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693c011710 con 0x7f69480ab5d0 2023-06-23T00:59:15.200 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f694cb62700 1 -- 172.21.15.97:0/1398241598 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948157330 con 0x7f69480ab5d0 2023-06-23T00:59:15.200 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f692f7fe700 1 -- 172.21.15.97:0/1398241598 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c011ad0 con 0x7f69480ab5d0 2023-06-23T00:59:15.200 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f694cb62700 1 -- 172.21.15.97:0/1398241598 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6948157970 con 0x7f69480ab5d0 2023-06-23T00:59:15.201 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f692f7fe700 1 -- 172.21.15.97:0/1398241598 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f693c01c6c0 con 0x7f69480ab5d0 2023-06-23T00:59:15.201 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f692f7fe700 1 -- 172.21.15.97:0/1398241598 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f693c012b00 con 0x7f69480ab5d0 2023-06-23T00:59:15.201 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.192+0000 7f694cb62700 1 -- 172.21.15.97:0/1398241598 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69480c1190 con 0x7f69480ab5d0 2023-06-23T00:59:15.202 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.196+0000 7f692f7fe700 1 -- 172.21.15.97:0/1398241598 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f693c017070 con 0x7f69480ab5d0 2023-06-23T00:59:15.202 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:15.199+0000 7f790d59e000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-23T00:59:15.236 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:15.232+0000 7f5571182000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-23T00:59:15.270 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.260+0000 7f694cb62700 1 -- 172.21.15.97:0/1398241598 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6948064310 con 0x7f69480ab5d0 2023-06-23T00:59:15.270 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.264+0000 7f692f7fe700 1 -- 172.21.15.97:0/1398241598 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f693c01cba0 con 0x7f69480ab5d0 2023-06-23T00:59:15.271 INFO:teuthology.misc.health.smithi097.stdout: 2023-06-23T00:59:15.271 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":10,"fsid":"6b52ccf4-99f4-48c9-9a8a-9a183942c228","created":"2023-06-23T00:59:11.989322+0000","modified":"2023-06-23T00:59:14.057374+0000","last_up_change":"0.000000","last_in_change":"2023-06-23T00:59:14.057374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"291bc189-d5fb-482f-92d6-f7ecfb0a388c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"693551b5-827b-4530-80b1-a836095efbf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a100d026-e382-4e71-bda5-ffa59f6b596b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"91783241-7821-458e-996f-a740274b18ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"67c375d3-ec8f-4d1a-bea7-e47896705fb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9de42b7c-cf51-4adf-9cc1-11c8d9863574","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ffa4ef96-2528-45cb-b2c9-a6c671b234e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"de849aa4-8494-4aeb-b1b6-6dd30458923c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T00:59:15.272 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.264+0000 7f694cb62700 1 -- 172.21.15.97:0/1398241598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69480ab5d0 msgr2=0x7f694815b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:15.273 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.264+0000 7f694cb62700 1 --2- 172.21.15.97:0/1398241598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69480ab5d0 0x7f694815b790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f693c00c7f0 tx=0x7f693c007f50 comp rx=0 tx=0).stop 2023-06-23T00:59:15.273 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.264+0000 7f694cb62700 1 -- 172.21.15.97:0/1398241598 shutdown_connections 2023-06-23T00:59:15.273 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.264+0000 7f694cb62700 1 --2- 172.21.15.97:0/1398241598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69481568d0 0x7f6948151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:15.273 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.264+0000 7f694cb62700 1 --2- 172.21.15.97:0/1398241598 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69480ab5d0 0x7f694815b790 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:15.274 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.264+0000 7f694cb62700 1 --2- 172.21.15.97:0/1398241598 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6948067ee0 0x7f6948156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:15.274 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.264+0000 7f694cb62700 1 -- 172.21.15.97:0/1398241598 >> 172.21.15.97:0/1398241598 conn(0x7f69480c89c0 msgr2=0x7f694806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:15.274 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.264+0000 7f694cb62700 1 -- 172.21.15.97:0/1398241598 shutdown_connections 2023-06-23T00:59:15.274 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:15.264+0000 7f694cb62700 1 -- 172.21.15.97:0/1398241598 wait complete. 2023-06-23T00:59:15.280 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-23T00:59:15.302 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:15.296+0000 7f5571182000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-23T00:59:15.375 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:15.371+0000 7f790d59e000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-23T00:59:15.446 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:15.439+0000 7f790d59e000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-23T00:59:15.459 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:15.452+0000 7f5571182000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-23T00:59:15.525 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:15.520+0000 7f5571182000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-23T00:59:16.177 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:16.171+0000 7f790d59e000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-23T00:59:16.229 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-06-23T00:59:16.224+0000 7f5571182000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-23T00:59:17.225 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:17.219+0000 7f78f6695700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-23T00:59:17.227 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-06-23T00:59:17.223+0000 7f78f6695700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-23T00:59:18.045 INFO:tasks.ceph.osd.0.smithi097.stderr:2023-06-23T00:59:18.040+0000 7f3c35f543c0 -1 osd.0 0 log_to_monitors true 2023-06-23T00:59:18.270 INFO:tasks.ceph.osd.3.smithi097.stderr:2023-06-23T00:59:18.264+0000 7f9cd0ba13c0 -1 osd.3 0 log_to_monitors true 2023-06-23T00:59:18.288 INFO:tasks.ceph.osd.1.smithi097.stderr:2023-06-23T00:59:18.284+0000 7f69cb4513c0 -1 osd.1 0 log_to_monitors true 2023-06-23T00:59:18.334 INFO:tasks.ceph.osd.2.smithi097.stderr:2023-06-23T00:59:18.328+0000 7fadff6183c0 -1 osd.2 0 log_to_monitors true 2023-06-23T00:59:18.481 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-06-23T00:59:18.475+0000 7f06651db3c0 -1 osd.4 0 log_to_monitors true 2023-06-23T00:59:18.522 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-06-23T00:59:18.515+0000 7f75183453c0 -1 osd.5 0 log_to_monitors true 2023-06-23T00:59:18.536 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-06-23T00:59:18.531+0000 7fd61043f3c0 -1 osd.7 0 log_to_monitors true 2023-06-23T00:59:18.561 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-06-23T00:59:18.555+0000 7faab09f13c0 -1 osd.6 0 log_to_monitors true 2023-06-23T00:59:20.446 INFO:tasks.ceph.osd.0.smithi097.stderr:2023-06-23T00:59:20.440+0000 7f3c316f4700 -1 osd.0 0 waiting for initial osdmap 2023-06-23T00:59:20.453 INFO:tasks.ceph.osd.0.smithi097.stderr:2023-06-23T00:59:20.448+0000 7f3c2a498700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T00:59:22.088 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-23T00:59:22.089 INFO:tasks.ceph.osd.3.smithi097.stderr:2023-06-23T00:59:22.084+0000 7f9ccc341700 -1 osd.3 0 waiting for initial osdmap 2023-06-23T00:59:22.094 INFO:tasks.ceph.osd.2.smithi097.stderr:2023-06-23T00:59:22.088+0000 7fadfadb8700 -1 osd.2 0 waiting for initial osdmap 2023-06-23T00:59:22.094 INFO:tasks.ceph.osd.3.smithi097.stderr:2023-06-23T00:59:22.088+0000 7f9cc50e5700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T00:59:22.103 INFO:tasks.ceph.osd.2.smithi097.stderr:2023-06-23T00:59:22.096+0000 7fadf3b5c700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T00:59:22.123 INFO:tasks.ceph.osd.1.smithi097.stderr:2023-06-23T00:59:22.116+0000 7f69c8416700 -1 osd.1 0 waiting for initial osdmap 2023-06-23T00:59:22.129 INFO:tasks.ceph.osd.1.smithi097.stderr:2023-06-23T00:59:22.124+0000 7f69bf995700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T00:59:22.180 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.172+0000 7ff1e495c700 1 Processor -- start 2023-06-23T00:59:22.181 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.172+0000 7ff1e495c700 1 -- start start 2023-06-23T00:59:22.182 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1e495c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff1e006e6c0 0x7ff1e0167cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:22.182 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1e495c700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e0161790 con 0x7ff1e015ce50 2023-06-23T00:59:22.183 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1e495c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e0160b80 con 0x7ff1e00b06e0 2023-06-23T00:59:22.183 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1e495c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e0160e60 con 0x7ff1e006e6c0 2023-06-23T00:59:22.183 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1df7fe700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff1e015ce50 0x7ff1e00b1e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:34686/0 (socket says 172.21.15.97:34686) 2023-06-23T00:59:22.183 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1df7fe700 1 -- 172.21.15.97:0/845238200 learned_addr learned my addr 172.21.15.97:0/845238200 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:22.183 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1dffff700 1 --2- 172.21.15.97:0/845238200 >> v2:172.21.15.149:3300/0 conn(0x7ff1e006e6c0 0x7ff1e0167cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:22.183 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1de7fc700 1 -- 172.21.15.97:0/845238200 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7757910 0 0) 0x7ff1e0161790 con 0x7ff1e015ce50 2023-06-23T00:59:22.183 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1de7fc700 1 -- 172.21.15.97:0/845238200 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1c8003570 con 0x7ff1e015ce50 2023-06-23T00:59:22.184 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1de7fc700 1 -- 172.21.15.97:0/845238200 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071136475 0 0) 0x7ff1e0160b80 con 0x7ff1e00b06e0 2023-06-23T00:59:22.184 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1de7fc700 1 -- 172.21.15.97:0/845238200 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e0161790 con 0x7ff1e00b06e0 2023-06-23T00:59:22.184 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1de7fc700 1 -- 172.21.15.97:0/845238200 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3302558163 0 0) 0x7ff1c8003570 con 0x7ff1e015ce50 2023-06-23T00:59:22.184 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1dffff700 1 -- 172.21.15.97:0/845238200 >> v1:172.21.15.149:6789/0 conn(0x7ff1e00b06e0 legacy=0x7ff1e006dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:22.184 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1dffff700 1 -- 172.21.15.97:0/845238200 >> v1:172.21.15.97:6789/0 conn(0x7ff1e015ce50 legacy=0x7ff1e00b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:22.184 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1dffff700 1 -- 172.21.15.97:0/845238200 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e0161140 con 0x7ff1e006e6c0 2023-06-23T00:59:22.184 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1dffff700 1 --2- 172.21.15.97:0/845238200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e006e6c0 0x7ff1e0167cf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00098e0 tx=0x7ff1d00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c77b14ef254db731 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:22.185 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1de7fc700 1 -- 172.21.15.97:0/845238200 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8001810 con 0x7ff1e006e6c0 2023-06-23T00:59:22.185 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1de7fc700 1 -- 172.21.15.97:0/845238200 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d0011420 con 0x7ff1e006e6c0 2023-06-23T00:59:22.185 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1de7fc700 1 -- 172.21.15.97:0/845238200 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00117a0 con 0x7ff1e006e6c0 2023-06-23T00:59:22.187 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1e495c700 1 -- 172.21.15.97:0/845238200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e006e6c0 msgr2=0x7ff1e0167cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:22.187 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1e495c700 1 --2- 172.21.15.97:0/845238200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e006e6c0 0x7ff1e0167cf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00098e0 tx=0x7ff1d00091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:22.187 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1e495c700 1 -- 172.21.15.97:0/845238200 shutdown_connections 2023-06-23T00:59:22.187 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1e495c700 1 --2- 172.21.15.97:0/845238200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e006e6c0 0x7ff1e0167cf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:22.187 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1e495c700 1 -- 172.21.15.97:0/845238200 >> 172.21.15.97:0/845238200 conn(0x7ff1e006dbe0 msgr2=0x7ff1e0068ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:22.188 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1e495c700 1 -- 172.21.15.97:0/845238200 shutdown_connections 2023-06-23T00:59:22.188 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.176+0000 7ff1e495c700 1 -- 172.21.15.97:0/845238200 wait complete. 2023-06-23T00:59:22.188 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1e495c700 1 Processor -- start 2023-06-23T00:59:22.188 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1e495c700 1 -- start start 2023-06-23T00:59:22.188 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1e495c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e006e6c0 0x7ff1e0066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:22.188 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1e495c700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1e00b06e0 0x7ff1e0153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:22.188 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1e495c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1e015ce50 0x7ff1e015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:22.189 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1e495c700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00682a0 con 0x7ff1e00b06e0 2023-06-23T00:59:22.189 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1e495c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e0067410 con 0x7ff1e006e6c0 2023-06-23T00:59:22.189 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1e495c700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e0154400 con 0x7ff1e015ce50 2023-06-23T00:59:22.189 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1deffd700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1e00b06e0 0x7ff1e0153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:22.189 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1deffd700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1e00b06e0 0x7ff1e0153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42670/0 (socket says 172.21.15.97:42670) 2023-06-23T00:59:22.189 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1deffd700 1 -- 172.21.15.97:0/2814262832 learned_addr learned my addr 172.21.15.97:0/2814262832 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:22.189 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1df7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e006e6c0 0x7ff1e0066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:22.190 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1dffff700 1 --2- 172.21.15.97:0/2814262832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1e015ce50 0x7ff1e015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:22.190 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1deffd700 1 -- 172.21.15.97:0/2814262832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1e015ce50 msgr2=0x7ff1e015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:22.190 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1deffd700 1 --2- 172.21.15.97:0/2814262832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1e015ce50 0x7ff1e015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:22.190 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1deffd700 1 -- 172.21.15.97:0/2814262832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e006e6c0 msgr2=0x7ff1e0066ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:22.190 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1deffd700 1 --2- 172.21.15.97:0/2814262832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e006e6c0 0x7ff1e0066ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:22.190 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1deffd700 1 -- 172.21.15.97:0/2814262832 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d0009420 con 0x7ff1e00b06e0 2023-06-23T00:59:22.190 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1deffd700 1 --2- 172.21.15.97:0/2814262832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1e00b06e0 0x7ff1e0153ec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400c7c0 tx=0x7ff1d4007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:22.191 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1c77fe700 1 -- 172.21.15.97:0/2814262832 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4010510 con 0x7ff1e00b06e0 2023-06-23T00:59:22.191 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1c77fe700 1 -- 172.21.15.97:0/2814262832 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d40106b0 con 0x7ff1e00b06e0 2023-06-23T00:59:22.191 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1c77fe700 1 -- 172.21.15.97:0/2814262832 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4010a70 con 0x7ff1e00b06e0 2023-06-23T00:59:22.191 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1e495c700 1 -- 172.21.15.97:0/2814262832 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e0067690 con 0x7ff1e00b06e0 2023-06-23T00:59:22.191 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.180+0000 7ff1e495c700 1 -- 172.21.15.97:0/2814262832 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e0067c50 con 0x7ff1e00b06e0 2023-06-23T00:59:22.192 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.184+0000 7ff1c77fe700 1 -- 172.21.15.97:0/2814262832 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 4) v1 ==== 79811+0+0 (secure 0 0 0) 0x7ff1d4012440 con 0x7ff1e00b06e0 2023-06-23T00:59:22.192 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.184+0000 7ff1e495c700 1 -- 172.21.15.97:0/2814262832 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e015a4d0 con 0x7ff1e00b06e0 2023-06-23T00:59:22.192 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.184+0000 7ff1c77fe700 1 --2- 172.21.15.97:0/2814262832 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7ff1cc060420 0x7ff1cc0628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:22.192 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.184+0000 7ff1c77fe700 1 -- 172.21.15.97:0/2814262832 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2507+0+0 (secure 0 0 0) 0x7ff1d407b050 con 0x7ff1e00b06e0 2023-06-23T00:59:22.193 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.184+0000 7ff1df7fe700 1 --2- 172.21.15.97:0/2814262832 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7ff1cc060420 0x7ff1cc0628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:22.193 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.184+0000 7ff1df7fe700 1 --2- 172.21.15.97:0/2814262832 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7ff1cc060420 0x7ff1cc0628d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8001580 tx=0x7ff1d8000f40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:22.196 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.192+0000 7ff1c77fe700 1 -- 172.21.15.97:0/2814262832 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7ff1e015a4d0 con 0x7ff1e00b06e0 2023-06-23T00:59:22.355 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.348+0000 7ff1e495c700 1 -- 172.21.15.97:0/2814262832 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1e015a4d0 con 0x7ff1e00b06e0 2023-06-23T00:59:22.357 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.352+0000 7ff1c77fe700 1 -- 172.21.15.97:0/2814262832 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7450 (secure 0 0 0) 0x7ff1e015a4d0 con 0x7ff1e00b06e0 2023-06-23T00:59:22.357 INFO:teuthology.misc.health.smithi097.stdout: 2023-06-23T00:59:22.358 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":14,"fsid":"6b52ccf4-99f4-48c9-9a8a-9a183942c228","created":"2023-06-23T00:59:11.989322+0000","modified":"2023-06-23T00:59:21.246429+0000","last_up_change":"2023-06-23T00:59:21.246429+0000","last_in_change":"2023-06-23T00:59:14.057374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"291bc189-d5fb-482f-92d6-f7ecfb0a388c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":32817},{"type":"v1","addr":"172.21.15.97:6801","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":32817},{"type":"v1","addr":"172.21.15.97:6803","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":32817},{"type":"v1","addr":"172.21.15.97:6807","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":32817},{"type":"v1","addr":"172.21.15.97:6805","nonce":32817}]},"public_addr":"172.21.15.97:6801/32817","cluster_addr":"172.21.15.97:6803/32817","heartbeat_back_addr":"172.21.15.97:6807/32817","heartbeat_front_addr":"172.21.15.97:6805/32817","state":["exists","up"]},{"osd":1,"uuid":"693551b5-827b-4530-80b1-a836095efbf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a100d026-e382-4e71-bda5-ffa59f6b596b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"91783241-7821-458e-996f-a740274b18ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"67c375d3-ec8f-4d1a-bea7-e47896705fb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9de42b7c-cf51-4adf-9cc1-11c8d9863574","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ffa4ef96-2528-45cb-b2c9-a6c671b234e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"de849aa4-8494-4aeb-b1b6-6dd30458923c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T00:59:22.361 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.356+0000 7ff1e495c700 1 -- 172.21.15.97:0/2814262832 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7ff1cc060420 msgr2=0x7ff1cc0628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:22.362 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.356+0000 7ff1e495c700 1 --2- 172.21.15.97:0/2814262832 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7ff1cc060420 0x7ff1cc0628d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8001580 tx=0x7ff1d8000f40 comp rx=0 tx=0).stop 2023-06-23T00:59:22.362 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.356+0000 7ff1e495c700 1 -- 172.21.15.97:0/2814262832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1e00b06e0 msgr2=0x7ff1e0153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:22.362 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.356+0000 7ff1e495c700 1 --2- 172.21.15.97:0/2814262832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1e00b06e0 0x7ff1e0153ec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400c7c0 tx=0x7ff1d4007de0 comp rx=0 tx=0).stop 2023-06-23T00:59:22.363 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.356+0000 7ff1e495c700 1 -- 172.21.15.97:0/2814262832 shutdown_connections 2023-06-23T00:59:22.363 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.356+0000 7ff1e495c700 1 --2- 172.21.15.97:0/2814262832 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7ff1cc060420 0x7ff1cc0628d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:22.363 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.356+0000 7ff1e495c700 1 --2- 172.21.15.97:0/2814262832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1e015ce50 0x7ff1e015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:22.363 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.356+0000 7ff1e495c700 1 --2- 172.21.15.97:0/2814262832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1e00b06e0 0x7ff1e0153ec0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:22.364 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.356+0000 7ff1e495c700 1 --2- 172.21.15.97:0/2814262832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e006e6c0 0x7ff1e0066ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:22.364 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.356+0000 7ff1e495c700 1 -- 172.21.15.97:0/2814262832 >> 172.21.15.97:0/2814262832 conn(0x7ff1e006dbe0 msgr2=0x7ff1e0156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:22.364 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.356+0000 7ff1e495c700 1 -- 172.21.15.97:0/2814262832 shutdown_connections 2023-06-23T00:59:22.365 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:22.356+0000 7ff1e495c700 1 -- 172.21.15.97:0/2814262832 wait complete. 2023-06-23T00:59:22.375 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-06-23T00:59:22.434 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-06-23T00:59:22.427+0000 7fd60bbdf700 -1 osd.7 0 waiting for initial osdmap 2023-06-23T00:59:22.445 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-06-23T00:59:22.439+0000 7fd604983700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T00:59:22.528 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-06-23T00:59:22.523+0000 7f06621a0700 -1 osd.4 0 waiting for initial osdmap 2023-06-23T00:59:22.535 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-06-23T00:59:22.531+0000 7f065971f700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T00:59:22.559 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-06-23T00:59:22.555+0000 7faaac191700 -1 osd.6 0 waiting for initial osdmap 2023-06-23T00:59:22.567 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-06-23T00:59:22.559+0000 7faaa4f35700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T00:59:22.576 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-06-23T00:59:22.571+0000 7f751530a700 -1 osd.5 0 waiting for initial osdmap 2023-06-23T00:59:22.582 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-06-23T00:59:22.575+0000 7f750c889700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T00:59:29.182 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-23T00:59:29.284 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135d5b0700 1 Processor -- start 2023-06-23T00:59:29.285 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135d5b0700 1 -- start start 2023-06-23T00:59:29.285 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135d5b0700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1358146390 0x7f135815d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:29.286 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135d5b0700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13580c9bb0 con 0x7f13580c8070 2023-06-23T00:59:29.286 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135d5b0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13580c61e0 con 0x7f13580c5ce0 2023-06-23T00:59:29.286 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135d5b0700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13580c7e00 con 0x7f1358146390 2023-06-23T00:59:29.286 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f1357fff700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1358146390 0x7f135815d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:29.286 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135cdaf700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f13580c8070 0x7f13580ca040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47156/0 (socket says 172.21.15.97:47156) 2023-06-23T00:59:29.287 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135cdaf700 1 -- 172.21.15.97:0/3739450781 learned_addr learned my addr 172.21.15.97:0/3739450781 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:29.288 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f1357fff700 1 -- 172.21.15.97:0/3739450781 >> v1:172.21.15.149:6789/0 conn(0x7f13580c5ce0 legacy=0x7f1358161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:29.288 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f1357fff700 1 -- 172.21.15.97:0/3739450781 >> v1:172.21.15.97:6789/0 conn(0x7f13580c8070 legacy=0x7f13580ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:29.288 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f1357fff700 1 -- 172.21.15.97:0/3739450781 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13580c9560 con 0x7f1358146390 2023-06-23T00:59:29.289 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f1356ffd700 1 -- 172.21.15.97:0/3739450781 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209596045 0 0) 0x7f13580c9bb0 con 0x7f13580c8070 2023-06-23T00:59:29.289 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f1357fff700 1 --2- 172.21.15.97:0/3739450781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358146390 0x7f135815d410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1348009e60 tx=0x7f1348009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32db3746e0a806fd server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:29.289 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f1356ffd700 1 -- 172.21.15.97:0/3739450781 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134800e070 con 0x7f1358146390 2023-06-23T00:59:29.289 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f1356ffd700 1 -- 172.21.15.97:0/3739450781 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134800bbf0 con 0x7f1358146390 2023-06-23T00:59:29.289 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f1356ffd700 1 -- 172.21.15.97:0/3739450781 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348012430 con 0x7f1358146390 2023-06-23T00:59:29.289 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135d5b0700 1 -- 172.21.15.97:0/3739450781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358146390 msgr2=0x7f135815d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:29.290 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135d5b0700 1 --2- 172.21.15.97:0/3739450781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358146390 0x7f135815d410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1348009e60 tx=0x7f1348009780 comp rx=0 tx=0).stop 2023-06-23T00:59:29.290 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135d5b0700 1 -- 172.21.15.97:0/3739450781 shutdown_connections 2023-06-23T00:59:29.290 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135d5b0700 1 --2- 172.21.15.97:0/3739450781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358146390 0x7f135815d410 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:29.290 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135d5b0700 1 -- 172.21.15.97:0/3739450781 >> 172.21.15.97:0/3739450781 conn(0x7f13580c19a0 msgr2=0x7f13580c1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:29.291 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135d5b0700 1 -- 172.21.15.97:0/3739450781 shutdown_connections 2023-06-23T00:59:29.291 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.280+0000 7f135d5b0700 1 -- 172.21.15.97:0/3739450781 wait complete. 2023-06-23T00:59:29.292 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135d5b0700 1 Processor -- start 2023-06-23T00:59:29.293 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135d5b0700 1 -- start start 2023-06-23T00:59:29.293 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135d5b0700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13580c5ce0 0x7f135813db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:29.293 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135d5b0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13580c8070 0x7f13580c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:29.293 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135d5b0700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358146390 0x7f135815df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:29.293 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135d5b0700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135813e760 con 0x7f1358146390 2023-06-23T00:59:29.293 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135d5b0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13580c33e0 con 0x7f13580c8070 2023-06-23T00:59:29.294 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135d5b0700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135813e480 con 0x7f13580c5ce0 2023-06-23T00:59:29.294 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135cdaf700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358146390 0x7f135815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:29.294 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135cdaf700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358146390 0x7f135815df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56946/0 (socket says 172.21.15.97:56946) 2023-06-23T00:59:29.294 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135cdaf700 1 -- 172.21.15.97:0/2453950558 learned_addr learned my addr 172.21.15.97:0/2453950558 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:29.295 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f1357fff700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13580c5ce0 0x7f135813db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:29.295 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f13577fe700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13580c8070 0x7f13580c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:29.295 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135cdaf700 1 -- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13580c5ce0 msgr2=0x7f135813db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:29.295 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135cdaf700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13580c5ce0 0x7f135813db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:29.295 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135cdaf700 1 -- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13580c8070 msgr2=0x7f13580c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:29.295 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135cdaf700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13580c8070 0x7f13580c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:29.295 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135cdaf700 1 -- 172.21.15.97:0/2453950558 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1348009a20 con 0x7f1358146390 2023-06-23T00:59:29.296 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f135cdaf700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358146390 0x7f135815df80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f135000c5d0 tx=0x7f1350007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:29.296 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f133ffff700 1 -- 172.21.15.97:0/2453950558 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350005b30 con 0x7f1358146390 2023-06-23T00:59:29.296 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f133ffff700 1 -- 172.21.15.97:0/2453950558 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1350005c90 con 0x7f1358146390 2023-06-23T00:59:29.296 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.284+0000 7f133ffff700 1 -- 172.21.15.97:0/2453950558 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350007320 con 0x7f1358146390 2023-06-23T00:59:29.296 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.288+0000 7f135d5b0700 1 -- 172.21.15.97:0/2453950558 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13580c2d90 con 0x7f1358146390 2023-06-23T00:59:29.296 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.288+0000 7f135d5b0700 1 -- 172.21.15.97:0/2453950558 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135813e0c0 con 0x7f1358146390 2023-06-23T00:59:29.297 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.288+0000 7f133ffff700 1 -- 172.21.15.97:0/2453950558 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f1350007690 con 0x7f1358146390 2023-06-23T00:59:29.297 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.288+0000 7f135d5b0700 1 -- 172.21.15.97:0/2453950558 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1358064310 con 0x7f1358146390 2023-06-23T00:59:29.297 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.288+0000 7f133ffff700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f13440604b0 0x7f1344062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:29.297 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.288+0000 7f133ffff700 1 -- 172.21.15.97:0/2453950558 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f135007b8d0 con 0x7f1358146390 2023-06-23T00:59:29.298 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.288+0000 7f1357fff700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f13440604b0 0x7f1344062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:29.298 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.288+0000 7f1357fff700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f13440604b0 0x7f1344062960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1358170900 tx=0x7f1348018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:29.299 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.292+0000 7f133ffff700 1 -- 172.21.15.97:0/2453950558 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f135004c2d0 con 0x7f1358146390 2023-06-23T00:59:29.459 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.452+0000 7f135d5b0700 1 -- 172.21.15.97:0/2453950558 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13580c9840 con 0x7f1358146390 2023-06-23T00:59:29.461 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.456+0000 7f133ffff700 1 -- 172.21.15.97:0/2453950558 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f1350017090 con 0x7f1358146390 2023-06-23T00:59:29.461 INFO:teuthology.misc.health.smithi097.stdout: 2023-06-23T00:59:29.461 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":19,"fsid":"6b52ccf4-99f4-48c9-9a8a-9a183942c228","created":"2023-06-23T00:59:11.989322+0000","modified":"2023-06-23T00:59:26.984342+0000","last_up_change":"2023-06-23T00:59:22.950578+0000","last_in_change":"2023-06-23T00:59:14.057374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T00:59:24.275869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"291bc189-d5fb-482f-92d6-f7ecfb0a388c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":32817},{"type":"v1","addr":"172.21.15.97:6801","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":32817},{"type":"v1","addr":"172.21.15.97:6803","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":32817},{"type":"v1","addr":"172.21.15.97:6807","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":32817},{"type":"v1","addr":"172.21.15.97:6805","nonce":32817}]},"public_addr":"172.21.15.97:6801/32817","cluster_addr":"172.21.15.97:6803/32817","heartbeat_back_addr":"172.21.15.97:6807/32817","heartbeat_front_addr":"172.21.15.97:6805/32817","state":["exists","up"]},{"osd":1,"uuid":"693551b5-827b-4530-80b1-a836095efbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":32818},{"type":"v1","addr":"172.21.15.97:6817","nonce":32818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":32818},{"type":"v1","addr":"172.21.15.97:6819","nonce":32818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":32818},{"type":"v1","addr":"172.21.15.97:6823","nonce":32818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":32818},{"type":"v1","addr":"172.21.15.97:6821","nonce":32818}]},"public_addr":"172.21.15.97:6817/32818","cluster_addr":"172.21.15.97:6819/32818","heartbeat_back_addr":"172.21.15.97:6823/32818","heartbeat_front_addr":"172.21.15.97:6821/32818","state":["exists","up"]},{"osd":2,"uuid":"a100d026-e382-4e71-bda5-ffa59f6b596b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":32820},{"type":"v1","addr":"172.21.15.97:6825","nonce":32820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":32820},{"type":"v1","addr":"172.21.15.97:6827","nonce":32820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":32820},{"type":"v1","addr":"172.21.15.97:6831","nonce":32820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":32820},{"type":"v1","addr":"172.21.15.97:6829","nonce":32820}]},"public_addr":"172.21.15.97:6825/32820","cluster_addr":"172.21.15.97:6827/32820","heartbeat_back_addr":"172.21.15.97:6831/32820","heartbeat_front_addr":"172.21.15.97:6829/32820","state":["exists","up"]},{"osd":3,"uuid":"91783241-7821-458e-996f-a740274b18ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":32819},{"type":"v1","addr":"172.21.15.97:6809","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":32819},{"type":"v1","addr":"172.21.15.97:6811","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":32819},{"type":"v1","addr":"172.21.15.97:6815","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":32819},{"type":"v1","addr":"172.21.15.97:6813","nonce":32819}]},"public_addr":"172.21.15.97:6809/32819","cluster_addr":"172.21.15.97:6811/32819","heartbeat_back_addr":"172.21.15.97:6815/32819","heartbeat_front_addr":"172.21.15.97:6813/32819","state":["exists","up"]},{"osd":4,"uuid":"67c375d3-ec8f-4d1a-bea7-e47896705fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":32992},{"type":"v1","addr":"172.21.15.149:6801","nonce":32992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":32992},{"type":"v1","addr":"172.21.15.149:6803","nonce":32992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":32992},{"type":"v1","addr":"172.21.15.149:6807","nonce":32992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":32992},{"type":"v1","addr":"172.21.15.149:6805","nonce":32992}]},"public_addr":"172.21.15.149:6801/32992","cluster_addr":"172.21.15.149:6803/32992","heartbeat_back_addr":"172.21.15.149:6807/32992","heartbeat_front_addr":"172.21.15.149:6805/32992","state":["exists","up"]},{"osd":5,"uuid":"9de42b7c-cf51-4adf-9cc1-11c8d9863574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":32995},{"type":"v1","addr":"172.21.15.149:6809","nonce":32995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":32995},{"type":"v1","addr":"172.21.15.149:6811","nonce":32995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":32995},{"type":"v1","addr":"172.21.15.149:6815","nonce":32995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":32995},{"type":"v1","addr":"172.21.15.149:6813","nonce":32995}]},"public_addr":"172.21.15.149:6809/32995","cluster_addr":"172.21.15.149:6811/32995","heartbeat_back_addr":"172.21.15.149:6815/32995","heartbeat_front_addr":"172.21.15.149:6813/32995","state":["exists","up"]},{"osd":6,"uuid":"ffa4ef96-2528-45cb-b2c9-a6c671b234e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":32996},{"type":"v1","addr":"172.21.15.149:6825","nonce":32996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":32996},{"type":"v1","addr":"172.21.15.149:6827","nonce":32996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":32996},{"type":"v1","addr":"172.21.15.149:6831","nonce":32996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":32996},{"type":"v1","addr":"172.21.15.149:6829","nonce":32996}]},"public_addr":"172.21.15.149:6825/32996","cluster_addr":"172.21.15.149:6827/32996","heartbeat_back_addr":"172.21.15.149:6831/32996","heartbeat_front_addr":"172.21.15.149:6829/32996","state":["exists","up"]},{"osd":7,"uuid":"de849aa4-8494-4aeb-b1b6-6dd30458923c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":32994},{"type":"v1","addr":"172.21.15.149:6817","nonce":32994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":32994},{"type":"v1","addr":"172.21.15.149:6819","nonce":32994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":32994},{"type":"v1","addr":"172.21.15.149:6823","nonce":32994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":32994},{"type":"v1","addr":"172.21.15.149:6821","nonce":32994}]},"public_addr":"172.21.15.149:6817/32994","cluster_addr":"172.21.15.149:6819/32994","heartbeat_back_addr":"172.21.15.149:6823/32994","heartbeat_front_addr":"172.21.15.149:6821/32994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.027722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.241225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.289939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.257873+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.443455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.479909+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.521773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.560641+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T00:59:29.463 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.456+0000 7f135d5b0700 1 -- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f13440604b0 msgr2=0x7f1344062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:29.463 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.456+0000 7f135d5b0700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f13440604b0 0x7f1344062960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1358170900 tx=0x7f1348018000 comp rx=0 tx=0).stop 2023-06-23T00:59:29.463 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.456+0000 7f135d5b0700 1 -- 172.21.15.97:0/2453950558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358146390 msgr2=0x7f135815df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:29.463 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.456+0000 7f135d5b0700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358146390 0x7f135815df80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f135000c5d0 tx=0x7f1350007d30 comp rx=0 tx=0).stop 2023-06-23T00:59:29.464 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.456+0000 7f135d5b0700 1 -- 172.21.15.97:0/2453950558 shutdown_connections 2023-06-23T00:59:29.464 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.456+0000 7f135d5b0700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f13440604b0 0x7f1344062960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:29.464 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.456+0000 7f135d5b0700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1358146390 0x7f135815df80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:29.464 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.456+0000 7f135d5b0700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13580c8070 0x7f13580c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:29.464 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.456+0000 7f135d5b0700 1 --2- 172.21.15.97:0/2453950558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13580c5ce0 0x7f135813db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:29.464 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.456+0000 7f135d5b0700 1 -- 172.21.15.97:0/2453950558 >> 172.21.15.97:0/2453950558 conn(0x7f13580c19a0 msgr2=0x7f135813aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:29.464 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.456+0000 7f135d5b0700 1 -- 172.21.15.97:0/2453950558 shutdown_connections 2023-06-23T00:59:29.465 INFO:teuthology.misc.health.smithi097.stderr:2023-06-23T00:59:29.456+0000 7f135d5b0700 1 -- 172.21.15.97:0/2453950558 wait complete. 2023-06-23T00:59:29.474 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-23T00:59:29.474 INFO:tasks.ceph:Creating RBD pool 2023-06-23T00:59:29.475 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-23T00:59:29.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.576+0000 7f7d67fff700 1 Processor -- start 2023-06-23T00:59:29.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.576+0000 7f7d67fff700 1 -- start start 2023-06-23T00:59:29.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.576+0000 7f7d67fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7d680adad0 0x7f7d680c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:29.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.576+0000 7f7d67fff700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7d680adea0 0x7f7d680c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:29.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.576+0000 7f7d67fff700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d68156000 con 0x7f7d6806c1d0 2023-06-23T00:59:29.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.576+0000 7f7d67fff700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d680c9200 con 0x7f7d680adea0 2023-06-23T00:59:29.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.576+0000 7f7d67fff700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d680c94a0 con 0x7f7d680adad0 2023-06-23T00:59:29.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.576+0000 7f7d5e7fc700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7d680adea0 0x7f7d680c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:29.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.576+0000 7f7d677fe700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7d6806c1d0 0x7f7d681596a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47172/0 (socket says 172.21.15.97:47172) 2023-06-23T00:59:29.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.576+0000 7f7d677fe700 1 -- 172.21.15.97:0/3886366722 learned_addr learned my addr 172.21.15.97:0/3886366722 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:29.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.576+0000 7f7d66ffd700 1 --2- 172.21.15.97:0/3886366722 >> v2:172.21.15.149:3300/0 conn(0x7f7d680adad0 0x7f7d680c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:29.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.576+0000 7f7d667fc700 1 -- 172.21.15.97:0/3886366722 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156843509 0 0) 0x7f7d68156000 con 0x7f7d6806c1d0 2023-06-23T00:59:29.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.576+0000 7f7d667fc700 1 -- 172.21.15.97:0/3886366722 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d54003570 con 0x7f7d6806c1d0 2023-06-23T00:59:29.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d5e7fc700 1 -- 172.21.15.97:0/3886366722 >> v2:172.21.15.149:3300/0 conn(0x7f7d680adad0 msgr2=0x7f7d680c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:29.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d5e7fc700 1 --2- 172.21.15.97:0/3886366722 >> v2:172.21.15.149:3300/0 conn(0x7f7d680adad0 0x7f7d680c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:29.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d5e7fc700 1 -- 172.21.15.97:0/3886366722 >> v1:172.21.15.97:6789/0 conn(0x7f7d6806c1d0 legacy=0x7f7d681596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:29.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d5e7fc700 1 -- 172.21.15.97:0/3886366722 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d680c7c30 con 0x7f7d680adea0 2023-06-23T00:59:29.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d5e7fc700 1 --2- 172.21.15.97:0/3886366722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d680adea0 0x7f7d680c76f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7d680cb590 tx=0x7f7d50009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb35842a803e590 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:29.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d667fc700 1 -- 172.21.15.97:0/3886366722 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d50005c10 con 0x7f7d680adea0 2023-06-23T00:59:29.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d667fc700 1 -- 172.21.15.97:0/3886366722 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d50005d70 con 0x7f7d680adea0 2023-06-23T00:59:29.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d667fc700 1 -- 172.21.15.97:0/3886366722 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d50006240 con 0x7f7d680adea0 2023-06-23T00:59:29.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d67fff700 1 -- 172.21.15.97:0/3886366722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d680adea0 msgr2=0x7f7d680c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:29.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d67fff700 1 --2- 172.21.15.97:0/3886366722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d680adea0 0x7f7d680c76f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7d680cb590 tx=0x7f7d50009120 comp rx=0 tx=0).stop 2023-06-23T00:59:29.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d67fff700 1 -- 172.21.15.97:0/3886366722 shutdown_connections 2023-06-23T00:59:29.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d67fff700 1 --2- 172.21.15.97:0/3886366722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d680adea0 0x7f7d680c76f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:29.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d67fff700 1 --2- 172.21.15.97:0/3886366722 >> v2:172.21.15.149:3300/0 conn(0x7f7d680adad0 0x7f7d680c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:29.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d67fff700 1 -- 172.21.15.97:0/3886366722 >> 172.21.15.97:0/3886366722 conn(0x7f7d680cc100 msgr2=0x7f7d6806e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:29.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d67fff700 1 -- 172.21.15.97:0/3886366722 shutdown_connections 2023-06-23T00:59:29.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d67fff700 1 -- 172.21.15.97:0/3886366722 wait complete. 2023-06-23T00:59:29.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d67fff700 1 Processor -- start 2023-06-23T00:59:29.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.580+0000 7f7d67fff700 1 -- start start 2023-06-23T00:59:29.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d67fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d6806c1d0 0x7f7d681531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d67fff700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d680adad0 0x7f7d681568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d67fff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d680adea0 0x7f7d68167870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d67fff700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d68167db0 con 0x7f7d680adad0 2023-06-23T00:59:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d67fff700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d680a4890 con 0x7f7d6806c1d0 2023-06-23T00:59:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d67fff700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d681588d0 con 0x7f7d680adea0 2023-06-23T00:59:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d5e7fc700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d680adad0 0x7f7d681568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d5e7fc700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d680adad0 0x7f7d681568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56950/0 (socket says 172.21.15.97:56950) 2023-06-23T00:59:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d5e7fc700 1 -- 172.21.15.97:0/3118631912 learned_addr learned my addr 172.21.15.97:0/3118631912 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:29.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d66ffd700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d6806c1d0 0x7f7d681531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:29.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d677fe700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d680adea0 0x7f7d68167870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:29.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d5e7fc700 1 -- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d680adea0 msgr2=0x7f7d68167870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:29.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d5e7fc700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d680adea0 0x7f7d68167870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:29.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d5e7fc700 1 -- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d6806c1d0 msgr2=0x7f7d681531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:29.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d5e7fc700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d6806c1d0 0x7f7d681531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:29.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d5e7fc700 1 -- 172.21.15.97:0/3118631912 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d500093c0 con 0x7f7d680adad0 2023-06-23T00:59:29.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d5e7fc700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d680adad0 0x7f7d681568e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7d6805e950 tx=0x7f7d50016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:29.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d5f7fe700 1 -- 172.21.15.97:0/3118631912 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5001d6b0 con 0x7f7d680adad0 2023-06-23T00:59:29.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d5f7fe700 1 -- 172.21.15.97:0/3118631912 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5001d810 con 0x7f7d680adad0 2023-06-23T00:59:29.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d67fff700 1 -- 172.21.15.97:0/3118631912 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d68156180 con 0x7f7d680adad0 2023-06-23T00:59:29.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d5f7fe700 1 -- 172.21.15.97:0/3118631912 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5001dbd0 con 0x7f7d680adad0 2023-06-23T00:59:29.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d67fff700 1 -- 172.21.15.97:0/3118631912 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d68158ba0 con 0x7f7d680adad0 2023-06-23T00:59:29.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.584+0000 7f7d67fff700 1 -- 172.21.15.97:0/3118631912 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d68068870 con 0x7f7d680adad0 2023-06-23T00:59:29.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.588+0000 7f7d5f7fe700 1 -- 172.21.15.97:0/3118631912 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f7d50030480 con 0x7f7d680adad0 2023-06-23T00:59:29.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.588+0000 7f7d5f7fe700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f7d480604b0 0x7f7d48062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:29.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.588+0000 7f7d5f7fe700 1 -- 172.21.15.97:0/3118631912 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7d5007dbc0 con 0x7f7d680adad0 2023-06-23T00:59:29.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.588+0000 7f7d66ffd700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f7d480604b0 0x7f7d48062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:29.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.588+0000 7f7d66ffd700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f7d480604b0 0x7f7d48062960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009db0 tx=0x7f7d580091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:29.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.596+0000 7f7d5f7fe700 1 -- 172.21.15.97:0/3118631912 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f7d5004e5c0 con 0x7f7d680adad0 2023-06-23T00:59:29.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:29.756+0000 7f7d67fff700 1 -- 172.21.15.97:0/3118631912 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f7d6804b3f0 con 0x7f7d680adad0 2023-06-23T00:59:30.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.020+0000 7f7d5f7fe700 1 -- 172.21.15.97:0/3118631912 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v20) v1 ==== 109+0+0 (secure 0 0 0) 0x7f7d50051be0 con 0x7f7d680adad0 2023-06-23T00:59:30.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.024+0000 7f7d67fff700 1 -- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f7d480604b0 msgr2=0x7f7d48062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:30.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.024+0000 7f7d67fff700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f7d480604b0 0x7f7d48062960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009db0 tx=0x7f7d580091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:30.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.024+0000 7f7d67fff700 1 -- 172.21.15.97:0/3118631912 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d680adad0 msgr2=0x7f7d681568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:30.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.024+0000 7f7d67fff700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d680adad0 0x7f7d681568e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7d6805e950 tx=0x7f7d50016000 comp rx=0 tx=0).stop 2023-06-23T00:59:30.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.024+0000 7f7d67fff700 1 -- 172.21.15.97:0/3118631912 shutdown_connections 2023-06-23T00:59:30.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.024+0000 7f7d67fff700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f7d480604b0 0x7f7d48062960 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:30.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.024+0000 7f7d67fff700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d680adea0 0x7f7d68167870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:30.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.024+0000 7f7d67fff700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7d680adad0 0x7f7d681568e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:30.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.024+0000 7f7d67fff700 1 --2- 172.21.15.97:0/3118631912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d6806c1d0 0x7f7d681531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:30.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.024+0000 7f7d67fff700 1 -- 172.21.15.97:0/3118631912 >> 172.21.15.97:0/3118631912 conn(0x7f7d680cc100 msgr2=0x7f7d680c0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:30.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.024+0000 7f7d67fff700 1 -- 172.21.15.97:0/3118631912 shutdown_connections 2023-06-23T00:59:30.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.024+0000 7f7d67fff700 1 -- 172.21.15.97:0/3118631912 wait complete. 2023-06-23T00:59:30.032 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'rbd' created 2023-06-23T00:59:30.043 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-23T00:59:30.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb136ba2700 1 Processor -- start 2023-06-23T00:59:30.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb136ba2700 1 -- start start 2023-06-23T00:59:30.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb136ba2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb130158770 0x7fb130158b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:30.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb136ba2700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb1300b55c0 0x7fb1300cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:30.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb136ba2700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1300ce3c0 0x7fb1300cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:30.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb136ba2700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1300cf470 con 0x7fb1300b55c0 2023-06-23T00:59:30.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb136ba2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1300ce860 con 0x7fb130158770 2023-06-23T00:59:30.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb136ba2700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1300ceb40 con 0x7fb1300ce3c0 2023-06-23T00:59:30.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb13539f700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb1300b55c0 0x7fb1300cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:30.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb13539f700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb1300b55c0 0x7fb1300cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56960/0 (socket says 172.21.15.97:56960) 2023-06-23T00:59:30.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb13539f700 1 -- 172.21.15.97:0/2401112258 learned_addr learned my addr 172.21.15.97:0/2401112258 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:30.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb135ba0700 1 --2- 172.21.15.97:0/2401112258 >> v2:172.21.15.149:3300/0 conn(0x7fb130158770 0x7fb130158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:30.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb1363a1700 1 --2- 172.21.15.97:0/2401112258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1300ce3c0 0x7fb1300cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:30.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb13539f700 1 -- 172.21.15.97:0/2401112258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1300ce3c0 msgr2=0x7fb1300cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:30.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb13539f700 1 --2- 172.21.15.97:0/2401112258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1300ce3c0 0x7fb1300cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:30.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb13539f700 1 -- 172.21.15.97:0/2401112258 >> v2:172.21.15.149:3300/0 conn(0x7fb130158770 msgr2=0x7fb130158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:30.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb13539f700 1 --2- 172.21.15.97:0/2401112258 >> v2:172.21.15.149:3300/0 conn(0x7fb130158770 0x7fb130158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:30.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb13539f700 1 -- 172.21.15.97:0/2401112258 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1300cee20 con 0x7fb1300b55c0 2023-06-23T00:59:30.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb135ba0700 1 --2- 172.21.15.97:0/2401112258 >> v2:172.21.15.149:3300/0 conn(0x7fb130158770 0x7fb130158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:30.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb13539f700 1 --2- 172.21.15.97:0/2401112258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1300b55c0 0x7fb1300cde80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb130088c00 tx=0x7fb12c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fd87f495de24b5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:30.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb134b9e700 1 -- 172.21.15.97:0/2401112258 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c00b860 con 0x7fb1300b55c0 2023-06-23T00:59:30.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb134b9e700 1 -- 172.21.15.97:0/2401112258 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c00b9c0 con 0x7fb1300b55c0 2023-06-23T00:59:30.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.144+0000 7fb134b9e700 1 -- 172.21.15.97:0/2401112258 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c00bd60 con 0x7fb1300b55c0 2023-06-23T00:59:30.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 -- 172.21.15.97:0/2401112258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1300b55c0 msgr2=0x7fb1300cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:30.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 --2- 172.21.15.97:0/2401112258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1300b55c0 0x7fb1300cde80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb130088c00 tx=0x7fb12c009250 comp rx=0 tx=0).stop 2023-06-23T00:59:30.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 -- 172.21.15.97:0/2401112258 shutdown_connections 2023-06-23T00:59:30.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 --2- 172.21.15.97:0/2401112258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1300b55c0 0x7fb1300cde80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:30.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 --2- 172.21.15.97:0/2401112258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1300ce3c0 0x7fb1300cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:30.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 --2- 172.21.15.97:0/2401112258 >> v2:172.21.15.149:3300/0 conn(0x7fb130158770 0x7fb130158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:30.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 -- 172.21.15.97:0/2401112258 >> 172.21.15.97:0/2401112258 conn(0x7fb13006cca0 msgr2=0x7fb1300b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:30.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 -- 172.21.15.97:0/2401112258 shutdown_connections 2023-06-23T00:59:30.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 -- 172.21.15.97:0/2401112258 wait complete. 2023-06-23T00:59:30.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 Processor -- start 2023-06-23T00:59:30.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 -- start start 2023-06-23T00:59:30.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1300b55c0 0x7fb130149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:30.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1300ce3c0 0x7fb13016c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:30.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb130158770 0x7fb13015b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:30.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb130159050 con 0x7fb1300b55c0 2023-06-23T00:59:30.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1301495c0 con 0x7fb130158770 2023-06-23T00:59:30.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb136ba2700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13016cdf0 con 0x7fb1300ce3c0 2023-06-23T00:59:30.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.148+0000 7fb135ba0700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1300b55c0 0x7fb130149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:30.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb135ba0700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1300b55c0 0x7fb130149080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56972/0 (socket says 172.21.15.97:56972) 2023-06-23T00:59:30.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb135ba0700 1 -- 172.21.15.97:0/1182653838 learned_addr learned my addr 172.21.15.97:0/1182653838 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:30.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb13539f700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1300ce3c0 0x7fb13016c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:30.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb1363a1700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb130158770 0x7fb13015b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:30.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb135ba0700 1 -- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1300ce3c0 msgr2=0x7fb13016c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:30.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb135ba0700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1300ce3c0 0x7fb13016c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:30.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb135ba0700 1 -- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb130158770 msgr2=0x7fb13015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:30.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb135ba0700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb130158770 0x7fb13015b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:30.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb135ba0700 1 -- 172.21.15.97:0/1182653838 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c0094f0 con 0x7fb1300b55c0 2023-06-23T00:59:30.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb13539f700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1300ce3c0 0x7fb13016c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:30.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb135ba0700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1300b55c0 0x7fb130149080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb12400d860 tx=0x7fb124008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:30.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb121ffb700 1 -- 172.21.15.97:0/1182653838 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1240125f0 con 0x7fb1300b55c0 2023-06-23T00:59:30.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb121ffb700 1 -- 172.21.15.97:0/1182653838 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb124012750 con 0x7fb1300b55c0 2023-06-23T00:59:30.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb136ba2700 1 -- 172.21.15.97:0/1182653838 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13016d0d0 con 0x7fb1300b55c0 2023-06-23T00:59:30.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb121ffb700 1 -- 172.21.15.97:0/1182653838 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124012af0 con 0x7fb1300b55c0 2023-06-23T00:59:30.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb136ba2700 1 -- 172.21.15.97:0/1182653838 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb130149930 con 0x7fb1300b55c0 2023-06-23T00:59:30.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb136ba2700 1 -- 172.21.15.97:0/1182653838 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb130158b40 con 0x7fb1300b55c0 2023-06-23T00:59:30.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.152+0000 7fb121ffb700 1 -- 172.21.15.97:0/1182653838 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fb124014430 con 0x7fb1300b55c0 2023-06-23T00:59:30.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.156+0000 7fb121ffb700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fb1140604b0 0x7fb114062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:30.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.156+0000 7fb121ffb700 1 -- 172.21.15.97:0/1182653838 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5195+0+0 (secure 0 0 0) 0x7fb12407c8b0 con 0x7fb1300b55c0 2023-06-23T00:59:30.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.156+0000 7fb13539f700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fb1140604b0 0x7fb114062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:30.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.156+0000 7fb13539f700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fb1140604b0 0x7fb114062960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb130088c00 tx=0x7fb12c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:30.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.164+0000 7fb121ffb700 1 -- 172.21.15.97:0/1182653838 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fb130158b40 con 0x7fb1300b55c0 2023-06-23T00:59:30.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:30.324+0000 7fb136ba2700 1 -- 172.21.15.97:0/1182653838 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb130158b40 con 0x7fb1300b55c0 2023-06-23T00:59:31.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.032+0000 7fb121ffb700 1 -- 172.21.15.97:0/1182653838 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v21) v1 ==== 173+0+0 (secure 0 0 0) 0x7fb130158b40 con 0x7fb1300b55c0 2023-06-23T00:59:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.036+0000 7fb136ba2700 1 -- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fb1140604b0 msgr2=0x7fb114062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.036+0000 7fb136ba2700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fb1140604b0 0x7fb114062960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb130088c00 tx=0x7fb12c017000 comp rx=0 tx=0).stop 2023-06-23T00:59:31.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.036+0000 7fb136ba2700 1 -- 172.21.15.97:0/1182653838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1300b55c0 msgr2=0x7fb130149080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.036+0000 7fb136ba2700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1300b55c0 0x7fb130149080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb12400d860 tx=0x7fb124008040 comp rx=0 tx=0).stop 2023-06-23T00:59:31.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.036+0000 7fb136ba2700 1 -- 172.21.15.97:0/1182653838 shutdown_connections 2023-06-23T00:59:31.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.036+0000 7fb136ba2700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fb1140604b0 0x7fb114062960 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.036+0000 7fb136ba2700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb130158770 0x7fb13015b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.036+0000 7fb136ba2700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1300ce3c0 0x7fb13016c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.036+0000 7fb136ba2700 1 --2- 172.21.15.97:0/1182653838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb1300b55c0 0x7fb130149080 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.036+0000 7fb136ba2700 1 -- 172.21.15.97:0/1182653838 >> 172.21.15.97:0/1182653838 conn(0x7fb13006cca0 msgr2=0x7fb1300cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:31.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.036+0000 7fb136ba2700 1 -- 172.21.15.97:0/1182653838 shutdown_connections 2023-06-23T00:59:31.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.036+0000 7fb136ba2700 1 -- 172.21.15.97:0/1182653838 wait complete. 2023-06-23T00:59:31.044 INFO:teuthology.orchestra.run.smithi097.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-23T00:59:31.055 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-23T00:59:31.056 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-23T00:59:31.056 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-23T00:59:31.058 INFO:tasks.ceph.mds.a:Started 2023-06-23T00:59:31.058 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-23T00:59:31.059 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-23T00:59:31.061 INFO:tasks.ceph.mds.c:Started 2023-06-23T00:59:31.061 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-23T00:59:31.061 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-23T00:59:31.063 INFO:tasks.ceph.mds.b:Started 2023-06-23T00:59:31.064 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-23T00:59:31.064 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-23T00:59:31.066 INFO:tasks.ceph.mds.d:Started 2023-06-23T00:59:31.066 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-23T00:59:31.066 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T00:59:31.127 INFO:tasks.ceph.mds.a.smithi097.stdout:starting mds.a at 2023-06-23T00:59:31.137 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2023-06-23T00:59:31.139 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2023-06-23T00:59:31.153 INFO:tasks.ceph.mds.c.smithi097.stdout:starting mds.c at 2023-06-23T00:59:31.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1eb3f700 1 Processor -- start 2023-06-23T00:59:31.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1eb3f700 1 -- start start 2023-06-23T00:59:31.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1eb3f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac18156640 0x7fac18156a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1eb3f700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fac180ccef0 0x7fac180ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1eb3f700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac180cca60 con 0x7fac180cb990 2023-06-23T00:59:31.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1eb3f700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac180cbe50 con 0x7fac180ccef0 2023-06-23T00:59:31.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1eb3f700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac180cc130 con 0x7fac18156640 2023-06-23T00:59:31.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1e33e700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fac180ccef0 0x7fac180ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1d33c700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fac180cb990 0x7fac180afaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47190/0 (socket says 172.21.15.97:47190) 2023-06-23T00:59:31.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1d33c700 1 -- 172.21.15.97:0/343285738 learned_addr learned my addr 172.21.15.97:0/343285738 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:31.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1e33e700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fac180ccef0 0x7fac180ae9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57028/0 (socket says 172.21.15.97:57028) 2023-06-23T00:59:31.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1db3d700 1 --2- 172.21.15.97:0/343285738 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac18156640 0x7fac18156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1e33e700 1 -- 172.21.15.97:0/343285738 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac18156640 msgr2=0x7fac18156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:31.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1e33e700 1 --2- 172.21.15.97:0/343285738 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac18156640 0x7fac18156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1e33e700 1 -- 172.21.15.97:0/343285738 >> v1:172.21.15.97:6789/0 conn(0x7fac180cb990 legacy=0x7fac180afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1cb3b700 1 -- 172.21.15.97:0/343285738 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134906142 0 0) 0x7fac180cca60 con 0x7fac180cb990 2023-06-23T00:59:31.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1e33e700 1 -- 172.21.15.97:0/343285738 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac180cc410 con 0x7fac180ccef0 2023-06-23T00:59:31.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1e33e700 1 --2- 172.21.15.97:0/343285738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac180ccef0 0x7fac180ae9f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fac10009e60 tx=0x7fac10009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cd98478c5b56ae server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:31.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1cb3b700 1 -- 172.21.15.97:0/343285738 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1000e070 con 0x7fac180ccef0 2023-06-23T00:59:31.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1cb3b700 1 -- 172.21.15.97:0/343285738 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1000bb60 con 0x7fac180ccef0 2023-06-23T00:59:31.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.180+0000 7fac1cb3b700 1 -- 172.21.15.97:0/343285738 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10012430 con 0x7fac180ccef0 2023-06-23T00:59:31.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.184+0000 7fac1eb3f700 1 -- 172.21.15.97:0/343285738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac180ccef0 msgr2=0x7fac180ae9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.184+0000 7fac1eb3f700 1 --2- 172.21.15.97:0/343285738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac180ccef0 0x7fac180ae9f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fac10009e60 tx=0x7fac10009780 comp rx=0 tx=0).stop 2023-06-23T00:59:31.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.184+0000 7fac1eb3f700 1 -- 172.21.15.97:0/343285738 shutdown_connections 2023-06-23T00:59:31.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.184+0000 7fac1eb3f700 1 --2- 172.21.15.97:0/343285738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac180ccef0 0x7fac180ae9f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.184+0000 7fac1eb3f700 1 --2- 172.21.15.97:0/343285738 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac18156640 0x7fac18156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.184+0000 7fac1eb3f700 1 -- 172.21.15.97:0/343285738 >> 172.21.15.97:0/343285738 conn(0x7fac18069ff0 msgr2=0x7fac180ad2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:31.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.184+0000 7fac1eb3f700 1 -- 172.21.15.97:0/343285738 shutdown_connections 2023-06-23T00:59:31.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.184+0000 7fac1eb3f700 1 -- 172.21.15.97:0/343285738 wait complete. 2023-06-23T00:59:31.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.184+0000 7fac1eb3f700 1 Processor -- start 2023-06-23T00:59:31.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.184+0000 7fac1eb3f700 1 -- start start 2023-06-23T00:59:31.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1eb3f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac180cb990 0x7fac180c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1eb3f700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac180ccef0 0x7fac18158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1eb3f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac18156640 0x7fac18067ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1eb3f700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac18159cf0 con 0x7fac180ccef0 2023-06-23T00:59:31.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1eb3f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac180c2bc0 con 0x7fac180cb990 2023-06-23T00:59:31.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1eb3f700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac18159730 con 0x7fac18156640 2023-06-23T00:59:31.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1d33c700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac180ccef0 0x7fac18158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1d33c700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac180ccef0 0x7fac18158c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57038/0 (socket says 172.21.15.97:57038) 2023-06-23T00:59:31.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1d33c700 1 -- 172.21.15.97:0/1811575487 learned_addr learned my addr 172.21.15.97:0/1811575487 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:31.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1e33e700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac18156640 0x7fac18067ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1db3d700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac180cb990 0x7fac180c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1d33c700 1 -- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac18156640 msgr2=0x7fac18067ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1d33c700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac18156640 0x7fac18067ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1d33c700 1 -- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac180cb990 msgr2=0x7fac180c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1d33c700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac180cb990 0x7fac180c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1d33c700 1 -- 172.21.15.97:0/1811575487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac10009a20 con 0x7fac180ccef0 2023-06-23T00:59:31.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1e33e700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac18156640 0x7fac18067ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:31.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1d33c700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac180ccef0 0x7fac18158c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fac1400c810 tx=0x7fac14007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:31.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac0dffb700 1 -- 172.21.15.97:0/1811575487 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14005c00 con 0x7fac180ccef0 2023-06-23T00:59:31.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac0dffb700 1 -- 172.21.15.97:0/1811575487 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14005d60 con 0x7fac180ccef0 2023-06-23T00:59:31.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1eb3f700 1 -- 172.21.15.97:0/1811575487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac18159a10 con 0x7fac180ccef0 2023-06-23T00:59:31.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac0dffb700 1 -- 172.21.15.97:0/1811575487 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac140072e0 con 0x7fac180ccef0 2023-06-23T00:59:31.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1eb3f700 1 -- 172.21.15.97:0/1811575487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac18166b60 con 0x7fac180ccef0 2023-06-23T00:59:31.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.188+0000 7fac1eb3f700 1 -- 172.21.15.97:0/1811575487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac180c26b0 con 0x7fac180ccef0 2023-06-23T00:59:31.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.192+0000 7fac0dffb700 1 -- 172.21.15.97:0/1811575487 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fac14007690 con 0x7fac180ccef0 2023-06-23T00:59:31.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.192+0000 7fac0dffb700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fabfc0604b0 0x7fabfc062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.192+0000 7fac0dffb700 1 -- 172.21.15.97:0/1811575487 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fac1407b900 con 0x7fac180ccef0 2023-06-23T00:59:31.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.192+0000 7fac1db3d700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fabfc0604b0 0x7fabfc062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.192+0000 7fac1db3d700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fabfc0604b0 0x7fabfc062960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fac08009d10 tx=0x7fac080091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:31.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.196+0000 7fac0dffb700 1 -- 172.21.15.97:0/1811575487 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fac14049bd0 con 0x7fac180ccef0 2023-06-23T00:59:31.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.364+0000 7fac1eb3f700 1 -- 172.21.15.97:0/1811575487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac180c2d30 con 0x7fac180ccef0 2023-06-23T00:59:31.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.364+0000 7fac0dffb700 1 -- 172.21.15.97:0/1811575487 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+13660 (secure 0 0 0) 0x7fac14017020 con 0x7fac180ccef0 2023-06-23T00:59:31.372 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:59:31.372 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":21,"fsid":"6b52ccf4-99f4-48c9-9a8a-9a183942c228","created":"2023-06-23T00:59:11.989322+0000","modified":"2023-06-23T00:59:31.018269+0000","last_up_change":"2023-06-23T00:59:22.950578+0000","last_in_change":"2023-06-23T00:59:14.057374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T00:59:24.275869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T00:59:29.802618+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"291bc189-d5fb-482f-92d6-f7ecfb0a388c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":32817},{"type":"v1","addr":"172.21.15.97:6801","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":32817},{"type":"v1","addr":"172.21.15.97:6803","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":32817},{"type":"v1","addr":"172.21.15.97:6807","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":32817},{"type":"v1","addr":"172.21.15.97:6805","nonce":32817}]},"public_addr":"172.21.15.97:6801/32817","cluster_addr":"172.21.15.97:6803/32817","heartbeat_back_addr":"172.21.15.97:6807/32817","heartbeat_front_addr":"172.21.15.97:6805/32817","state":["exists","up"]},{"osd":1,"uuid":"693551b5-827b-4530-80b1-a836095efbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":32818},{"type":"v1","addr":"172.21.15.97:6817","nonce":32818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":32818},{"type":"v1","addr":"172.21.15.97:6819","nonce":32818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":32818},{"type":"v1","addr":"172.21.15.97:6823","nonce":32818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":32818},{"type":"v1","addr":"172.21.15.97:6821","nonce":32818}]},"public_addr":"172.21.15.97:6817/32818","cluster_addr":"172.21.15.97:6819/32818","heartbeat_back_addr":"172.21.15.97:6823/32818","heartbeat_front_addr":"172.21.15.97:6821/32818","state":["exists","up"]},{"osd":2,"uuid":"a100d026-e382-4e71-bda5-ffa59f6b596b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":32820},{"type":"v1","addr":"172.21.15.97:6825","nonce":32820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":32820},{"type":"v1","addr":"172.21.15.97:6827","nonce":32820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":32820},{"type":"v1","addr":"172.21.15.97:6831","nonce":32820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":32820},{"type":"v1","addr":"172.21.15.97:6829","nonce":32820}]},"public_addr":"172.21.15.97:6825/32820","cluster_addr":"172.21.15.97:6827/32820","heartbeat_back_addr":"172.21.15.97:6831/32820","heartbeat_front_addr":"172.21.15.97:6829/32820","state":["exists","up"]},{"osd":3,"uuid":"91783241-7821-458e-996f-a740274b18ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":32819},{"type":"v1","addr":"172.21.15.97:6809","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":32819},{"type":"v1","addr":"172.21.15.97:6811","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":32819},{"type":"v1","addr":"172.21.15.97:6815","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":32819},{"type":"v1","addr":"172.21.15.97:6813","nonce":32819}]},"public_addr":"172.21.15.97:6809/32819","cluster_addr":"172.21.15.97:6811/32819","heartbeat_back_addr":"172.21.15.97:6815/32819","heartbeat_front_addr":"172.21.15.97:6813/32819","state":["exists","up"]},{"osd":4,"uuid":"67c375d3-ec8f-4d1a-bea7-e47896705fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":32992},{"type":"v1","addr":"172.21.15.149:6801","nonce":32992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":32992},{"type":"v1","addr":"172.21.15.149:6803","nonce":32992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":32992},{"type":"v1","addr":"172.21.15.149:6807","nonce":32992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":32992},{"type":"v1","addr":"172.21.15.149:6805","nonce":32992}]},"public_addr":"172.21.15.149:6801/32992","cluster_addr":"172.21.15.149:6803/32992","heartbeat_back_addr":"172.21.15.149:6807/32992","heartbeat_front_addr":"172.21.15.149:6805/32992","state":["exists","up"]},{"osd":5,"uuid":"9de42b7c-cf51-4adf-9cc1-11c8d9863574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":32995},{"type":"v1","addr":"172.21.15.149:6809","nonce":32995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":32995},{"type":"v1","addr":"172.21.15.149:6811","nonce":32995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":32995},{"type":"v1","addr":"172.21.15.149:6815","nonce":32995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":32995},{"type":"v1","addr":"172.21.15.149:6813","nonce":32995}]},"public_addr":"172.21.15.149:6809/32995","cluster_addr":"172.21.15.149:6811/32995","heartbeat_back_addr":"172.21.15.149:6815/32995","heartbeat_front_addr":"172.21.15.149:6813/32995","state":["exists","up"]},{"osd":6,"uuid":"ffa4ef96-2528-45cb-b2c9-a6c671b234e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":32996},{"type":"v1","addr":"172.21.15.149:6825","nonce":32996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":32996},{"type":"v1","addr":"172.21.15.149:6827","nonce":32996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":32996},{"type":"v1","addr":"172.21.15.149:6831","nonce":32996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":32996},{"type":"v1","addr":"172.21.15.149:6829","nonce":32996}]},"public_addr":"172.21.15.149:6825/32996","cluster_addr":"172.21.15.149:6827/32996","heartbeat_back_addr":"172.21.15.149:6831/32996","heartbeat_front_addr":"172.21.15.149:6829/32996","state":["exists","up"]},{"osd":7,"uuid":"de849aa4-8494-4aeb-b1b6-6dd30458923c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":32994},{"type":"v1","addr":"172.21.15.149:6817","nonce":32994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":32994},{"type":"v1","addr":"172.21.15.149:6819","nonce":32994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":32994},{"type":"v1","addr":"172.21.15.149:6823","nonce":32994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":32994},{"type":"v1","addr":"172.21.15.149:6821","nonce":32994}]},"public_addr":"172.21.15.149:6817/32994","cluster_addr":"172.21.15.149:6819/32994","heartbeat_back_addr":"172.21.15.149:6823/32994","heartbeat_front_addr":"172.21.15.149:6821/32994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.027722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.241225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.289939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.257873+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.443455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.479909+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.521773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.560641+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T00:59:31.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.368+0000 7fac1eb3f700 1 -- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fabfc0604b0 msgr2=0x7fabfc062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.368+0000 7fac1eb3f700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fabfc0604b0 0x7fabfc062960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fac08009d10 tx=0x7fac080091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.368+0000 7fac1eb3f700 1 -- 172.21.15.97:0/1811575487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac180ccef0 msgr2=0x7fac18158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.368+0000 7fac1eb3f700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac180ccef0 0x7fac18158c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fac1400c810 tx=0x7fac14007db0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.368+0000 7fac1eb3f700 1 -- 172.21.15.97:0/1811575487 shutdown_connections 2023-06-23T00:59:31.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.368+0000 7fac1eb3f700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fabfc0604b0 0x7fabfc062960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.368+0000 7fac1eb3f700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac18156640 0x7fac18067ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.368+0000 7fac1eb3f700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fac180ccef0 0x7fac18158c90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.368+0000 7fac1eb3f700 1 --2- 172.21.15.97:0/1811575487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac180cb990 0x7fac180c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.368+0000 7fac1eb3f700 1 -- 172.21.15.97:0/1811575487 >> 172.21.15.97:0/1811575487 conn(0x7fac18069ff0 msgr2=0x7fac180ad1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:31.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.368+0000 7fac1eb3f700 1 -- 172.21.15.97:0/1811575487 shutdown_connections 2023-06-23T00:59:31.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.368+0000 7fac1eb3f700 1 -- 172.21.15.97:0/1811575487 wait complete. 2023-06-23T00:59:31.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T00:59:24.275869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T00:59:29.802618+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-06-23T00:59:31.387 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T00:59:31.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.484+0000 7fa8263be700 1 Processor -- start 2023-06-23T00:59:31.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.484+0000 7fa8263be700 1 -- start start 2023-06-23T00:59:31.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa8263be700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8200cfab0 0x7fa8200cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa8263be700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa82006c8e0 0x7fa820159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa8263be700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8200b2bb0 con 0x7fa8200b55e0 2023-06-23T00:59:31.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa8263be700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8200cd8d0 con 0x7fa82006c8e0 2023-06-23T00:59:31.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa8263be700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82006cd40 con 0x7fa8200cfab0 2023-06-23T00:59:31.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa825bbd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa82006c8e0 0x7fa820159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa8253bc700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8200cfab0 0x7fa8200cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa824bbb700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa8200b55e0 0x7fa8200b3040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.97:48856/0 (socket says 172.21.15.97:48856) 2023-06-23T00:59:31.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa824bbb700 1 -- 172.21.15.97:0/903852823 learned_addr learned my addr 172.21.15.97:0/903852823 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:31.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa8253bc700 1 -- 172.21.15.97:0/903852823 >> v2:172.21.15.149:3300/0 conn(0x7fa82006c8e0 msgr2=0x7fa820159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:31.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa8253bc700 1 --2- 172.21.15.97:0/903852823 >> v2:172.21.15.149:3300/0 conn(0x7fa82006c8e0 0x7fa820159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa8253bc700 1 -- 172.21.15.97:0/903852823 >> v1:172.21.15.149:6789/0 conn(0x7fa8200b55e0 legacy=0x7fa8200b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa8253bc700 1 -- 172.21.15.97:0/903852823 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8200b28b0 con 0x7fa8200cfab0 2023-06-23T00:59:31.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa825bbd700 1 --2- 172.21.15.97:0/903852823 >> v2:172.21.15.149:3300/0 conn(0x7fa82006c8e0 0x7fa820159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:31.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa8253bc700 1 --2- 172.21.15.97:0/903852823 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8200cfab0 0x7fa8200cfe80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa8140098e0 tx=0x7fa8140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19cc1ee1e8ceef71 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:31.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa813fff700 1 -- 172.21.15.97:0/903852823 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81400b640 con 0x7fa8200cfab0 2023-06-23T00:59:31.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa813fff700 1 -- 172.21.15.97:0/903852823 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81400b7a0 con 0x7fa8200cfab0 2023-06-23T00:59:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.488+0000 7fa813fff700 1 -- 172.21.15.97:0/903852823 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81400bb40 con 0x7fa8200cfab0 2023-06-23T00:59:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 -- 172.21.15.97:0/903852823 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8200cfab0 msgr2=0x7fa8200cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 --2- 172.21.15.97:0/903852823 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8200cfab0 0x7fa8200cfe80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa8140098e0 tx=0x7fa8140091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 -- 172.21.15.97:0/903852823 shutdown_connections 2023-06-23T00:59:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 --2- 172.21.15.97:0/903852823 >> v2:172.21.15.149:3300/0 conn(0x7fa82006c8e0 0x7fa820159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 --2- 172.21.15.97:0/903852823 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8200cfab0 0x7fa8200cfe80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 -- 172.21.15.97:0/903852823 >> 172.21.15.97:0/903852823 conn(0x7fa82006e260 msgr2=0x7fa82006c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:31.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 -- 172.21.15.97:0/903852823 shutdown_connections 2023-06-23T00:59:31.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 -- 172.21.15.97:0/903852823 wait complete. 2023-06-23T00:59:31.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 Processor -- start 2023-06-23T00:59:31.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 -- start start 2023-06-23T00:59:31.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa82006c8e0 0x7fa820147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8200b55e0 0x7fa820153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8200cfab0 0x7fa82014a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200b0600 con 0x7fa82006c8e0 2023-06-23T00:59:31.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200b08e0 con 0x7fa8200b55e0 2023-06-23T00:59:31.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8263be700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200b0bc0 con 0x7fa8200cfab0 2023-06-23T00:59:31.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.492+0000 7fa8253bc700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa82006c8e0 0x7fa820147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8253bc700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa82006c8e0 0x7fa820147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57050/0 (socket says 172.21.15.97:57050) 2023-06-23T00:59:31.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8253bc700 1 -- 172.21.15.97:0/449313701 learned_addr learned my addr 172.21.15.97:0/449313701 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:31.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa824bbb700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8200b55e0 0x7fa820153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa825bbd700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8200cfab0 0x7fa82014a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8253bc700 1 -- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8200cfab0 msgr2=0x7fa82014a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8253bc700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8200cfab0 0x7fa82014a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8253bc700 1 -- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8200b55e0 msgr2=0x7fa820153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8253bc700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8200b55e0 0x7fa820153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8253bc700 1 -- 172.21.15.97:0/449313701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa818009a20 con 0x7fa82006c8e0 2023-06-23T00:59:31.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8253bc700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa82006c8e0 0x7fa820147ff0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa820088600 tx=0x7fa814017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:31.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8117fa700 1 -- 172.21.15.97:0/449313701 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814000c40 con 0x7fa82006c8e0 2023-06-23T00:59:31.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8263be700 1 -- 172.21.15.97:0/449313701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa814009420 con 0x7fa82006c8e0 2023-06-23T00:59:31.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8117fa700 1 -- 172.21.15.97:0/449313701 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81400b910 con 0x7fa82006c8e0 2023-06-23T00:59:31.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8117fa700 1 -- 172.21.15.97:0/449313701 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814025420 con 0x7fa82006c8e0 2023-06-23T00:59:31.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8263be700 1 -- 172.21.15.97:0/449313701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8200b1180 con 0x7fa82006c8e0 2023-06-23T00:59:31.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.496+0000 7fa8263be700 1 -- 172.21.15.97:0/449313701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82004bc30 con 0x7fa82006c8e0 2023-06-23T00:59:31.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.500+0000 7fa8117fa700 1 -- 172.21.15.97:0/449313701 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fa814023070 con 0x7fa82006c8e0 2023-06-23T00:59:31.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.500+0000 7fa8117fa700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fa8040604b0 0x7fa804062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.500+0000 7fa8117fa700 1 -- 172.21.15.97:0/449313701 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa81407d940 con 0x7fa82006c8e0 2023-06-23T00:59:31.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.500+0000 7fa824bbb700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fa8040604b0 0x7fa804062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.500+0000 7fa824bbb700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fa8040604b0 0x7fa804062960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa820152aa0 tx=0x7fa81c007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:31.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.504+0000 7fa8117fa700 1 -- 172.21.15.97:0/449313701 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fa81404e2a0 con 0x7fa82006c8e0 2023-06-23T00:59:31.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.668+0000 7fa8263be700 1 -- 172.21.15.97:0/449313701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8200ccb10 con 0x7fa82006c8e0 2023-06-23T00:59:31.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.672+0000 7fa8117fa700 1 -- 172.21.15.97:0/449313701 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8140518c0 con 0x7fa82006c8e0 2023-06-23T00:59:31.677 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-06-23T00:59:31.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.672+0000 7fa8263be700 1 -- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fa8040604b0 msgr2=0x7fa804062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.672+0000 7fa8263be700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fa8040604b0 0x7fa804062960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa820152aa0 tx=0x7fa81c007eb0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.672+0000 7fa8263be700 1 -- 172.21.15.97:0/449313701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa82006c8e0 msgr2=0x7fa820147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.672+0000 7fa8263be700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa82006c8e0 0x7fa820147ff0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa820088600 tx=0x7fa814017000 comp rx=0 tx=0).stop 2023-06-23T00:59:31.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.672+0000 7fa8263be700 1 -- 172.21.15.97:0/449313701 shutdown_connections 2023-06-23T00:59:31.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.672+0000 7fa8263be700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fa8040604b0 0x7fa804062960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.672+0000 7fa8263be700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8200cfab0 0x7fa82014a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.672+0000 7fa8263be700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8200b55e0 0x7fa820153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.672+0000 7fa8263be700 1 --2- 172.21.15.97:0/449313701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa82006c8e0 0x7fa820147ff0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.672+0000 7fa8263be700 1 -- 172.21.15.97:0/449313701 >> 172.21.15.97:0/449313701 conn(0x7fa82006e260 msgr2=0x7fa8200b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:31.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.672+0000 7fa8263be700 1 -- 172.21.15.97:0/449313701 shutdown_connections 2023-06-23T00:59:31.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.672+0000 7fa8263be700 1 -- 172.21.15.97:0/449313701 wait complete. 2023-06-23T00:59:31.691 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T00:59:31.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.796+0000 7f83b13f0700 1 Processor -- start 2023-06-23T00:59:31.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.796+0000 7f83b13f0700 1 -- start start 2023-06-23T00:59:31.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b13f0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f83ac0b14c0 0x7f83ac0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b13f0700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83ac151240 0x7f83ac05e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b13f0700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ac0ca600 con 0x7f83ac157060 2023-06-23T00:59:31.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b13f0700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ac157560 con 0x7f83ac0b14c0 2023-06-23T00:59:31.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b13f0700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac157840 con 0x7f83ac151240 2023-06-23T00:59:31.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83a3fff700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f83ac157060 0x7f83ac150b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47204/0 (socket says 172.21.15.97:47204) 2023-06-23T00:59:31.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83a3fff700 1 -- 172.21.15.97:0/2498596296 learned_addr learned my addr 172.21.15.97:0/2498596296 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:31.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b0bef700 1 --2- 172.21.15.97:0/2498596296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83ac151240 0x7f83ac05e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83abfff700 1 --2- 172.21.15.97:0/2498596296 >> v2:172.21.15.149:3300/0 conn(0x7f83ac0b14c0 0x7f83ac0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83ab7fe700 1 -- 172.21.15.97:0/2498596296 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987124300 0 0) 0x7f83ac0ca600 con 0x7f83ac157060 2023-06-23T00:59:31.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83ab7fe700 1 -- 172.21.15.97:0/2498596296 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8398003570 con 0x7f83ac157060 2023-06-23T00:59:31.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b0bef700 1 -- 172.21.15.97:0/2498596296 >> v2:172.21.15.149:3300/0 conn(0x7f83ac0b14c0 msgr2=0x7f83ac0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:31.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b0bef700 1 --2- 172.21.15.97:0/2498596296 >> v2:172.21.15.149:3300/0 conn(0x7f83ac0b14c0 0x7f83ac0b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b0bef700 1 -- 172.21.15.97:0/2498596296 >> v1:172.21.15.97:6789/0 conn(0x7f83ac157060 legacy=0x7f83ac150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b0bef700 1 -- 172.21.15.97:0/2498596296 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac157b20 con 0x7f83ac151240 2023-06-23T00:59:31.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83abfff700 1 --2- 172.21.15.97:0/2498596296 >> v2:172.21.15.149:3300/0 conn(0x7f83ac0b14c0 0x7f83ac0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:31.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b0bef700 1 --2- 172.21.15.97:0/2498596296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83ac151240 0x7f83ac05e180 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009e60 tx=0x7f83a4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d3cf9c2676f7bd6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:31.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83ab7fe700 1 -- 172.21.15.97:0/2498596296 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a400e070 con 0x7f83ac151240 2023-06-23T00:59:31.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83ab7fe700 1 -- 172.21.15.97:0/2498596296 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a400bb60 con 0x7f83ac151240 2023-06-23T00:59:31.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83ab7fe700 1 -- 172.21.15.97:0/2498596296 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a4012430 con 0x7f83ac151240 2023-06-23T00:59:31.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b13f0700 1 -- 172.21.15.97:0/2498596296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83ac151240 msgr2=0x7f83ac05e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b13f0700 1 --2- 172.21.15.97:0/2498596296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83ac151240 0x7f83ac05e180 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009e60 tx=0x7f83a4009780 comp rx=0 tx=0).stop 2023-06-23T00:59:31.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b13f0700 1 -- 172.21.15.97:0/2498596296 shutdown_connections 2023-06-23T00:59:31.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b13f0700 1 --2- 172.21.15.97:0/2498596296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83ac151240 0x7f83ac05e180 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b13f0700 1 --2- 172.21.15.97:0/2498596296 >> v2:172.21.15.149:3300/0 conn(0x7f83ac0b14c0 0x7f83ac0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b13f0700 1 -- 172.21.15.97:0/2498596296 >> 172.21.15.97:0/2498596296 conn(0x7f83ac06c1d0 msgr2=0x7f83ac06c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:31.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b13f0700 1 -- 172.21.15.97:0/2498596296 shutdown_connections 2023-06-23T00:59:31.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.800+0000 7f83b13f0700 1 -- 172.21.15.97:0/2498596296 wait complete. 2023-06-23T00:59:31.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83b13f0700 1 Processor -- start 2023-06-23T00:59:31.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83b13f0700 1 -- start start 2023-06-23T00:59:31.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83b13f0700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ac0b14c0 0x7f83ac155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83b13f0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83ac151240 0x7f83ac16a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83b13f0700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83ac157060 0x7f83ac16ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83b13f0700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac154ee0 con 0x7f83ac0b14c0 2023-06-23T00:59:31.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83b13f0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac154030 con 0x7f83ac151240 2023-06-23T00:59:31.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83b13f0700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac1542d0 con 0x7f83ac157060 2023-06-23T00:59:31.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83abfff700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ac0b14c0 0x7f83ac155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83abfff700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ac0b14c0 0x7f83ac155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57062/0 (socket says 172.21.15.97:57062) 2023-06-23T00:59:31.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83abfff700 1 -- 172.21.15.97:0/2067464258 learned_addr learned my addr 172.21.15.97:0/2067464258 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:31.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83b0bef700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83ac157060 0x7f83ac16ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83a3fff700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83ac151240 0x7f83ac16a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83abfff700 1 -- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83ac157060 msgr2=0x7f83ac16ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83abfff700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83ac157060 0x7f83ac16ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83abfff700 1 -- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83ac151240 msgr2=0x7f83ac16a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83abfff700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83ac151240 0x7f83ac16a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.804+0000 7f83abfff700 1 -- 172.21.15.97:0/2067464258 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a4009a20 con 0x7f83ac0b14c0 2023-06-23T00:59:31.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.808+0000 7f83abfff700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ac0b14c0 0x7f83ac155370 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f839c00d860 tx=0x7f839c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:31.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.808+0000 7f83a8ff9700 1 -- 172.21.15.97:0/2067464258 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c0125f0 con 0x7f83ac0b14c0 2023-06-23T00:59:31.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.808+0000 7f83b13f0700 1 -- 172.21.15.97:0/2067464258 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ac1545b0 con 0x7f83ac0b14c0 2023-06-23T00:59:31.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.808+0000 7f83a8ff9700 1 -- 172.21.15.97:0/2067464258 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839c012750 con 0x7f83ac0b14c0 2023-06-23T00:59:31.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.808+0000 7f83a8ff9700 1 -- 172.21.15.97:0/2067464258 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c012af0 con 0x7f83ac0b14c0 2023-06-23T00:59:31.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.808+0000 7f83b13f0700 1 -- 172.21.15.97:0/2067464258 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ac154b70 con 0x7f83ac0b14c0 2023-06-23T00:59:31.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.808+0000 7f83b13f0700 1 -- 172.21.15.97:0/2067464258 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ac04b3f0 con 0x7f83ac0b14c0 2023-06-23T00:59:31.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.808+0000 7f83a8ff9700 1 -- 172.21.15.97:0/2067464258 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f839c013480 con 0x7f83ac0b14c0 2023-06-23T00:59:31.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.812+0000 7f83a8ff9700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f838c0604b0 0x7f838c062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:31.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.812+0000 7f83a8ff9700 1 -- 172.21.15.97:0/2067464258 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f839c07c7b0 con 0x7f83ac0b14c0 2023-06-23T00:59:31.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.812+0000 7f83a3fff700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f838c0604b0 0x7f838c062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:31.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.812+0000 7f83a3fff700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f838c0604b0 0x7f838c062960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0adf20 tx=0x7f8394009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:31.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.820+0000 7f83a8ff9700 1 -- 172.21.15.97:0/2067464258 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f839c04cfb0 con 0x7f83ac0b14c0 2023-06-23T00:59:31.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.976+0000 7f83b13f0700 1 -- 172.21.15.97:0/2067464258 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f83ac0b1ea0 con 0x7f83ac0b14c0 2023-06-23T00:59:31.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.980+0000 7f83a8ff9700 1 -- 172.21.15.97:0/2067464258 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f839c0505d0 con 0x7f83ac0b14c0 2023-06-23T00:59:31.988 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 8 2023-06-23T00:59:31.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.980+0000 7f83b13f0700 1 -- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f838c0604b0 msgr2=0x7f838c062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.980+0000 7f83b13f0700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f838c0604b0 0x7f838c062960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0adf20 tx=0x7f8394009040 comp rx=0 tx=0).stop 2023-06-23T00:59:31.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.980+0000 7f83b13f0700 1 -- 172.21.15.97:0/2067464258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ac0b14c0 msgr2=0x7f83ac155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:31.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.980+0000 7f83b13f0700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ac0b14c0 0x7f83ac155370 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f839c00d860 tx=0x7f839c008040 comp rx=0 tx=0).stop 2023-06-23T00:59:31.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.980+0000 7f83b13f0700 1 -- 172.21.15.97:0/2067464258 shutdown_connections 2023-06-23T00:59:31.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.980+0000 7f83b13f0700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f838c0604b0 0x7f838c062960 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.980+0000 7f83b13f0700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83ac157060 0x7f83ac16ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.980+0000 7f83b13f0700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83ac151240 0x7f83ac16a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.980+0000 7f83b13f0700 1 --2- 172.21.15.97:0/2067464258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ac0b14c0 0x7f83ac155370 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:31.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.980+0000 7f83b13f0700 1 -- 172.21.15.97:0/2067464258 >> 172.21.15.97:0/2067464258 conn(0x7f83ac06c1d0 msgr2=0x7f83ac06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:31.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.980+0000 7f83b13f0700 1 -- 172.21.15.97:0/2067464258 shutdown_connections 2023-06-23T00:59:31.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:31.980+0000 7f83b13f0700 1 -- 172.21.15.97:0/2067464258 wait complete. 2023-06-23T00:59:31.999 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T00:59:32.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.096+0000 7efca90ef700 1 Processor -- start 2023-06-23T00:59:32.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.096+0000 7efca90ef700 1 -- start start 2023-06-23T00:59:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca90ef700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efca4159a50 0x7efca40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca90ef700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efca414c920 0x7efca40c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca90ef700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca40ae870 con 0x7efca414c550 2023-06-23T00:59:32.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca90ef700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca40c87a0 con 0x7efca414c920 2023-06-23T00:59:32.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca90ef700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca40ae2b0 con 0x7efca4159a50 2023-06-23T00:59:32.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca3fff700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7efca414c550 0x7efca4159340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47210/0 (socket says 172.21.15.97:47210) 2023-06-23T00:59:32.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca3fff700 1 -- 172.21.15.97:0/3179603271 learned_addr learned my addr 172.21.15.97:0/3179603271 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:32.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca37fe700 1 --2- 172.21.15.97:0/3179603271 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efca4159a50 0x7efca40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca88ee700 1 --2- 172.21.15.97:0/3179603271 >> v2:172.21.15.149:3300/0 conn(0x7efca414c920 0x7efca40c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca2ffd700 1 -- 172.21.15.97:0/3179603271 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867744282 0 0) 0x7efc94001110 con 0x7efca414c550 2023-06-23T00:59:32.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca2ffd700 1 -- 172.21.15.97:0/3179603271 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc8c003570 con 0x7efca414c550 2023-06-23T00:59:32.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca37fe700 1 -- 172.21.15.97:0/3179603271 >> v2:172.21.15.149:3300/0 conn(0x7efca414c920 msgr2=0x7efca40c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca37fe700 1 --2- 172.21.15.97:0/3179603271 >> v2:172.21.15.149:3300/0 conn(0x7efca414c920 0x7efca40c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca37fe700 1 -- 172.21.15.97:0/3179603271 >> v1:172.21.15.97:6789/0 conn(0x7efca414c550 legacy=0x7efca4159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca2ffd700 1 -- 172.21.15.97:0/3179603271 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 320495056 0 0) 0x7efc8c003570 con 0x7efca414c550 2023-06-23T00:59:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca37fe700 1 -- 172.21.15.97:0/3179603271 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca40ae590 con 0x7efca4159a50 2023-06-23T00:59:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca88ee700 1 --2- 172.21.15.97:0/3179603271 >> v2:172.21.15.149:3300/0 conn(0x7efca414c920 0x7efca40c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca37fe700 1 --2- 172.21.15.97:0/3179603271 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efca4159a50 0x7efca40c8110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efc980098e0 tx=0x7efc980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=146c8b297299e0f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca2ffd700 1 -- 172.21.15.97:0/3179603271 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94001600 con 0x7efca4159a50 2023-06-23T00:59:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca2ffd700 1 -- 172.21.15.97:0/3179603271 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc98011420 con 0x7efca4159a50 2023-06-23T00:59:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.100+0000 7efca2ffd700 1 -- 172.21.15.97:0/3179603271 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc980117a0 con 0x7efca4159a50 2023-06-23T00:59:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 -- 172.21.15.97:0/3179603271 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efca4159a50 msgr2=0x7efca40c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 --2- 172.21.15.97:0/3179603271 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efca4159a50 0x7efca40c8110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efc980098e0 tx=0x7efc980091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 -- 172.21.15.97:0/3179603271 shutdown_connections 2023-06-23T00:59:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 --2- 172.21.15.97:0/3179603271 >> v2:172.21.15.149:3300/0 conn(0x7efca414c920 0x7efca40c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 --2- 172.21.15.97:0/3179603271 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efca4159a50 0x7efca40c8110 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 -- 172.21.15.97:0/3179603271 >> 172.21.15.97:0/3179603271 conn(0x7efca40cc9b0 msgr2=0x7efca40c8910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 -- 172.21.15.97:0/3179603271 shutdown_connections 2023-06-23T00:59:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 -- 172.21.15.97:0/3179603271 wait complete. 2023-06-23T00:59:32.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 Processor -- start 2023-06-23T00:59:32.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 -- start start 2023-06-23T00:59:32.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efca414c550 0x7efca40c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca414c920 0x7efca40aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca4159a50 0x7efca40af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca414d210 con 0x7efca4159a50 2023-06-23T00:59:32.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca414cee0 con 0x7efca414c920 2023-06-23T00:59:32.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca90ef700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca40c5710 con 0x7efca414c550 2023-06-23T00:59:32.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca88ee700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca4159a50 0x7efca40af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca88ee700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca4159a50 0x7efca40af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57064/0 (socket says 172.21.15.97:57064) 2023-06-23T00:59:32.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca88ee700 1 -- 172.21.15.97:0/3751867167 learned_addr learned my addr 172.21.15.97:0/3751867167 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:32.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca37fe700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca414c920 0x7efca40aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca3fff700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efca414c550 0x7efca40c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca88ee700 1 -- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efca414c550 msgr2=0x7efca40c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca88ee700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efca414c550 0x7efca40c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca88ee700 1 -- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca414c920 msgr2=0x7efca40aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca88ee700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca414c920 0x7efca40aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca88ee700 1 -- 172.21.15.97:0/3751867167 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c009a20 con 0x7efca4159a50 2023-06-23T00:59:32.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca37fe700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca414c920 0x7efca40aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:32.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.104+0000 7efca3fff700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efca414c550 0x7efca40c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:32.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.108+0000 7efca88ee700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca4159a50 0x7efca40af180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009f20 tx=0x7efc9c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:32.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.108+0000 7efc8bfff700 1 -- 172.21.15.97:0/3751867167 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c00cb70 con 0x7efca4159a50 2023-06-23T00:59:32.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.108+0000 7efc8bfff700 1 -- 172.21.15.97:0/3751867167 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c00f040 con 0x7efca4159a50 2023-06-23T00:59:32.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.108+0000 7efca90ef700 1 -- 172.21.15.97:0/3751867167 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc98009420 con 0x7efca4159a50 2023-06-23T00:59:32.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.108+0000 7efc8bfff700 1 -- 172.21.15.97:0/3751867167 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c014480 con 0x7efca4159a50 2023-06-23T00:59:32.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.108+0000 7efca90ef700 1 -- 172.21.15.97:0/3751867167 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca40c5cd0 con 0x7efca4159a50 2023-06-23T00:59:32.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.108+0000 7efca90ef700 1 -- 172.21.15.97:0/3751867167 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca406a420 con 0x7efca4159a50 2023-06-23T00:59:32.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.108+0000 7efc8bfff700 1 -- 172.21.15.97:0/3751867167 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7efc9c003020 con 0x7efca4159a50 2023-06-23T00:59:32.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.108+0000 7efc8bfff700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7efc900604b0 0x7efc90062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.108+0000 7efc8bfff700 1 -- 172.21.15.97:0/3751867167 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5206+0+0 (secure 0 0 0) 0x7efc9c07cd90 con 0x7efca4159a50 2023-06-23T00:59:32.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.112+0000 7efca3fff700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7efc900604b0 0x7efc90062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.112+0000 7efca3fff700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7efc900604b0 0x7efc90062960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc94004950 tx=0x7efc94001710 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:32.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.116+0000 7efc8bfff700 1 -- 172.21.15.97:0/3751867167 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7efc9c04d590 con 0x7efca4159a50 2023-06-23T00:59:32.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.312+0000 7efca90ef700 1 -- 172.21.15.97:0/3751867167 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efca404bc30 con 0x7efca4159a50 2023-06-23T00:59:32.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.312+0000 7efc8bfff700 1 -- 172.21.15.97:0/3751867167 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7efc9c018de0 con 0x7efca4159a50 2023-06-23T00:59:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:59:32.320 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6833/361425768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":361425768},{"type":"v1","addr":"172.21.15.97:6833","nonce":361425768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2295858768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2295858768},{"type":"v1","addr":"172.21.15.149:6835","nonce":2295858768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3038582563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3038582563},{"type":"v1","addr":"172.21.15.149:6837","nonce":3038582563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/163806060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":163806060},{"type":"v1","addr":"172.21.15.97:6835","nonce":163806060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-23T00:59:32.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.316+0000 7efca90ef700 1 -- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7efc900604b0 msgr2=0x7efc90062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.316+0000 7efca90ef700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7efc900604b0 0x7efc90062960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc94004950 tx=0x7efc94001710 comp rx=0 tx=0).stop 2023-06-23T00:59:32.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.316+0000 7efca90ef700 1 -- 172.21.15.97:0/3751867167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca4159a50 msgr2=0x7efca40af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.316+0000 7efca90ef700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca4159a50 0x7efca40af180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009f20 tx=0x7efc9c00b040 comp rx=0 tx=0).stop 2023-06-23T00:59:32.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.316+0000 7efca90ef700 1 -- 172.21.15.97:0/3751867167 shutdown_connections 2023-06-23T00:59:32.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.316+0000 7efca90ef700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7efc900604b0 0x7efc90062960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.316+0000 7efca90ef700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca4159a50 0x7efca40af180 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.316+0000 7efca90ef700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca414c920 0x7efca40aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.316+0000 7efca90ef700 1 --2- 172.21.15.97:0/3751867167 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efca414c550 0x7efca40c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.316+0000 7efca90ef700 1 -- 172.21.15.97:0/3751867167 >> 172.21.15.97:0/3751867167 conn(0x7efca40cc9b0 msgr2=0x7efca40c13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:32.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.316+0000 7efca90ef700 1 -- 172.21.15.97:0/3751867167 shutdown_connections 2023-06-23T00:59:32.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.316+0000 7efca90ef700 1 -- 172.21.15.97:0/3751867167 wait complete. 2023-06-23T00:59:32.324 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 3 2023-06-23T00:59:32.334 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T00:59:32.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.432+0000 7f6045425700 1 Processor -- start 2023-06-23T00:59:32.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.432+0000 7f6045425700 1 -- start start 2023-06-23T00:59:32.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6045425700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f60400aed20 0x7f60400cf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6045425700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604006c1d0 0x7f604006c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6045425700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60400ce090 con 0x7f60400ca860 2023-06-23T00:59:32.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6045425700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6040159160 con 0x7f60400aed20 2023-06-23T00:59:32.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6045425700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60400ceef0 con 0x7f604006c1d0 2023-06-23T00:59:32.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f603ffff700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f60400aed20 0x7f60400cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6044c24700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f60400ca860 0x7f60400cacd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47218/0 (socket says 172.21.15.97:47218) 2023-06-23T00:59:32.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6044c24700 1 -- 172.21.15.97:0/3663050937 learned_addr learned my addr 172.21.15.97:0/3663050937 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:32.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f603f7fe700 1 --2- 172.21.15.97:0/3663050937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604006c1d0 0x7f604006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f603effd700 1 -- 172.21.15.97:0/3663050937 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661948670 0 0) 0x7f60400ce090 con 0x7f60400ca860 2023-06-23T00:59:32.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f603ffff700 1 -- 172.21.15.97:0/3663050937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604006c1d0 msgr2=0x7f604006c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:32.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f603ffff700 1 --2- 172.21.15.97:0/3663050937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604006c1d0 0x7f604006c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f603ffff700 1 -- 172.21.15.97:0/3663050937 >> v1:172.21.15.97:6789/0 conn(0x7f60400ca860 legacy=0x7f60400cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f603ffff700 1 -- 172.21.15.97:0/3663050937 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604006cb60 con 0x7f60400aed20 2023-06-23T00:59:32.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f603ffff700 1 --2- 172.21.15.97:0/3663050937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60400aed20 0x7f60400cf380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60300098e0 tx=0x7f60300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcb76f11aaf0b0f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:32.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f603effd700 1 -- 172.21.15.97:0/3663050937 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603000b640 con 0x7f60400aed20 2023-06-23T00:59:32.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f603effd700 1 -- 172.21.15.97:0/3663050937 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603000b7a0 con 0x7f60400aed20 2023-06-23T00:59:32.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f603effd700 1 -- 172.21.15.97:0/3663050937 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603000bb40 con 0x7f60400aed20 2023-06-23T00:59:32.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6045425700 1 -- 172.21.15.97:0/3663050937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60400aed20 msgr2=0x7f60400cf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6045425700 1 --2- 172.21.15.97:0/3663050937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60400aed20 0x7f60400cf380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60300098e0 tx=0x7f60300091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6045425700 1 -- 172.21.15.97:0/3663050937 shutdown_connections 2023-06-23T00:59:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6045425700 1 --2- 172.21.15.97:0/3663050937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604006c1d0 0x7f604006c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6045425700 1 --2- 172.21.15.97:0/3663050937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60400aed20 0x7f60400cf380 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6045425700 1 -- 172.21.15.97:0/3663050937 >> 172.21.15.97:0/3663050937 conn(0x7f604006e1c0 msgr2=0x7f60400cfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6045425700 1 -- 172.21.15.97:0/3663050937 shutdown_connections 2023-06-23T00:59:32.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.436+0000 7f6045425700 1 -- 172.21.15.97:0/3663050937 wait complete. 2023-06-23T00:59:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6045425700 1 Processor -- start 2023-06-23T00:59:32.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6045425700 1 -- start start 2023-06-23T00:59:32.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6045425700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604006c1d0 0x7f60400b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6045425700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60400aed20 0x7f604014a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6045425700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60400ca860 0x7f604015ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6045425700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400b40a0 con 0x7f60400aed20 2023-06-23T00:59:32.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6045425700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604014abb0 con 0x7f60400ca860 2023-06-23T00:59:32.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6045425700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60400b4ee0 con 0x7f604006c1d0 2023-06-23T00:59:32.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f603f7fe700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60400aed20 0x7f604014a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f603f7fe700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60400aed20 0x7f604014a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57090/0 (socket says 172.21.15.97:57090) 2023-06-23T00:59:32.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f603f7fe700 1 -- 172.21.15.97:0/3170066527 learned_addr learned my addr 172.21.15.97:0/3170066527 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:32.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f603ffff700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604006c1d0 0x7f60400b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6044c24700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60400ca860 0x7f604015ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f603f7fe700 1 -- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604006c1d0 msgr2=0x7f60400b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f603f7fe700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604006c1d0 0x7f60400b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f603f7fe700 1 -- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60400ca860 msgr2=0x7f604015ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f603f7fe700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60400ca860 0x7f604015ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f603f7fe700 1 -- 172.21.15.97:0/3170066527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030009420 con 0x7f60400aed20 2023-06-23T00:59:32.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f603f7fe700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60400aed20 0x7f604014a670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6028009ee0 tx=0x7f602800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:32.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6037fff700 1 -- 172.21.15.97:0/3170066527 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800cc20 con 0x7f60400aed20 2023-06-23T00:59:32.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6037fff700 1 -- 172.21.15.97:0/3170066527 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602800f040 con 0x7f60400aed20 2023-06-23T00:59:32.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6045425700 1 -- 172.21.15.97:0/3170066527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60400b42d0 con 0x7f60400aed20 2023-06-23T00:59:32.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6037fff700 1 -- 172.21.15.97:0/3170066527 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028014480 con 0x7f60400aed20 2023-06-23T00:59:32.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.440+0000 7f6045425700 1 -- 172.21.15.97:0/3170066527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60400b4890 con 0x7f60400aed20 2023-06-23T00:59:32.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.444+0000 7f6045425700 1 -- 172.21.15.97:0/3170066527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60400b5050 con 0x7f60400aed20 2023-06-23T00:59:32.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.444+0000 7f6037fff700 1 -- 172.21.15.97:0/3170066527 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f60280147f0 con 0x7f60400aed20 2023-06-23T00:59:32.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.444+0000 7f6037fff700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f60200604b0 0x7f6020062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.444+0000 7f6037fff700 1 -- 172.21.15.97:0/3170066527 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f602807d150 con 0x7f60400aed20 2023-06-23T00:59:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.444+0000 7f603ffff700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f60200604b0 0x7f6020062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.448+0000 7f603ffff700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f60200604b0 0x7f6020062960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60300093f0 tx=0x7f6030017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:32.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.456+0000 7f6037fff700 1 -- 172.21.15.97:0/3170066527 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f602804d9f0 con 0x7f60400aed20 2023-06-23T00:59:32.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.620+0000 7f6045425700 1 -- 172.21.15.97:0/3170066527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60400ce2e0 con 0x7f60400aed20 2023-06-23T00:59:32.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.620+0000 7f6037fff700 1 -- 172.21.15.97:0/3170066527 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+13647 (secure 0 0 0) 0x7f6028051010 con 0x7f60400aed20 2023-06-23T00:59:32.627 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:59:32.628 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"6b52ccf4-99f4-48c9-9a8a-9a183942c228","created":"2023-06-23T00:59:11.989322+0000","modified":"2023-06-23T00:59:32.027306+0000","last_up_change":"2023-06-23T00:59:22.950578+0000","last_in_change":"2023-06-23T00:59:14.057374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T00:59:24.275869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T00:59:29.802618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"291bc189-d5fb-482f-92d6-f7ecfb0a388c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":32817},{"type":"v1","addr":"172.21.15.97:6801","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":32817},{"type":"v1","addr":"172.21.15.97:6803","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":32817},{"type":"v1","addr":"172.21.15.97:6807","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":32817},{"type":"v1","addr":"172.21.15.97:6805","nonce":32817}]},"public_addr":"172.21.15.97:6801/32817","cluster_addr":"172.21.15.97:6803/32817","heartbeat_back_addr":"172.21.15.97:6807/32817","heartbeat_front_addr":"172.21.15.97:6805/32817","state":["exists","up"]},{"osd":1,"uuid":"693551b5-827b-4530-80b1-a836095efbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":32818},{"type":"v1","addr":"172.21.15.97:6817","nonce":32818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":32818},{"type":"v1","addr":"172.21.15.97:6819","nonce":32818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":32818},{"type":"v1","addr":"172.21.15.97:6823","nonce":32818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":32818},{"type":"v1","addr":"172.21.15.97:6821","nonce":32818}]},"public_addr":"172.21.15.97:6817/32818","cluster_addr":"172.21.15.97:6819/32818","heartbeat_back_addr":"172.21.15.97:6823/32818","heartbeat_front_addr":"172.21.15.97:6821/32818","state":["exists","up"]},{"osd":2,"uuid":"a100d026-e382-4e71-bda5-ffa59f6b596b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":32820},{"type":"v1","addr":"172.21.15.97:6825","nonce":32820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":32820},{"type":"v1","addr":"172.21.15.97:6827","nonce":32820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":32820},{"type":"v1","addr":"172.21.15.97:6831","nonce":32820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":32820},{"type":"v1","addr":"172.21.15.97:6829","nonce":32820}]},"public_addr":"172.21.15.97:6825/32820","cluster_addr":"172.21.15.97:6827/32820","heartbeat_back_addr":"172.21.15.97:6831/32820","heartbeat_front_addr":"172.21.15.97:6829/32820","state":["exists","up"]},{"osd":3,"uuid":"91783241-7821-458e-996f-a740274b18ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":32819},{"type":"v1","addr":"172.21.15.97:6809","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":32819},{"type":"v1","addr":"172.21.15.97:6811","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":32819},{"type":"v1","addr":"172.21.15.97:6815","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":32819},{"type":"v1","addr":"172.21.15.97:6813","nonce":32819}]},"public_addr":"172.21.15.97:6809/32819","cluster_addr":"172.21.15.97:6811/32819","heartbeat_back_addr":"172.21.15.97:6815/32819","heartbeat_front_addr":"172.21.15.97:6813/32819","state":["exists","up"]},{"osd":4,"uuid":"67c375d3-ec8f-4d1a-bea7-e47896705fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":32992},{"type":"v1","addr":"172.21.15.149:6801","nonce":32992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":32992},{"type":"v1","addr":"172.21.15.149:6803","nonce":32992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":32992},{"type":"v1","addr":"172.21.15.149:6807","nonce":32992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":32992},{"type":"v1","addr":"172.21.15.149:6805","nonce":32992}]},"public_addr":"172.21.15.149:6801/32992","cluster_addr":"172.21.15.149:6803/32992","heartbeat_back_addr":"172.21.15.149:6807/32992","heartbeat_front_addr":"172.21.15.149:6805/32992","state":["exists","up"]},{"osd":5,"uuid":"9de42b7c-cf51-4adf-9cc1-11c8d9863574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":32995},{"type":"v1","addr":"172.21.15.149:6809","nonce":32995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":32995},{"type":"v1","addr":"172.21.15.149:6811","nonce":32995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":32995},{"type":"v1","addr":"172.21.15.149:6815","nonce":32995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":32995},{"type":"v1","addr":"172.21.15.149:6813","nonce":32995}]},"public_addr":"172.21.15.149:6809/32995","cluster_addr":"172.21.15.149:6811/32995","heartbeat_back_addr":"172.21.15.149:6815/32995","heartbeat_front_addr":"172.21.15.149:6813/32995","state":["exists","up"]},{"osd":6,"uuid":"ffa4ef96-2528-45cb-b2c9-a6c671b234e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":32996},{"type":"v1","addr":"172.21.15.149:6825","nonce":32996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":32996},{"type":"v1","addr":"172.21.15.149:6827","nonce":32996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":32996},{"type":"v1","addr":"172.21.15.149:6831","nonce":32996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":32996},{"type":"v1","addr":"172.21.15.149:6829","nonce":32996}]},"public_addr":"172.21.15.149:6825/32996","cluster_addr":"172.21.15.149:6827/32996","heartbeat_back_addr":"172.21.15.149:6831/32996","heartbeat_front_addr":"172.21.15.149:6829/32996","state":["exists","up"]},{"osd":7,"uuid":"de849aa4-8494-4aeb-b1b6-6dd30458923c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":32994},{"type":"v1","addr":"172.21.15.149:6817","nonce":32994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":32994},{"type":"v1","addr":"172.21.15.149:6819","nonce":32994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":32994},{"type":"v1","addr":"172.21.15.149:6823","nonce":32994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":32994},{"type":"v1","addr":"172.21.15.149:6821","nonce":32994}]},"public_addr":"172.21.15.149:6817/32994","cluster_addr":"172.21.15.149:6819/32994","heartbeat_back_addr":"172.21.15.149:6823/32994","heartbeat_front_addr":"172.21.15.149:6821/32994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.027722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.241225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.289939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.257873+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.443455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.479909+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.521773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.560641+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T00:59:32.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.624+0000 7f6045425700 1 -- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f60200604b0 msgr2=0x7f6020062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.624+0000 7f6045425700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f60200604b0 0x7f6020062960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60300093f0 tx=0x7f6030017000 comp rx=0 tx=0).stop 2023-06-23T00:59:32.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.624+0000 7f6045425700 1 -- 172.21.15.97:0/3170066527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60400aed20 msgr2=0x7f604014a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.624+0000 7f6045425700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60400aed20 0x7f604014a670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6028009ee0 tx=0x7f602800b040 comp rx=0 tx=0).stop 2023-06-23T00:59:32.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.624+0000 7f6045425700 1 -- 172.21.15.97:0/3170066527 shutdown_connections 2023-06-23T00:59:32.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.624+0000 7f6045425700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f60200604b0 0x7f6020062960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.624+0000 7f6045425700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60400ca860 0x7f604015ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.624+0000 7f6045425700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60400aed20 0x7f604014a670 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.624+0000 7f6045425700 1 --2- 172.21.15.97:0/3170066527 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f604006c1d0 0x7f60400b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.624+0000 7f6045425700 1 -- 172.21.15.97:0/3170066527 >> 172.21.15.97:0/3170066527 conn(0x7f604006e1c0 msgr2=0x7f6040156ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:32.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.624+0000 7f6045425700 1 -- 172.21.15.97:0/3170066527 shutdown_connections 2023-06-23T00:59:32.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.624+0000 7f6045425700 1 -- 172.21.15.97:0/3170066527 wait complete. 2023-06-23T00:59:32.646 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T00:59:24.275869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T00:59:29.802618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-06-23T00:59:32.647 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T00:59:32.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.756+0000 7fdb2e3d8700 1 Processor -- start 2023-06-23T00:59:32.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.756+0000 7fdb2e3d8700 1 -- start start 2023-06-23T00:59:32.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2e3d8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdb280ccba0 0x7fdb28156a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2e3d8700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb280afde0 0x7fdb280ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2e3d8700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb280cc710 con 0x7fdb28156670 2023-06-23T00:59:32.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2e3d8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb280b0220 con 0x7fdb280ccba0 2023-06-23T00:59:32.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2e3d8700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280cbb00 con 0x7fdb280afde0 2023-06-23T00:59:32.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2d3d6700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdb28156670 0x7fdb280cb320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47234/0 (socket says 172.21.15.97:47234) 2023-06-23T00:59:32.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2d3d6700 1 -- 172.21.15.97:0/3771905376 learned_addr learned my addr 172.21.15.97:0/3771905376 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:32.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2cbd5700 1 --2- 172.21.15.97:0/3771905376 >> v2:172.21.15.149:3300/0 conn(0x7fdb280ccba0 0x7fdb28156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2dbd7700 1 --2- 172.21.15.97:0/3771905376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb280afde0 0x7fdb280ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb1bfff700 1 -- 172.21.15.97:0/3771905376 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116548983 0 0) 0x7fdb280cc710 con 0x7fdb28156670 2023-06-23T00:59:32.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb1bfff700 1 -- 172.21.15.97:0/3771905376 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb14003570 con 0x7fdb28156670 2023-06-23T00:59:32.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2cbd5700 1 -- 172.21.15.97:0/3771905376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb280afde0 msgr2=0x7fdb280ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:32.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2cbd5700 1 --2- 172.21.15.97:0/3771905376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb280afde0 0x7fdb280ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2cbd5700 1 -- 172.21.15.97:0/3771905376 >> v1:172.21.15.97:6789/0 conn(0x7fdb28156670 legacy=0x7fdb280cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2cbd5700 1 -- 172.21.15.97:0/3771905376 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb280cbde0 con 0x7fdb280ccba0 2023-06-23T00:59:32.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2cbd5700 1 --2- 172.21.15.97:0/3771905376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb280ccba0 0x7fdb28156a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0098e0 tx=0x7fdb1c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d665bae809d718 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:32.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb1bfff700 1 -- 172.21.15.97:0/3771905376 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c011630 con 0x7fdb280ccba0 2023-06-23T00:59:32.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb1bfff700 1 -- 172.21.15.97:0/3771905376 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c011790 con 0x7fdb280ccba0 2023-06-23T00:59:32.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb1bfff700 1 -- 172.21.15.97:0/3771905376 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c011b30 con 0x7fdb280ccba0 2023-06-23T00:59:32.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/3771905376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb280ccba0 msgr2=0x7fdb28156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2e3d8700 1 --2- 172.21.15.97:0/3771905376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb280ccba0 0x7fdb28156a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0098e0 tx=0x7fdb1c0091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/3771905376 shutdown_connections 2023-06-23T00:59:32.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2e3d8700 1 --2- 172.21.15.97:0/3771905376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb280afde0 0x7fdb280ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2e3d8700 1 --2- 172.21.15.97:0/3771905376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb280ccba0 0x7fdb28156a40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/3771905376 >> 172.21.15.97:0/3771905376 conn(0x7fdb280ca260 msgr2=0x7fdb280ca660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:32.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/3771905376 shutdown_connections 2023-06-23T00:59:32.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.760+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/3771905376 wait complete. 2023-06-23T00:59:32.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2e3d8700 1 Processor -- start 2023-06-23T00:59:32.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2e3d8700 1 -- start start 2023-06-23T00:59:32.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2e3d8700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb280afde0 0x7fdb280c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2e3d8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb280ccba0 0x7fdb280c1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2e3d8700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb28156670 0x7fdb2816a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2e3d8700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280c32c0 con 0x7fdb280afde0 2023-06-23T00:59:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2e3d8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280c28f0 con 0x7fdb280ccba0 2023-06-23T00:59:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2e3d8700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280c1ce0 con 0x7fdb28156670 2023-06-23T00:59:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2d3d6700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb280afde0 0x7fdb280c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2d3d6700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb280afde0 0x7fdb280c2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57098/0 (socket says 172.21.15.97:57098) 2023-06-23T00:59:32.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2d3d6700 1 -- 172.21.15.97:0/1406262462 learned_addr learned my addr 172.21.15.97:0/1406262462 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:32.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2cbd5700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb280ccba0 0x7fdb280c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2dbd7700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb28156670 0x7fdb2816a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2d3d6700 1 -- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb28156670 msgr2=0x7fdb2816a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2d3d6700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb28156670 0x7fdb2816a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2d3d6700 1 -- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb280ccba0 msgr2=0x7fdb280c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2d3d6700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb280ccba0 0x7fdb280c1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2d3d6700 1 -- 172.21.15.97:0/1406262462 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c009420 con 0x7fdb280afde0 2023-06-23T00:59:32.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb2d3d6700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb280afde0 0x7fdb280c2d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400c7c0 tx=0x7fdb24007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:32.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb197fa700 1 -- 172.21.15.97:0/1406262462 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb24005cd0 con 0x7fdb280afde0 2023-06-23T00:59:32.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.764+0000 7fdb197fa700 1 -- 172.21.15.97:0/1406262462 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb24005e30 con 0x7fdb280afde0 2023-06-23T00:59:32.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.768+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/1406262462 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb280c1fc0 con 0x7fdb280afde0 2023-06-23T00:59:32.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.768+0000 7fdb197fa700 1 -- 172.21.15.97:0/1406262462 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb24007320 con 0x7fdb280afde0 2023-06-23T00:59:32.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.768+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/1406262462 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb280c2580 con 0x7fdb280afde0 2023-06-23T00:59:32.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.768+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/1406262462 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb28068ee0 con 0x7fdb280afde0 2023-06-23T00:59:32.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.768+0000 7fdb197fa700 1 -- 172.21.15.97:0/1406262462 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fdb24007690 con 0x7fdb280afde0 2023-06-23T00:59:32.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.772+0000 7fdb197fa700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fdb0c0604b0 0x7fdb0c062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:32.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.772+0000 7fdb197fa700 1 -- 172.21.15.97:0/1406262462 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdb2407baf0 con 0x7fdb280afde0 2023-06-23T00:59:32.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.772+0000 7fdb2cbd5700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fdb0c0604b0 0x7fdb0c062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:32.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.772+0000 7fdb2cbd5700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fdb0c0604b0 0x7fdb0c062960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0091e0 tx=0x7fdb1c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:32.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.776+0000 7fdb197fa700 1 -- 172.21.15.97:0/1406262462 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fdb2404c390 con 0x7fdb280afde0 2023-06-23T00:59:32.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.940+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/1406262462 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb280cc0c0 con 0x7fdb280afde0 2023-06-23T00:59:32.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.940+0000 7fdb197fa700 1 -- 172.21.15.97:0/1406262462 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb240170a0 con 0x7fdb280afde0 2023-06-23T00:59:32.948 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-06-23T00:59:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.944+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fdb0c0604b0 msgr2=0x7fdb0c062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.944+0000 7fdb2e3d8700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fdb0c0604b0 0x7fdb0c062960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0091e0 tx=0x7fdb1c017000 comp rx=0 tx=0).stop 2023-06-23T00:59:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.944+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/1406262462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb280afde0 msgr2=0x7fdb280c2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.944+0000 7fdb2e3d8700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb280afde0 0x7fdb280c2d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400c7c0 tx=0x7fdb24007e00 comp rx=0 tx=0).stop 2023-06-23T00:59:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.944+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/1406262462 shutdown_connections 2023-06-23T00:59:32.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.944+0000 7fdb2e3d8700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fdb0c0604b0 0x7fdb0c062960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.944+0000 7fdb2e3d8700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb28156670 0x7fdb2816a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.944+0000 7fdb2e3d8700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb280ccba0 0x7fdb280c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.944+0000 7fdb2e3d8700 1 --2- 172.21.15.97:0/1406262462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb280afde0 0x7fdb280c2d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.944+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/1406262462 >> 172.21.15.97:0/1406262462 conn(0x7fdb280ca260 msgr2=0x7fdb28155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.944+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/1406262462 shutdown_connections 2023-06-23T00:59:32.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:32.944+0000 7fdb2e3d8700 1 -- 172.21.15.97:0/1406262462 wait complete. 2023-06-23T00:59:32.961 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T00:59:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.060+0000 7f1b80f3e700 1 Processor -- start 2023-06-23T00:59:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.060+0000 7f1b80f3e700 1 -- start start 2023-06-23T00:59:33.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b80f3e700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c156570 0x7f1b7c156940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b80f3e700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b7c15b120 0x7f1b7c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b80f3e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7c0aec20 con 0x7f1b7c15a450 2023-06-23T00:59:33.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b80f3e700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7c0ca120 con 0x7f1b7c15b120 2023-06-23T00:59:33.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b80f3e700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c0ca400 con 0x7f1b7c156570 2023-06-23T00:59:33.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b73fff700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b7c15b120 0x7f1b7c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b73fff700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b7c15b120 0x7f1b7c0cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57110/0 (socket says 172.21.15.97:57110) 2023-06-23T00:59:33.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b73fff700 1 -- 172.21.15.97:0/1354244643 learned_addr learned my addr 172.21.15.97:0/1354244643 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:33.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b7b7fe700 1 --2- 172.21.15.97:0/1354244643 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c156570 0x7f1b7c156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b73fff700 1 -- 172.21.15.97:0/1354244643 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c156570 msgr2=0x7f1b7c156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:33.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b73fff700 1 --2- 172.21.15.97:0/1354244643 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c156570 0x7f1b7c156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b73fff700 1 -- 172.21.15.97:0/1354244643 >> v1:172.21.15.149:6789/0 conn(0x7f1b7c15a450 legacy=0x7f1b7c0cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b73fff700 1 -- 172.21.15.97:0/1354244643 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c0aee70 con 0x7f1b7c15b120 2023-06-23T00:59:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b73fff700 1 --2- 172.21.15.97:0/1354244643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b7c15b120 0x7f1b7c0cd180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b640099b0 tx=0x7f1b64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ec015c62ed75ba server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b7affd700 1 -- 172.21.15.97:0/1354244643 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64009ea0 con 0x7f1b7c15b120 2023-06-23T00:59:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b7affd700 1 -- 172.21.15.97:0/1354244643 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6400b860 con 0x7f1b7c15b120 2023-06-23T00:59:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b7affd700 1 -- 172.21.15.97:0/1354244643 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6400bc00 con 0x7f1b7c15b120 2023-06-23T00:59:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b80f3e700 1 -- 172.21.15.97:0/1354244643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b7c15b120 msgr2=0x7f1b7c0cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b80f3e700 1 --2- 172.21.15.97:0/1354244643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b7c15b120 0x7f1b7c0cd180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b640099b0 tx=0x7f1b64009250 comp rx=0 tx=0).stop 2023-06-23T00:59:33.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b80f3e700 1 -- 172.21.15.97:0/1354244643 shutdown_connections 2023-06-23T00:59:33.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b80f3e700 1 --2- 172.21.15.97:0/1354244643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b7c15b120 0x7f1b7c0cd180 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b80f3e700 1 --2- 172.21.15.97:0/1354244643 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c156570 0x7f1b7c156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b80f3e700 1 -- 172.21.15.97:0/1354244643 >> 172.21.15.97:0/1354244643 conn(0x7f1b7c0cd840 msgr2=0x7f1b7c0cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:33.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b80f3e700 1 -- 172.21.15.97:0/1354244643 shutdown_connections 2023-06-23T00:59:33.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.064+0000 7f1b80f3e700 1 -- 172.21.15.97:0/1354244643 wait complete. 2023-06-23T00:59:33.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b80f3e700 1 Processor -- start 2023-06-23T00:59:33.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b80f3e700 1 -- start start 2023-06-23T00:59:33.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b80f3e700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c156570 0x7f1b7c166b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b80f3e700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b7c15a450 0x7f1b7c16a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b80f3e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b7c15b120 0x7f1b7c1696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b80f3e700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c16a750 con 0x7f1b7c15a450 2023-06-23T00:59:33.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b80f3e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c16a190 con 0x7f1b7c15b120 2023-06-23T00:59:33.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b80f3e700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c16a470 con 0x7f1b7c156570 2023-06-23T00:59:33.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b73fff700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b7c15a450 0x7f1b7c16a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b73fff700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b7c15a450 0x7f1b7c16a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57116/0 (socket says 172.21.15.97:57116) 2023-06-23T00:59:33.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b73fff700 1 -- 172.21.15.97:0/4256406137 learned_addr learned my addr 172.21.15.97:0/4256406137 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:33.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b7b7fe700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c156570 0x7f1b7c166b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b7bfff700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b7c15b120 0x7f1b7c1696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b73fff700 1 -- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c156570 msgr2=0x7f1b7c166b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b73fff700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c156570 0x7f1b7c166b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b73fff700 1 -- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b7c15b120 msgr2=0x7f1b7c1696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b73fff700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b7c15b120 0x7f1b7c1696c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b73fff700 1 -- 172.21.15.97:0/4256406137 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640094f0 con 0x7f1b7c15a450 2023-06-23T00:59:33.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b73fff700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b7c15a450 0x7f1b7c16a8e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c06b100 tx=0x7f1b64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:33.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.068+0000 7f1b737fe700 1 -- 172.21.15.97:0/4256406137 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6400bbe0 con 0x7f1b7c15a450 2023-06-23T00:59:33.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.072+0000 7f1b737fe700 1 -- 172.21.15.97:0/4256406137 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6401a450 con 0x7f1b7c15a450 2023-06-23T00:59:33.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.072+0000 7f1b737fe700 1 -- 172.21.15.97:0/4256406137 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6401a810 con 0x7f1b7c15a450 2023-06-23T00:59:33.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.072+0000 7f1b80f3e700 1 -- 172.21.15.97:0/4256406137 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7c0c6b90 con 0x7f1b7c15a450 2023-06-23T00:59:33.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.072+0000 7f1b80f3e700 1 -- 172.21.15.97:0/4256406137 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7c167060 con 0x7f1b7c15a450 2023-06-23T00:59:33.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.072+0000 7f1b80f3e700 1 -- 172.21.15.97:0/4256406137 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7c0c69f0 con 0x7f1b7c15a450 2023-06-23T00:59:33.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.072+0000 7f1b737fe700 1 -- 172.21.15.97:0/4256406137 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f1b6401abc0 con 0x7f1b7c15a450 2023-06-23T00:59:33.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.072+0000 7f1b737fe700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f1b5c0604b0 0x7f1b5c062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.072+0000 7f1b737fe700 1 -- 172.21.15.97:0/4256406137 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1b6407de70 con 0x7f1b7c15a450 2023-06-23T00:59:33.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.072+0000 7f1b7b7fe700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f1b5c0604b0 0x7f1b5c062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.076+0000 7f1b7b7fe700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f1b5c0604b0 0x7f1b5c062960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009d20 tx=0x7f1b6c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:33.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.080+0000 7f1b737fe700 1 -- 172.21.15.97:0/4256406137 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f1b7c0c69f0 con 0x7f1b7c15a450 2023-06-23T00:59:33.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b80f3e700 1 -- 172.21.15.97:0/4256406137 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1b7c0c69f0 con 0x7f1b7c15a450 2023-06-23T00:59:33.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b737fe700 1 -- 172.21.15.97:0/4256406137 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1b7c0c69f0 con 0x7f1b7c15a450 2023-06-23T00:59:33.250 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 8 2023-06-23T00:59:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b80f3e700 1 -- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f1b5c0604b0 msgr2=0x7f1b5c062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b80f3e700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f1b5c0604b0 0x7f1b5c062960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009d20 tx=0x7f1b6c0091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b80f3e700 1 -- 172.21.15.97:0/4256406137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b7c15a450 msgr2=0x7f1b7c16a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b80f3e700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b7c15a450 0x7f1b7c16a8e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c06b100 tx=0x7f1b64017000 comp rx=0 tx=0).stop 2023-06-23T00:59:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b80f3e700 1 -- 172.21.15.97:0/4256406137 shutdown_connections 2023-06-23T00:59:33.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b80f3e700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f1b5c0604b0 0x7f1b5c062960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b80f3e700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b7c15b120 0x7f1b7c1696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b80f3e700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b7c15a450 0x7f1b7c16a8e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b80f3e700 1 --2- 172.21.15.97:0/4256406137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b7c156570 0x7f1b7c166b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b80f3e700 1 -- 172.21.15.97:0/4256406137 >> 172.21.15.97:0/4256406137 conn(0x7f1b7c0cd840 msgr2=0x7f1b7c152830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:33.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b80f3e700 1 -- 172.21.15.97:0/4256406137 shutdown_connections 2023-06-23T00:59:33.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.244+0000 7f1b80f3e700 1 -- 172.21.15.97:0/4256406137 wait complete. 2023-06-23T00:59:33.264 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-23T00:59:33.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.364+0000 7fdbff47c700 1 Processor -- start 2023-06-23T00:59:33.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.364+0000 7fdbff47c700 1 -- start start 2023-06-23T00:59:33.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.364+0000 7fdbff47c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdbf806c9b0 0x7fdbf80aca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.364+0000 7fdbff47c700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf80c9fb0 con 0x7fdbf80d0520 2023-06-23T00:59:33.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.364+0000 7fdbff47c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf80acfc0 con 0x7fdbf80cbea0 2023-06-23T00:59:33.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.364+0000 7fdbff47c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf80ca200 con 0x7fdbf806c9b0 2023-06-23T00:59:33.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbfec7b700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdbf80d0520 0x7fdbf80cafc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47250/0 (socket says 172.21.15.97:47250) 2023-06-23T00:59:33.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbfec7b700 1 -- 172.21.15.97:0/624539308 learned_addr learned my addr 172.21.15.97:0/624539308 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:33.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbfe47a700 1 --2- 172.21.15.97:0/624539308 >> v2:172.21.15.149:3300/0 conn(0x7fdbf806c9b0 0x7fdbf80aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbfd478700 1 -- 172.21.15.97:0/624539308 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083217241 0 0) 0x7fdbf80c9fb0 con 0x7fdbf80d0520 2023-06-23T00:59:33.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbfd478700 1 -- 172.21.15.97:0/624539308 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe4003570 con 0x7fdbf80d0520 2023-06-23T00:59:33.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbfd478700 1 -- 172.21.15.97:0/624539308 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2188969304 0 0) 0x7fdbe4003570 con 0x7fdbf80d0520 2023-06-23T00:59:33.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbfe47a700 1 -- 172.21.15.97:0/624539308 >> v1:172.21.15.149:6789/0 conn(0x7fdbf80cbea0 legacy=0x7fdbf806cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbfe47a700 1 -- 172.21.15.97:0/624539308 >> v1:172.21.15.97:6789/0 conn(0x7fdbf80d0520 legacy=0x7fdbf80cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbfe47a700 1 -- 172.21.15.97:0/624539308 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf80ca4e0 con 0x7fdbf806c9b0 2023-06-23T00:59:33.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbfe47a700 1 --2- 172.21.15.97:0/624539308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf806c9b0 0x7fdbf80aca80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80098d0 tx=0x7fdbe8009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5df873e34d57f70 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:33.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbfd478700 1 -- 172.21.15.97:0/624539308 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf00017f0 con 0x7fdbf806c9b0 2023-06-23T00:59:33.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbfd478700 1 -- 172.21.15.97:0/624539308 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe8011420 con 0x7fdbf806c9b0 2023-06-23T00:59:33.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbfd478700 1 -- 172.21.15.97:0/624539308 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80117c0 con 0x7fdbf806c9b0 2023-06-23T00:59:33.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbff47c700 1 -- 172.21.15.97:0/624539308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf806c9b0 msgr2=0x7fdbf80aca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbff47c700 1 --2- 172.21.15.97:0/624539308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf806c9b0 0x7fdbf80aca80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80098d0 tx=0x7fdbe8009120 comp rx=0 tx=0).stop 2023-06-23T00:59:33.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbff47c700 1 -- 172.21.15.97:0/624539308 shutdown_connections 2023-06-23T00:59:33.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbff47c700 1 --2- 172.21.15.97:0/624539308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf806c9b0 0x7fdbf80aca80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbff47c700 1 -- 172.21.15.97:0/624539308 >> 172.21.15.97:0/624539308 conn(0x7fdbf80cfa10 msgr2=0x7fdbf80cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:33.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbff47c700 1 -- 172.21.15.97:0/624539308 shutdown_connections 2023-06-23T00:59:33.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.368+0000 7fdbff47c700 1 -- 172.21.15.97:0/624539308 wait complete. 2023-06-23T00:59:33.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbff47c700 1 Processor -- start 2023-06-23T00:59:33.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbff47c700 1 -- start start 2023-06-23T00:59:33.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbff47c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbf806c9b0 0x7fdbf815d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbff47c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf80cbea0 0x7fdbf8153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbff47c700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf80d0520 0x7fdbf81542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbff47c700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf8169860 con 0x7fdbf80d0520 2023-06-23T00:59:33.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbff47c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf8168c90 con 0x7fdbf80cbea0 2023-06-23T00:59:33.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbff47c700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf8168f30 con 0x7fdbf806c9b0 2023-06-23T00:59:33.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbfec7b700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf80d0520 0x7fdbf81542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbfec7b700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf80d0520 0x7fdbf81542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57120/0 (socket says 172.21.15.97:57120) 2023-06-23T00:59:33.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbfec7b700 1 -- 172.21.15.97:0/1145881068 learned_addr learned my addr 172.21.15.97:0/1145881068 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:33.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbfe47a700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbf806c9b0 0x7fdbf815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbfdc79700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf80cbea0 0x7fdbf8153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbfec7b700 1 -- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbf806c9b0 msgr2=0x7fdbf815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbfec7b700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbf806c9b0 0x7fdbf815d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbfec7b700 1 -- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf80cbea0 msgr2=0x7fdbf8153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbfec7b700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf80cbea0 0x7fdbf8153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbfec7b700 1 -- 172.21.15.97:0/1145881068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe80093c0 con 0x7fdbf80d0520 2023-06-23T00:59:33.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbfe47a700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbf806c9b0 0x7fdbf815d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:33.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbfec7b700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf80d0520 0x7fdbf81542f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000cb90 tx=0x7fdbf00015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:33.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbee7fc700 1 -- 172.21.15.97:0/1145881068 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0004dc0 con 0x7fdbf80d0520 2023-06-23T00:59:33.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbee7fc700 1 -- 172.21.15.97:0/1145881068 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf000a700 con 0x7fdbf80d0520 2023-06-23T00:59:33.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbff47c700 1 -- 172.21.15.97:0/1145881068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf8169210 con 0x7fdbf80d0520 2023-06-23T00:59:33.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbee7fc700 1 -- 172.21.15.97:0/1145881068 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf000aac0 con 0x7fdbf80d0520 2023-06-23T00:59:33.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.372+0000 7fdbff47c700 1 -- 172.21.15.97:0/1145881068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf815dd00 con 0x7fdbf80d0520 2023-06-23T00:59:33.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.376+0000 7fdbee7fc700 1 -- 172.21.15.97:0/1145881068 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fdbf0007150 con 0x7fdbf80d0520 2023-06-23T00:59:33.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.376+0000 7fdbff47c700 1 -- 172.21.15.97:0/1145881068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf815df80 con 0x7fdbf80d0520 2023-06-23T00:59:33.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.376+0000 7fdbee7fc700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fdbdc0604b0 0x7fdbdc062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.376+0000 7fdbee7fc700 1 -- 172.21.15.97:0/1145881068 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdbf007bc50 con 0x7fdbf80d0520 2023-06-23T00:59:33.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.376+0000 7fdbfe47a700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fdbdc0604b0 0x7fdbdc062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.376+0000 7fdbfe47a700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fdbdc0604b0 0x7fdbdc062960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009390 tx=0x7fdbe8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:33.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.384+0000 7fdbee7fc700 1 -- 172.21.15.97:0/1145881068 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fdbf815df80 con 0x7fdbf80d0520 2023-06-23T00:59:33.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.544+0000 7fdbff47c700 1 -- 172.21.15.97:0/1145881068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdbf815df80 con 0x7fdbf80d0520 2023-06-23T00:59:33.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.544+0000 7fdbee7fc700 1 -- 172.21.15.97:0/1145881068 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v22) v1 ==== 84+0+126 (secure 0 0 0) 0x7fdbf815df80 con 0x7fdbf80d0520 2023-06-23T00:59:33.553 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:59:33.553 INFO:teuthology.orchestra.run.smithi097.stdout:[ 2023-06-23T00:59:33.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-06-23T00:59:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 1, 2023-06-23T00:59:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": ".mgr" 2023-06-23T00:59:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-06-23T00:59:33.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-06-23T00:59:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 2, 2023-06-23T00:59:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": "rbd" 2023-06-23T00:59:33.556 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-06-23T00:59:33.557 INFO:teuthology.orchestra.run.smithi097.stdout:] 2023-06-23T00:59:33.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.548+0000 7fdbff47c700 1 -- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fdbdc0604b0 msgr2=0x7fdbdc062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.548+0000 7fdbff47c700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fdbdc0604b0 0x7fdbdc062960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009390 tx=0x7fdbe8016000 comp rx=0 tx=0).stop 2023-06-23T00:59:33.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.548+0000 7fdbff47c700 1 -- 172.21.15.97:0/1145881068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf80d0520 msgr2=0x7fdbf81542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.548+0000 7fdbff47c700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf80d0520 0x7fdbf81542f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000cb90 tx=0x7fdbf00015b0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.548+0000 7fdbff47c700 1 -- 172.21.15.97:0/1145881068 shutdown_connections 2023-06-23T00:59:33.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.548+0000 7fdbff47c700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fdbdc0604b0 0x7fdbdc062960 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.548+0000 7fdbff47c700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbf80d0520 0x7fdbf81542f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.548+0000 7fdbff47c700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbf80cbea0 0x7fdbf8153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.548+0000 7fdbff47c700 1 --2- 172.21.15.97:0/1145881068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbf806c9b0 0x7fdbf815d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.548+0000 7fdbff47c700 1 -- 172.21.15.97:0/1145881068 >> 172.21.15.97:0/1145881068 conn(0x7fdbf80cfa10 msgr2=0x7fdbf8154980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:33.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.548+0000 7fdbff47c700 1 -- 172.21.15.97:0/1145881068 shutdown_connections 2023-06-23T00:59:33.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.548+0000 7fdbff47c700 1 -- 172.21.15.97:0/1145881068 wait complete. 2023-06-23T00:59:33.565 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-23T00:59:33.566 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-23T00:59:33.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b13900700 1 Processor -- start 2023-06-23T00:59:33.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b13900700 1 -- start start 2023-06-23T00:59:33.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b13900700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2b0c153460 0x7f2b0c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b13900700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b0c1599e0 0x7f2b0c15b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b13900700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c153830 con 0x7f2b0c06daf0 2023-06-23T00:59:33.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b13900700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0c06df90 con 0x7f2b0c153460 2023-06-23T00:59:33.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b13900700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c159dd0 con 0x7f2b0c1599e0 2023-06-23T00:59:33.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b10e9b700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2b0c06daf0 0x7f2b0c1592d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47262/0 (socket says 172.21.15.97:47262) 2023-06-23T00:59:33.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b10e9b700 1 -- 172.21.15.97:0/1119296214 learned_addr learned my addr 172.21.15.97:0/1119296214 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:33.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b1169c700 1 --2- 172.21.15.97:0/1119296214 >> v2:172.21.15.149:3300/0 conn(0x7f2b0c153460 0x7f2b0c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b11e9d700 1 --2- 172.21.15.97:0/1119296214 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b0c1599e0 0x7f2b0c15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b03fff700 1 -- 172.21.15.97:0/1119296214 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761807900 0 0) 0x7f2b0c153830 con 0x7f2b0c06daf0 2023-06-23T00:59:33.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b03fff700 1 -- 172.21.15.97:0/1119296214 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af8003570 con 0x7f2b0c06daf0 2023-06-23T00:59:33.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b1169c700 1 -- 172.21.15.97:0/1119296214 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b0c1599e0 msgr2=0x7f2b0c15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:33.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b1169c700 1 --2- 172.21.15.97:0/1119296214 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b0c1599e0 0x7f2b0c15b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b1169c700 1 -- 172.21.15.97:0/1119296214 >> v1:172.21.15.97:6789/0 conn(0x7f2b0c06daf0 legacy=0x7f2b0c1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b1169c700 1 -- 172.21.15.97:0/1119296214 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c15a2b0 con 0x7f2b0c153460 2023-06-23T00:59:33.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b11e9d700 1 --2- 172.21.15.97:0/1119296214 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b0c1599e0 0x7f2b0c15b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:33.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b1169c700 1 --2- 172.21.15.97:0/1119296214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b0c153460 0x7f2b0c06d5b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b080098e0 tx=0x7f2b080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1c61f1f25371fa server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:33.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b03fff700 1 -- 172.21.15.97:0/1119296214 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b08011630 con 0x7f2b0c153460 2023-06-23T00:59:33.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b03fff700 1 -- 172.21.15.97:0/1119296214 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b08011790 con 0x7f2b0c153460 2023-06-23T00:59:33.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.672+0000 7f2b03fff700 1 -- 172.21.15.97:0/1119296214 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b08011b10 con 0x7f2b0c153460 2023-06-23T00:59:33.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.676+0000 7f2b13900700 1 -- 172.21.15.97:0/1119296214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b0c153460 msgr2=0x7f2b0c06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.676+0000 7f2b13900700 1 --2- 172.21.15.97:0/1119296214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b0c153460 0x7f2b0c06d5b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b080098e0 tx=0x7f2b080091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.676+0000 7f2b13900700 1 -- 172.21.15.97:0/1119296214 shutdown_connections 2023-06-23T00:59:33.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.676+0000 7f2b13900700 1 --2- 172.21.15.97:0/1119296214 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b0c1599e0 0x7f2b0c15b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.676+0000 7f2b13900700 1 --2- 172.21.15.97:0/1119296214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b0c153460 0x7f2b0c06d5b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.676+0000 7f2b13900700 1 -- 172.21.15.97:0/1119296214 >> 172.21.15.97:0/1119296214 conn(0x7f2b0c06cca0 msgr2=0x7f2b0c0cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:33.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.676+0000 7f2b13900700 1 -- 172.21.15.97:0/1119296214 shutdown_connections 2023-06-23T00:59:33.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.676+0000 7f2b13900700 1 -- 172.21.15.97:0/1119296214 wait complete. 2023-06-23T00:59:33.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.676+0000 7f2b13900700 1 Processor -- start 2023-06-23T00:59:33.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.676+0000 7f2b13900700 1 -- start start 2023-06-23T00:59:33.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b13900700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c06daf0 0x7f2b0c14a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b13900700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b0c153460 0x7f2b0c0b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b13900700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b0c1599e0 0x7f2b0c0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b13900700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0afa80 con 0x7f2b0c06daf0 2023-06-23T00:59:33.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b13900700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c14acd0 con 0x7f2b0c1599e0 2023-06-23T00:59:33.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b13900700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0b2cd0 con 0x7f2b0c153460 2023-06-23T00:59:33.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b1169c700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c06daf0 0x7f2b0c14a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b1169c700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c06daf0 0x7f2b0c14a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57122/0 (socket says 172.21.15.97:57122) 2023-06-23T00:59:33.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b1169c700 1 -- 172.21.15.97:0/213658136 learned_addr learned my addr 172.21.15.97:0/213658136 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:33.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b10e9b700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b0c153460 0x7f2b0c0b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b11e9d700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b0c1599e0 0x7f2b0c0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b1169c700 1 -- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b0c153460 msgr2=0x7f2b0c0b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b1169c700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b0c153460 0x7f2b0c0b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b1169c700 1 -- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b0c1599e0 msgr2=0x7f2b0c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:33.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b1169c700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b0c1599e0 0x7f2b0c0cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:33.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b1169c700 1 -- 172.21.15.97:0/213658136 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b04009a20 con 0x7f2b0c06daf0 2023-06-23T00:59:33.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b10e9b700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b0c153460 0x7f2b0c0b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:33.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b1169c700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c06daf0 0x7f2b0c14a790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009ed0 tx=0x7f2b08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:33.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b017fa700 1 -- 172.21.15.97:0/213658136 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b08011900 con 0x7f2b0c06daf0 2023-06-23T00:59:33.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b017fa700 1 -- 172.21.15.97:0/213658136 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b08011a80 con 0x7f2b0c06daf0 2023-06-23T00:59:33.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b13900700 1 -- 172.21.15.97:0/213658136 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b08009420 con 0x7f2b0c06daf0 2023-06-23T00:59:33.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b017fa700 1 -- 172.21.15.97:0/213658136 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0801a680 con 0x7f2b0c06daf0 2023-06-23T00:59:33.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b13900700 1 -- 172.21.15.97:0/213658136 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0c0b3290 con 0x7f2b0c06daf0 2023-06-23T00:59:33.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b13900700 1 -- 172.21.15.97:0/213658136 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0c04bc30 con 0x7f2b0c06daf0 2023-06-23T00:59:33.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.680+0000 7f2b017fa700 1 -- 172.21.15.97:0/213658136 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f2b0801aab0 con 0x7f2b0c06daf0 2023-06-23T00:59:33.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.684+0000 7f2b017fa700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f2af00604b0 0x7f2af0062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:33.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.684+0000 7f2b017fa700 1 -- 172.21.15.97:0/213658136 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2b0807e160 con 0x7f2b0c06daf0 2023-06-23T00:59:33.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.684+0000 7f2b10e9b700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f2af00604b0 0x7f2af0062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:33.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.684+0000 7f2b10e9b700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f2af00604b0 0x7f2af0062960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c156180 tx=0x7f2afc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:33.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.692+0000 7f2b017fa700 1 -- 172.21.15.97:0/213658136 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f2b0804ea00 con 0x7f2b0c06daf0 2023-06-23T00:59:33.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:33.848+0000 7f2b13900700 1 -- 172.21.15.97:0/213658136 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2b0c06e4c0 con 0x7f2b0c06daf0 2023-06-23T00:59:34.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.156+0000 7f2b017fa700 1 -- 172.21.15.97:0/213658136 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2b08052020 con 0x7f2b0c06daf0 2023-06-23T00:59:34.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.168+0000 7f2b13900700 1 -- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f2af00604b0 msgr2=0x7f2af0062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:34.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.168+0000 7f2b13900700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f2af00604b0 0x7f2af0062960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c156180 tx=0x7f2afc009040 comp rx=0 tx=0).stop 2023-06-23T00:59:34.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.168+0000 7f2b13900700 1 -- 172.21.15.97:0/213658136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c06daf0 msgr2=0x7f2b0c14a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:34.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.168+0000 7f2b13900700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c06daf0 0x7f2b0c14a790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009ed0 tx=0x7f2b08017000 comp rx=0 tx=0).stop 2023-06-23T00:59:34.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.168+0000 7f2b13900700 1 -- 172.21.15.97:0/213658136 shutdown_connections 2023-06-23T00:59:34.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.168+0000 7f2b13900700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f2af00604b0 0x7f2af0062960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:34.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.168+0000 7f2b13900700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b0c1599e0 0x7f2b0c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:34.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.168+0000 7f2b13900700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b0c153460 0x7f2b0c0b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:34.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.168+0000 7f2b13900700 1 --2- 172.21.15.97:0/213658136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c06daf0 0x7f2b0c14a790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:34.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.168+0000 7f2b13900700 1 -- 172.21.15.97:0/213658136 >> 172.21.15.97:0/213658136 conn(0x7f2b0c06cca0 msgr2=0x7f2b0c150eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:34.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.168+0000 7f2b13900700 1 -- 172.21.15.97:0/213658136 shutdown_connections 2023-06-23T00:59:34.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.168+0000 7f2b13900700 1 -- 172.21.15.97:0/213658136 wait complete. 2023-06-23T00:59:34.177 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' created 2023-06-23T00:59:34.186 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-06-23T00:59:34.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.292+0000 7fd6d9414700 1 Processor -- start 2023-06-23T00:59:34.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.292+0000 7fd6d9414700 1 -- start start 2023-06-23T00:59:34.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6d9414700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6d40b19c0 0x7fd6d40b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:34.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6d9414700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd6d40cc1c0 0x7fd6d40ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:34.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6d9414700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd6d406b790 0x7fd6d41561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:34.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6d9414700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d40cbd30 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6d9414700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d40cb120 con 0x7fd6d406b790 2023-06-23T00:59:34.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6d9414700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40cb400 con 0x7fd6d40b19c0 2023-06-23T00:59:34.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6cb7fe700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd6d40cc1c0 0x7fd6d40ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:34.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6cb7fe700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd6d40cc1c0 0x7fd6d40ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57138/0 (socket says 172.21.15.97:57138) 2023-06-23T00:59:34.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6cb7fe700 1 -- 172.21.15.97:0/4123575482 learned_addr learned my addr 172.21.15.97:0/4123575482 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:34.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6d3fff700 1 --2- 172.21.15.97:0/4123575482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6d40b19c0 0x7fd6d40b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:34.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6d8c13700 1 --2- 172.21.15.97:0/4123575482 >> v2:172.21.15.149:3300/0 conn(0x7fd6d406b790 0x7fd6d41561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:34.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6cb7fe700 1 -- 172.21.15.97:0/4123575482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6d40b19c0 msgr2=0x7fd6d40b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:34.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6cb7fe700 1 --2- 172.21.15.97:0/4123575482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6d40b19c0 0x7fd6d40b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:34.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6cb7fe700 1 -- 172.21.15.97:0/4123575482 >> v2:172.21.15.149:3300/0 conn(0x7fd6d406b790 msgr2=0x7fd6d41561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:34.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6cb7fe700 1 --2- 172.21.15.97:0/4123575482 >> v2:172.21.15.149:3300/0 conn(0x7fd6d406b790 0x7fd6d41561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:34.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6cb7fe700 1 -- 172.21.15.97:0/4123575482 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d40cb6e0 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6cb7fe700 1 --2- 172.21.15.97:0/4123575482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6d40cc1c0 0x7fd6d40ca7f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4067fe0 tx=0x7fd6bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ad573957beaf8b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:34.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6d37fe700 1 -- 172.21.15.97:0/4123575482 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc00b860 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6d37fe700 1 -- 172.21.15.97:0/4123575482 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc00b9c0 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6d37fe700 1 -- 172.21.15.97:0/4123575482 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc00bd60 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6d9414700 1 -- 172.21.15.97:0/4123575482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6d40cc1c0 msgr2=0x7fd6d40ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:34.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.296+0000 7fd6d9414700 1 --2- 172.21.15.97:0/4123575482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6d40cc1c0 0x7fd6d40ca7f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4067fe0 tx=0x7fd6bc009250 comp rx=0 tx=0).stop 2023-06-23T00:59:34.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.300+0000 7fd6d9414700 1 -- 172.21.15.97:0/4123575482 shutdown_connections 2023-06-23T00:59:34.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.300+0000 7fd6d9414700 1 --2- 172.21.15.97:0/4123575482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6d40cc1c0 0x7fd6d40ca7f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:34.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.300+0000 7fd6d9414700 1 --2- 172.21.15.97:0/4123575482 >> v2:172.21.15.149:3300/0 conn(0x7fd6d406b790 0x7fd6d41561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:34.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.300+0000 7fd6d9414700 1 --2- 172.21.15.97:0/4123575482 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6d40b19c0 0x7fd6d40b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:34.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.300+0000 7fd6d9414700 1 -- 172.21.15.97:0/4123575482 >> 172.21.15.97:0/4123575482 conn(0x7fd6d4066ed0 msgr2=0x7fd6d40672a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:34.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.300+0000 7fd6d9414700 1 -- 172.21.15.97:0/4123575482 shutdown_connections 2023-06-23T00:59:34.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.300+0000 7fd6d9414700 1 -- 172.21.15.97:0/4123575482 wait complete. 2023-06-23T00:59:34.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.300+0000 7fd6d9414700 1 Processor -- start 2023-06-23T00:59:34.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.300+0000 7fd6d9414700 1 -- start start 2023-06-23T00:59:34.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d9414700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6d406b790 0x7fd6d40af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:34.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d9414700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6d40b19c0 0x7fd6d41554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:34.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d9414700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6d40cc1c0 0x7fd6d416ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:34.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d9414700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4155fa0 con 0x7fd6d40b19c0 2023-06-23T00:59:34.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d9414700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40afdb0 con 0x7fd6d406b790 2023-06-23T00:59:34.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d9414700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40b0090 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6cb7fe700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6d40b19c0 0x7fd6d41554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:34.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6d406b790 0x7fd6d40af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:34.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6cb7fe700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6d40b19c0 0x7fd6d41554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57146/0 (socket says 172.21.15.97:57146) 2023-06-23T00:59:34.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6d406b790 0x7fd6d40af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.97:44502/0 (socket says 172.21.15.97:44502) 2023-06-23T00:59:34.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6cb7fe700 1 -- 172.21.15.97:0/3895933842 learned_addr learned my addr 172.21.15.97:0/3895933842 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:34.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d8c13700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6d40cc1c0 0x7fd6d416ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:34.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d8c13700 1 -- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6d406b790 msgr2=0x7fd6d40af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:34.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d8c13700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6d406b790 0x7fd6d40af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:34.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d8c13700 1 -- 172.21.15.97:0/3895933842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6d40b19c0 msgr2=0x7fd6d41554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:34.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d8c13700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6d40b19c0 0x7fd6d41554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:34.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d8c13700 1 -- 172.21.15.97:0/3895933842 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc0094f0 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d3fff700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6d406b790 0x7fd6d40af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:34.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d8c13700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6d40cc1c0 0x7fd6d416ce40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc007ed0 tx=0x7fd6cc009850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:34.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d0ff9700 1 -- 172.21.15.97:0/3895933842 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc018070 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d0ff9700 1 -- 172.21.15.97:0/3895933842 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc00eb90 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d9414700 1 -- 172.21.15.97:0/3895933842 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d40b0370 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d0ff9700 1 -- 172.21.15.97:0/3895933842 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc014420 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.304+0000 7fd6d9414700 1 -- 172.21.15.97:0/3895933842 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d40afb40 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.308+0000 7fd6d9414700 1 -- 172.21.15.97:0/3895933842 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d40697d0 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.308+0000 7fd6d0ff9700 1 -- 172.21.15.97:0/3895933842 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fd6cc003020 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.308+0000 7fd6d0ff9700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fd6b80604b0 0x7fd6b8062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:34.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.308+0000 7fd6d0ff9700 1 -- 172.21.15.97:0/3895933842 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fd6cc07c770 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.308+0000 7fd6d3fff700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fd6b80604b0 0x7fd6b8062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:34.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.308+0000 7fd6d3fff700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fd6b80604b0 0x7fd6b8062960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4006fd0 tx=0x7fd6c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:34.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.320+0000 7fd6d0ff9700 1 -- 172.21.15.97:0/3895933842 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fd6cc04ce00 con 0x7fd6d40cc1c0 2023-06-23T00:59:34.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:34.480+0000 7fd6d9414700 1 -- 172.21.15.97:0/3895933842 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fd6d40cb9c0 con 0x7fd6d40cc1c0 2023-06-23T00:59:35.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.183+0000 7fd6d0ff9700 1 -- 172.21.15.97:0/3895933842 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v24) v1 ==== 171+0+0 (secure 0 0 0) 0x7fd6cc050420 con 0x7fd6d40cc1c0 2023-06-23T00:59:35.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.199+0000 7fd6d9414700 1 -- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fd6b80604b0 msgr2=0x7fd6b8062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:35.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.199+0000 7fd6d9414700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fd6b80604b0 0x7fd6b8062960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4006fd0 tx=0x7fd6c4008040 comp rx=0 tx=0).stop 2023-06-23T00:59:35.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.199+0000 7fd6d9414700 1 -- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6d40cc1c0 msgr2=0x7fd6d416ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:35.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.199+0000 7fd6d9414700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6d40cc1c0 0x7fd6d416ce40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc007ed0 tx=0x7fd6cc009850 comp rx=0 tx=0).stop 2023-06-23T00:59:35.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.199+0000 7fd6d9414700 1 -- 172.21.15.97:0/3895933842 shutdown_connections 2023-06-23T00:59:35.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.199+0000 7fd6d9414700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fd6b80604b0 0x7fd6b8062960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.199+0000 7fd6d9414700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6d40cc1c0 0x7fd6d416ce40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.199+0000 7fd6d9414700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6d40b19c0 0x7fd6d41554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.199+0000 7fd6d9414700 1 --2- 172.21.15.97:0/3895933842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6d406b790 0x7fd6d40af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.199+0000 7fd6d9414700 1 -- 172.21.15.97:0/3895933842 >> 172.21.15.97:0/3895933842 conn(0x7fd6d4066ed0 msgr2=0x7fd6d406c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:35.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.199+0000 7fd6d9414700 1 -- 172.21.15.97:0/3895933842 shutdown_connections 2023-06-23T00:59:35.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.199+0000 7fd6d9414700 1 -- 172.21.15.97:0/3895933842 wait complete. 2023-06-23T00:59:35.208 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' created 2023-06-23T00:59:35.218 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-23T00:59:35.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.315+0000 7fa65e3f5700 1 Processor -- start 2023-06-23T00:59:35.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.315+0000 7fa65e3f5700 1 -- start start 2023-06-23T00:59:35.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65e3f5700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa65815c500 0x7fa65806dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:35.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65e3f5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa6580cf3b0 0x7fa6580cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:35.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65e3f5700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6580ce310 con 0x7fa65806d7e0 2023-06-23T00:59:35.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65e3f5700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6580ce5f0 con 0x7fa65815c500 2023-06-23T00:59:35.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65e3f5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6580ce8d0 con 0x7fa6580cf3b0 2023-06-23T00:59:35.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65cbf2700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa65815c500 0x7fa65806dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:35.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65d3f3700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa65806d7e0 0x7fa65815bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47278/0 (socket says 172.21.15.97:47278) 2023-06-23T00:59:35.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65d3f3700 1 -- 172.21.15.97:0/167880838 learned_addr learned my addr 172.21.15.97:0/167880838 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:35.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65dbf4700 1 --2- 172.21.15.97:0/167880838 >> v2:172.21.15.149:3300/0 conn(0x7fa6580cf3b0 0x7fa6580cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:35.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65cbf2700 1 -- 172.21.15.97:0/167880838 >> v2:172.21.15.149:3300/0 conn(0x7fa6580cf3b0 msgr2=0x7fa6580cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:35.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65cbf2700 1 --2- 172.21.15.97:0/167880838 >> v2:172.21.15.149:3300/0 conn(0x7fa6580cf3b0 0x7fa6580cd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65cbf2700 1 -- 172.21.15.97:0/167880838 >> v1:172.21.15.97:6789/0 conn(0x7fa65806d7e0 legacy=0x7fa65815bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:35.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa64ffff700 1 -- 172.21.15.97:0/167880838 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662405998 0 0) 0x7fa6580ce310 con 0x7fa65806d7e0 2023-06-23T00:59:35.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65cbf2700 1 -- 172.21.15.97:0/167880838 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6580cebb0 con 0x7fa65815c500 2023-06-23T00:59:35.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65cbf2700 1 --2- 172.21.15.97:0/167880838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65815c500 0x7fa65806dbb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa65815dab0 tx=0x7fa6540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ac4bc78698c833 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:35.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa64ffff700 1 -- 172.21.15.97:0/167880838 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654011630 con 0x7fa65815c500 2023-06-23T00:59:35.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa64ffff700 1 -- 172.21.15.97:0/167880838 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654011790 con 0x7fa65815c500 2023-06-23T00:59:35.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa64ffff700 1 -- 172.21.15.97:0/167880838 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654011b30 con 0x7fa65815c500 2023-06-23T00:59:35.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65e3f5700 1 -- 172.21.15.97:0/167880838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65815c500 msgr2=0x7fa65806dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:35.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65e3f5700 1 --2- 172.21.15.97:0/167880838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65815c500 0x7fa65806dbb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa65815dab0 tx=0x7fa6540091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65e3f5700 1 -- 172.21.15.97:0/167880838 shutdown_connections 2023-06-23T00:59:35.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65e3f5700 1 --2- 172.21.15.97:0/167880838 >> v2:172.21.15.149:3300/0 conn(0x7fa6580cf3b0 0x7fa6580cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65e3f5700 1 --2- 172.21.15.97:0/167880838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65815c500 0x7fa65806dbb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65e3f5700 1 -- 172.21.15.97:0/167880838 >> 172.21.15.97:0/167880838 conn(0x7fa65806cc60 msgr2=0x7fa6580cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:35.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65e3f5700 1 -- 172.21.15.97:0/167880838 shutdown_connections 2023-06-23T00:59:35.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.319+0000 7fa65e3f5700 1 -- 172.21.15.97:0/167880838 wait complete. 2023-06-23T00:59:35.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65e3f5700 1 Processor -- start 2023-06-23T00:59:35.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65e3f5700 1 -- start start 2023-06-23T00:59:35.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65e3f5700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65806d7e0 0x7fa658155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:35.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65e3f5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6580cf3b0 0x7fa6581465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:35.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65e3f5700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa65815c500 0x7fa6580c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:35.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65e3f5700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa658155ef0 con 0x7fa65806d7e0 2023-06-23T00:59:35.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65e3f5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa658157010 con 0x7fa6580cf3b0 2023-06-23T00:59:35.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65e3f5700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa658155c50 con 0x7fa65815c500 2023-06-23T00:59:35.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65d3f3700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65806d7e0 0x7fa658155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:35.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65d3f3700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65806d7e0 0x7fa658155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57164/0 (socket says 172.21.15.97:57164) 2023-06-23T00:59:35.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65d3f3700 1 -- 172.21.15.97:0/4052117570 learned_addr learned my addr 172.21.15.97:0/4052117570 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:35.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65dbf4700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa65815c500 0x7fa6580c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:35.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65cbf2700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6580cf3b0 0x7fa6581465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:35.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65d3f3700 1 -- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa65815c500 msgr2=0x7fa6580c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:35.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65d3f3700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa65815c500 0x7fa6580c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65d3f3700 1 -- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6580cf3b0 msgr2=0x7fa6581465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:35.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65d3f3700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6580cf3b0 0x7fa6581465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65d3f3700 1 -- 172.21.15.97:0/4052117570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654009420 con 0x7fa65806d7e0 2023-06-23T00:59:35.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65cbf2700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6580cf3b0 0x7fa6581465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:35.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.323+0000 7fa65d3f3700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65806d7e0 0x7fa658155710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c7e0 tx=0x7fa648007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:35.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.327+0000 7fa64d7fa700 1 -- 172.21.15.97:0/4052117570 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648005b30 con 0x7fa65806d7e0 2023-06-23T00:59:35.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.327+0000 7fa64d7fa700 1 -- 172.21.15.97:0/4052117570 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa648005c90 con 0x7fa65806d7e0 2023-06-23T00:59:35.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.327+0000 7fa64d7fa700 1 -- 172.21.15.97:0/4052117570 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648007300 con 0x7fa65806d7e0 2023-06-23T00:59:35.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.327+0000 7fa65e3f5700 1 -- 172.21.15.97:0/4052117570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa658156250 con 0x7fa65806d7e0 2023-06-23T00:59:35.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.327+0000 7fa65e3f5700 1 -- 172.21.15.97:0/4052117570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa658156810 con 0x7fa65806d7e0 2023-06-23T00:59:35.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.327+0000 7fa65e3f5700 1 -- 172.21.15.97:0/4052117570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa658088110 con 0x7fa65806d7e0 2023-06-23T00:59:35.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.327+0000 7fa64d7fa700 1 -- 172.21.15.97:0/4052117570 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fa64801b3b0 con 0x7fa65806d7e0 2023-06-23T00:59:35.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.327+0000 7fa64d7fa700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fa63c0604b0 0x7fa63c062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:35.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.327+0000 7fa64d7fa700 1 -- 172.21.15.97:0/4052117570 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fa64807bcb0 con 0x7fa65806d7e0 2023-06-23T00:59:35.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.331+0000 7fa65cbf2700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fa63c0604b0 0x7fa63c062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:35.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.331+0000 7fa65cbf2700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fa63c0604b0 0x7fa63c062960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa6540091e0 tx=0x7fa654017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:35.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.335+0000 7fa64d7fa700 1 -- 172.21.15.97:0/4052117570 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fa64804c260 con 0x7fa65806d7e0 2023-06-23T00:59:35.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.531+0000 7fa65e3f5700 1 -- 172.21.15.97:0/4052117570 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa6580cee90 con 0x7fa65806d7e0 2023-06-23T00:59:35.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.547+0000 7fa64d7fa700 1 -- 172.21.15.97:0/4052117570 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa6480170c0 con 0x7fa65806d7e0 2023-06-23T00:59:35.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.555+0000 7fa65e3f5700 1 -- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fa63c0604b0 msgr2=0x7fa63c062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:35.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.555+0000 7fa65e3f5700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fa63c0604b0 0x7fa63c062960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa6540091e0 tx=0x7fa654017000 comp rx=0 tx=0).stop 2023-06-23T00:59:35.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.555+0000 7fa65e3f5700 1 -- 172.21.15.97:0/4052117570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65806d7e0 msgr2=0x7fa658155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:35.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.555+0000 7fa65e3f5700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65806d7e0 0x7fa658155710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c7e0 tx=0x7fa648007df0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.555+0000 7fa65e3f5700 1 -- 172.21.15.97:0/4052117570 shutdown_connections 2023-06-23T00:59:35.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.555+0000 7fa65e3f5700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fa63c0604b0 0x7fa63c062960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.555+0000 7fa65e3f5700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa65815c500 0x7fa6580c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.555+0000 7fa65e3f5700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6580cf3b0 0x7fa6581465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.555+0000 7fa65e3f5700 1 --2- 172.21.15.97:0/4052117570 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa65806d7e0 0x7fa658155710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.555+0000 7fa65e3f5700 1 -- 172.21.15.97:0/4052117570 >> 172.21.15.97:0/4052117570 conn(0x7fa65806cc60 msgr2=0x7fa6580ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:35.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.559+0000 7fa65e3f5700 1 -- 172.21.15.97:0/4052117570 shutdown_connections 2023-06-23T00:59:35.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.559+0000 7fa65e3f5700 1 -- 172.21.15.97:0/4052117570 wait complete. 2023-06-23T00:59:35.569 INFO:teuthology.orchestra.run.smithi097.stderr:new fs with metadata pool 3 and data pool 4 2023-06-23T00:59:35.589 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-06-23T00:59:35.589 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-06-23T00:59:35.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.683+0000 7fd33297f700 1 Processor -- start 2023-06-23T00:59:35.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.683+0000 7fd33297f700 1 -- start start 2023-06-23T00:59:35.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c156730 0x7fd32c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:35.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd32c06ad00 0x7fd32c15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:35.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c0c65b0 con 0x7fd32c06d840 2023-06-23T00:59:35.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c0c6820 con 0x7fd32c06ad00 2023-06-23T00:59:35.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0c6b00 con 0x7fd32c156730 2023-06-23T00:59:35.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33217e700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd32c06d840 0x7fd32c06c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47284/0 (socket says 172.21.15.97:47284) 2023-06-23T00:59:35.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33217e700 1 -- 172.21.15.97:0/756122658 learned_addr learned my addr 172.21.15.97:0/756122658 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:35.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33117c700 1 --2- 172.21.15.97:0/756122658 >> v2:172.21.15.97:3300/0 conn(0x7fd32c06ad00 0x7fd32c15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:35.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33197d700 1 --2- 172.21.15.97:0/756122658 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c156730 0x7fd32c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:35.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33097b700 1 -- 172.21.15.97:0/756122658 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786773366 0 0) 0x7fd32c0c65b0 con 0x7fd32c06d840 2023-06-23T00:59:35.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33097b700 1 -- 172.21.15.97:0/756122658 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd318003570 con 0x7fd32c06d840 2023-06-23T00:59:35.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33097b700 1 -- 172.21.15.97:0/756122658 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2397573533 0 0) 0x7fd318003570 con 0x7fd32c06d840 2023-06-23T00:59:35.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33117c700 1 -- 172.21.15.97:0/756122658 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c156730 msgr2=0x7fd32c15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:35.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33117c700 1 --2- 172.21.15.97:0/756122658 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c156730 0x7fd32c15a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33117c700 1 -- 172.21.15.97:0/756122658 >> v1:172.21.15.97:6789/0 conn(0x7fd32c06d840 legacy=0x7fd32c06c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:35.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33117c700 1 -- 172.21.15.97:0/756122658 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c0c6de0 con 0x7fd32c06ad00 2023-06-23T00:59:35.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33197d700 1 --2- 172.21.15.97:0/756122658 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c156730 0x7fd32c15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:35.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33117c700 1 --2- 172.21.15.97:0/756122658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd32c06ad00 0x7fd32c15aaa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0098e0 tx=0x7fd31c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dab7e57553bb911 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:35.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33097b700 1 -- 172.21.15.97:0/756122658 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3240017f0 con 0x7fd32c06ad00 2023-06-23T00:59:35.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33097b700 1 -- 172.21.15.97:0/756122658 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c011420 con 0x7fd32c06ad00 2023-06-23T00:59:35.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33097b700 1 -- 172.21.15.97:0/756122658 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c0117c0 con 0x7fd32c06ad00 2023-06-23T00:59:35.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 -- 172.21.15.97:0/756122658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd32c06ad00 msgr2=0x7fd32c15aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:35.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 --2- 172.21.15.97:0/756122658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd32c06ad00 0x7fd32c15aaa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0098e0 tx=0x7fd31c0091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 -- 172.21.15.97:0/756122658 shutdown_connections 2023-06-23T00:59:35.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 --2- 172.21.15.97:0/756122658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd32c06ad00 0x7fd32c15aaa0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 --2- 172.21.15.97:0/756122658 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c156730 0x7fd32c15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 -- 172.21.15.97:0/756122658 >> 172.21.15.97:0/756122658 conn(0x7fd32c067990 msgr2=0x7fd32c0cbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:35.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 -- 172.21.15.97:0/756122658 shutdown_connections 2023-06-23T00:59:35.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 -- 172.21.15.97:0/756122658 wait complete. 2023-06-23T00:59:35.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 Processor -- start 2023-06-23T00:59:35.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.687+0000 7fd33297f700 1 -- start start 2023-06-23T00:59:35.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33297f700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd32c06ad00 0x7fd32c0b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:35.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33297f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c06d840 0x7fd32c152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:35.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33297f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c156730 0x7fd32c0c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:35.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33297f700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0cbb50 con 0x7fd32c06ad00 2023-06-23T00:59:35.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33297f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0b11c0 con 0x7fd32c06d840 2023-06-23T00:59:35.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33297f700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0c42a0 con 0x7fd32c156730 2023-06-23T00:59:35.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33197d700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd32c06ad00 0x7fd32c0b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:35.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33197d700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd32c06ad00 0x7fd32c0b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57180/0 (socket says 172.21.15.97:57180) 2023-06-23T00:59:35.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33197d700 1 -- 172.21.15.97:0/3949283227 learned_addr learned my addr 172.21.15.97:0/3949283227 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:35.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33117c700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c06d840 0x7fd32c152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:35.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33217e700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c156730 0x7fd32c0c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:35.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33197d700 1 -- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c156730 msgr2=0x7fd32c0c0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:35.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33197d700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c156730 0x7fd32c0c0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33197d700 1 -- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c06d840 msgr2=0x7fd32c152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:35.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33197d700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c06d840 0x7fd32c152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:35.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33197d700 1 -- 172.21.15.97:0/3949283227 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3280093c0 con 0x7fd32c06ad00 2023-06-23T00:59:35.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33217e700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c156730 0x7fd32c0c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:35.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33197d700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd32c06ad00 0x7fd32c0b0c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd32800ec80 tx=0x7fd328009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:35.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd321ffb700 1 -- 172.21.15.97:0/3949283227 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328005a00 con 0x7fd32c06ad00 2023-06-23T00:59:35.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd321ffb700 1 -- 172.21.15.97:0/3949283227 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd328005b60 con 0x7fd32c06ad00 2023-06-23T00:59:35.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33297f700 1 -- 172.21.15.97:0/3949283227 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c009420 con 0x7fd32c06ad00 2023-06-23T00:59:35.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd321ffb700 1 -- 172.21.15.97:0/3949283227 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32800c9d0 con 0x7fd32c06ad00 2023-06-23T00:59:35.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.691+0000 7fd33297f700 1 -- 172.21.15.97:0/3949283227 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32c0cb500 con 0x7fd32c06ad00 2023-06-23T00:59:35.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.695+0000 7fd321ffb700 1 -- 172.21.15.97:0/3949283227 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fd32800cd80 con 0x7fd32c06ad00 2023-06-23T00:59:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.695+0000 7fd33297f700 1 -- 172.21.15.97:0/3949283227 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32c06b190 con 0x7fd32c06ad00 2023-06-23T00:59:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.695+0000 7fd321ffb700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fd3100604b0 0x7fd310062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.695+0000 7fd321ffb700 1 -- 172.21.15.97:0/3949283227 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd32807ce40 con 0x7fd32c06ad00 2023-06-23T00:59:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.695+0000 7fd33117c700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fd3100604b0 0x7fd310062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.695+0000 7fd33117c700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fd3100604b0 0x7fd310062960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0030c0 tx=0x7fd31c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:35.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.703+0000 7fd321ffb700 1 -- 172.21.15.97:0/3949283227 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fd32804d2f0 con 0x7fd32c06ad00 2023-06-23T00:59:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:35.867+0000 7fd33297f700 1 -- 172.21.15.97:0/3949283227 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fd32c04b3f0 con 0x7fd32c06ad00 2023-06-23T00:59:36.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.551+0000 7fd321ffb700 1 -- 172.21.15.97:0/3949283227 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v26) v1 ==== 157+0+0 (secure 0 0 0) 0x7fd3280200e0 con 0x7fd32c06ad00 2023-06-23T00:59:36.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.555+0000 7fd33297f700 1 -- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fd3100604b0 msgr2=0x7fd310062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:36.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.555+0000 7fd33297f700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fd3100604b0 0x7fd310062960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0030c0 tx=0x7fd31c016000 comp rx=0 tx=0).stop 2023-06-23T00:59:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.555+0000 7fd33297f700 1 -- 172.21.15.97:0/3949283227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd32c06ad00 msgr2=0x7fd32c0b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.555+0000 7fd33297f700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd32c06ad00 0x7fd32c0b0c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd32800ec80 tx=0x7fd328009120 comp rx=0 tx=0).stop 2023-06-23T00:59:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.555+0000 7fd33297f700 1 -- 172.21.15.97:0/3949283227 shutdown_connections 2023-06-23T00:59:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.555+0000 7fd33297f700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fd3100604b0 0x7fd310062960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.555+0000 7fd33297f700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c156730 0x7fd32c0c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.555+0000 7fd33297f700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c06d840 0x7fd32c152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.555+0000 7fd33297f700 1 --2- 172.21.15.97:0/3949283227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd32c06ad00 0x7fd32c0b0c80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:36.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.555+0000 7fd33297f700 1 -- 172.21.15.97:0/3949283227 >> 172.21.15.97:0/3949283227 conn(0x7fd32c067990 msgr2=0x7fd32c0abbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:36.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.555+0000 7fd33297f700 1 -- 172.21.15.97:0/3949283227 shutdown_connections 2023-06-23T00:59:36.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.555+0000 7fd33297f700 1 -- 172.21.15.97:0/3949283227 wait complete. 2023-06-23T00:59:36.577 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-06-23T00:59:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.683+0000 7fe425fe4700 1 Processor -- start 2023-06-23T00:59:36.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.683+0000 7fe425fe4700 1 -- start start 2023-06-23T00:59:36.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe425fe4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4200cfe80 0x7fe42006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:36.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe425fe4700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4200b2bb0 con 0x7fe4200b55e0 2023-06-23T00:59:36.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe425fe4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4200b28b0 con 0x7fe4200cfab0 2023-06-23T00:59:36.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe425fe4700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200cd8d0 con 0x7fe4200cfe80 2023-06-23T00:59:36.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe41ffff700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe4200b55e0 0x7fe420159760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47290/0 (socket says 172.21.15.97:47290) 2023-06-23T00:59:36.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe41ffff700 1 -- 172.21.15.97:0/2053813029 learned_addr learned my addr 172.21.15.97:0/2053813029 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:36.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe4257e3700 1 --2- 172.21.15.97:0/2053813029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4200cfe80 0x7fe42006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:36.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe41f7fe700 1 -- 172.21.15.97:0/2053813029 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797840493 0 0) 0x7fe4200b2bb0 con 0x7fe4200b55e0 2023-06-23T00:59:36.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe41f7fe700 1 -- 172.21.15.97:0/2053813029 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe40c003570 con 0x7fe4200b55e0 2023-06-23T00:59:36.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe4257e3700 1 -- 172.21.15.97:0/2053813029 >> v1:172.21.15.149:6789/0 conn(0x7fe4200cfab0 legacy=0x7fe4200b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:36.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe41f7fe700 1 -- 172.21.15.97:0/2053813029 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929269134 0 0) 0x7fe4200b28b0 con 0x7fe4200cfab0 2023-06-23T00:59:36.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe4257e3700 1 -- 172.21.15.97:0/2053813029 >> v1:172.21.15.97:6789/0 conn(0x7fe4200b55e0 legacy=0x7fe420159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:36.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe4257e3700 1 -- 172.21.15.97:0/2053813029 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4200ceb60 con 0x7fe4200cfe80 2023-06-23T00:59:36.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe4257e3700 1 --2- 172.21.15.97:0/2053813029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4200cfe80 0x7fe42006c8e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe418009e90 tx=0x7fe418009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d03b198670711b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:36.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe41f7fe700 1 -- 172.21.15.97:0/2053813029 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41800e070 con 0x7fe4200cfe80 2023-06-23T00:59:36.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe41f7fe700 1 -- 172.21.15.97:0/2053813029 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41800bc30 con 0x7fe4200cfe80 2023-06-23T00:59:36.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe41f7fe700 1 -- 172.21.15.97:0/2053813029 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418012430 con 0x7fe4200cfe80 2023-06-23T00:59:36.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe425fe4700 1 -- 172.21.15.97:0/2053813029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4200cfe80 msgr2=0x7fe42006c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:36.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe425fe4700 1 --2- 172.21.15.97:0/2053813029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4200cfe80 0x7fe42006c8e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe418009e90 tx=0x7fe418009780 comp rx=0 tx=0).stop 2023-06-23T00:59:36.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe425fe4700 1 -- 172.21.15.97:0/2053813029 shutdown_connections 2023-06-23T00:59:36.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe425fe4700 1 --2- 172.21.15.97:0/2053813029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4200cfe80 0x7fe42006c8e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:36.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe425fe4700 1 -- 172.21.15.97:0/2053813029 >> 172.21.15.97:0/2053813029 conn(0x7fe42006e260 msgr2=0x7fe42006c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:36.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe425fe4700 1 -- 172.21.15.97:0/2053813029 shutdown_connections 2023-06-23T00:59:36.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.687+0000 7fe425fe4700 1 -- 172.21.15.97:0/2053813029 wait complete. 2023-06-23T00:59:36.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe425fe4700 1 Processor -- start 2023-06-23T00:59:36.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe425fe4700 1 -- start start 2023-06-23T00:59:36.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe425fe4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4200b55e0 0x7fe4200b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:36.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe425fe4700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4200cfab0 0x7fe420153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:36.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe425fe4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4200cfe80 0x7fe42015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:36.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe425fe4700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200b14c0 con 0x7fe4200cfab0 2023-06-23T00:59:36.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe425fe4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200a63a0 con 0x7fe4200b55e0 2023-06-23T00:59:36.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe425fe4700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200a6680 con 0x7fe4200cfe80 2023-06-23T00:59:36.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe41ffff700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4200cfab0 0x7fe420153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:36.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe41ffff700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4200cfab0 0x7fe420153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57188/0 (socket says 172.21.15.97:57188) 2023-06-23T00:59:36.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe41ffff700 1 -- 172.21.15.97:0/513433612 learned_addr learned my addr 172.21.15.97:0/513433612 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:36.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe4257e3700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4200cfe80 0x7fe42015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:36.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe424fe2700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4200b55e0 0x7fe4200b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:36.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe41ffff700 1 -- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4200cfe80 msgr2=0x7fe42015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:36.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe41ffff700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4200cfe80 0x7fe42015d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:36.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe41ffff700 1 -- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4200b55e0 msgr2=0x7fe4200b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:36.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe41ffff700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4200b55e0 0x7fe4200b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:36.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe41ffff700 1 -- 172.21.15.97:0/513433612 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe418009a20 con 0x7fe4200cfab0 2023-06-23T00:59:36.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe41ffff700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4200cfab0 0x7fe420153270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4080011e0 tx=0x7fe408007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:36.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe41cff9700 1 -- 172.21.15.97:0/513433612 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408005b30 con 0x7fe4200cfab0 2023-06-23T00:59:36.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe41cff9700 1 -- 172.21.15.97:0/513433612 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408005c90 con 0x7fe4200cfab0 2023-06-23T00:59:36.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe425fe4700 1 -- 172.21.15.97:0/513433612 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4200a6960 con 0x7fe4200cfab0 2023-06-23T00:59:36.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe41cff9700 1 -- 172.21.15.97:0/513433612 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408007320 con 0x7fe4200cfab0 2023-06-23T00:59:36.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.691+0000 7fe425fe4700 1 -- 172.21.15.97:0/513433612 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe420168a30 con 0x7fe4200cfab0 2023-06-23T00:59:36.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.695+0000 7fe425fe4700 1 -- 172.21.15.97:0/513433612 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe420168cb0 con 0x7fe4200cfab0 2023-06-23T00:59:36.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.695+0000 7fe41cff9700 1 -- 172.21.15.97:0/513433612 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fe408007690 con 0x7fe4200cfab0 2023-06-23T00:59:36.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.695+0000 7fe41cff9700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fe4000604b0 0x7fe400062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:36.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.695+0000 7fe41cff9700 1 -- 172.21.15.97:0/513433612 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6284+0+0 (secure 0 0 0) 0x7fe40807be60 con 0x7fe4200cfab0 2023-06-23T00:59:36.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.695+0000 7fe424fe2700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fe4000604b0 0x7fe400062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:36.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.699+0000 7fe424fe2700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fe4000604b0 0x7fe400062960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4100011e0 tx=0x7fe410009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:36.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.707+0000 7fe41cff9700 1 -- 172.21.15.97:0/513433612 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fe40804c230 con 0x7fe4200cfab0 2023-06-23T00:59:36.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:36.871+0000 7fe425fe4700 1 -- 172.21.15.97:0/513433612 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe4200a6e60 con 0x7fe4200cfab0 2023-06-23T00:59:37.165 INFO:tasks.ceph.mds.c.smithi097.stderr:2023-06-23T00:59:37.159+0000 7f3ce2adb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-23T00:59:38.487 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T00:59:38.490 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T00:59:38.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.579+0000 7fe41cff9700 1 -- 172.21.15.97:0/513433612 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v28) v1 ==== 228+0+0 (secure 0 0 0) 0x7fe408017020 con 0x7fe4200cfab0 2023-06-23T00:59:38.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.587+0000 7fe425fe4700 1 -- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fe4000604b0 msgr2=0x7fe400062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:38.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.587+0000 7fe425fe4700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fe4000604b0 0x7fe400062960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4100011e0 tx=0x7fe410009040 comp rx=0 tx=0).stop 2023-06-23T00:59:38.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.587+0000 7fe425fe4700 1 -- 172.21.15.97:0/513433612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4200cfab0 msgr2=0x7fe420153270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:38.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.587+0000 7fe425fe4700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4200cfab0 0x7fe420153270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4080011e0 tx=0x7fe408007df0 comp rx=0 tx=0).stop 2023-06-23T00:59:38.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.587+0000 7fe425fe4700 1 -- 172.21.15.97:0/513433612 shutdown_connections 2023-06-23T00:59:38.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.587+0000 7fe425fe4700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fe4000604b0 0x7fe400062960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:38.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.587+0000 7fe425fe4700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4200cfe80 0x7fe42015d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:38.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.587+0000 7fe425fe4700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4200cfab0 0x7fe420153270 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:38.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.587+0000 7fe425fe4700 1 --2- 172.21.15.97:0/513433612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4200b55e0 0x7fe4200b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:38.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.587+0000 7fe425fe4700 1 -- 172.21.15.97:0/513433612 >> 172.21.15.97:0/513433612 conn(0x7fe42006e260 msgr2=0x7fe4201550d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:38.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.587+0000 7fe425fe4700 1 -- 172.21.15.97:0/513433612 shutdown_connections 2023-06-23T00:59:38.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.587+0000 7fe425fe4700 1 -- 172.21.15.97:0/513433612 wait complete. 2023-06-23T00:59:38.599 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data_ec' created 2023-06-23T00:59:38.610 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-06-23T00:59:38.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.707+0000 7f82cb09a700 1 Processor -- start 2023-06-23T00:59:38.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.707+0000 7f82cb09a700 1 -- start start 2023-06-23T00:59:38.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82cb09a700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f82bc034310 0x7f82bc04fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:38.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82cb09a700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc007ea0 con 0x7f82bc0e3c70 2023-06-23T00:59:38.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82cb09a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc0e4150 con 0x7f82bc0346e0 2023-06-23T00:59:38.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82cb09a700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82bc034b40 con 0x7f82bc034310 2023-06-23T00:59:38.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82ca098700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f82bc034310 0x7f82bc04fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:38.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82c9897700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f82bc0e3c70 0x7f82bc0e0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47300/0 (socket says 172.21.15.97:47300) 2023-06-23T00:59:38.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82c9897700 1 -- 172.21.15.97:0/3268627462 learned_addr learned my addr 172.21.15.97:0/3268627462 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:38.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82ca098700 1 -- 172.21.15.97:0/3268627462 >> v1:172.21.15.149:6789/0 conn(0x7f82bc0346e0 legacy=0x7f82bc034d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:38.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82ca098700 1 -- 172.21.15.97:0/3268627462 >> v1:172.21.15.97:6789/0 conn(0x7f82bc0e3c70 legacy=0x7f82bc0e0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:38.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82ca098700 1 -- 172.21.15.97:0/3268627462 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0e4430 con 0x7f82bc034310 2023-06-23T00:59:38.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82ca098700 1 --2- 172.21.15.97:0/3268627462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82bc034310 0x7f82bc04fc70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f82c00098e0 tx=0x7f82c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7bac006ec5b231 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:38.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82c9096700 1 -- 172.21.15.97:0/3268627462 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0009e80 con 0x7f82bc034310 2023-06-23T00:59:38.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82c9096700 1 -- 172.21.15.97:0/3268627462 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c000b860 con 0x7f82bc034310 2023-06-23T00:59:38.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82c9096700 1 -- 172.21.15.97:0/3268627462 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c000bbe0 con 0x7f82bc034310 2023-06-23T00:59:38.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82cb09a700 1 -- 172.21.15.97:0/3268627462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82bc034310 msgr2=0x7f82bc04fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:38.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82cb09a700 1 --2- 172.21.15.97:0/3268627462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82bc034310 0x7f82bc04fc70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f82c00098e0 tx=0x7f82c00091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:38.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82cb09a700 1 -- 172.21.15.97:0/3268627462 shutdown_connections 2023-06-23T00:59:38.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82cb09a700 1 --2- 172.21.15.97:0/3268627462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82bc034310 0x7f82bc04fc70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:38.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82cb09a700 1 -- 172.21.15.97:0/3268627462 >> 172.21.15.97:0/3268627462 conn(0x7f82bc0520a0 msgr2=0x7f82bc0524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:38.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82cb09a700 1 -- 172.21.15.97:0/3268627462 shutdown_connections 2023-06-23T00:59:38.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.711+0000 7f82cb09a700 1 -- 172.21.15.97:0/3268627462 wait complete. 2023-06-23T00:59:38.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82cb09a700 1 Processor -- start 2023-06-23T00:59:38.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82cb09a700 1 -- start start 2023-06-23T00:59:38.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82cb09a700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82bc034310 0x7f82bc0d7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:38.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82cb09a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82bc0346e0 0x7f82bc04c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:38.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82cb09a700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82bc0e3c70 0x7f82bc0df450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:38.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82cb09a700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0d7eb0 con 0x7f82bc034310 2023-06-23T00:59:38.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82cb09a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0394a0 con 0x7f82bc0346e0 2023-06-23T00:59:38.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82cb09a700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc04cf30 con 0x7f82bc0e3c70 2023-06-23T00:59:38.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82ca098700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82bc034310 0x7f82bc0d7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:38.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82ca098700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82bc034310 0x7f82bc0d7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57198/0 (socket says 172.21.15.97:57198) 2023-06-23T00:59:38.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82ca098700 1 -- 172.21.15.97:0/1058236702 learned_addr learned my addr 172.21.15.97:0/1058236702 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:38.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82c9897700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82bc0346e0 0x7f82bc04c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:38.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82ca899700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82bc0e3c70 0x7f82bc0df450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:38.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82ca098700 1 -- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82bc0e3c70 msgr2=0x7f82bc0df450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:38.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82ca098700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82bc0e3c70 0x7f82bc0df450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:38.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82ca098700 1 -- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82bc0346e0 msgr2=0x7f82bc04c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:38.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82ca098700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82bc0346e0 0x7f82bc04c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:38.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82ca098700 1 -- 172.21.15.97:0/1058236702 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c0009420 con 0x7f82bc034310 2023-06-23T00:59:38.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82ca098700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82bc034310 0x7f82bc0d7970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82c00091e0 tx=0x7f82c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:38.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82ba7fc700 1 -- 172.21.15.97:0/1058236702 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c000bb20 con 0x7f82bc034310 2023-06-23T00:59:38.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82ba7fc700 1 -- 172.21.15.97:0/1058236702 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c0025420 con 0x7f82bc034310 2023-06-23T00:59:38.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82cb09a700 1 -- 172.21.15.97:0/1058236702 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc04d210 con 0x7f82bc034310 2023-06-23T00:59:38.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.715+0000 7f82ba7fc700 1 -- 172.21.15.97:0/1058236702 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c00257e0 con 0x7f82bc034310 2023-06-23T00:59:38.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.719+0000 7f82cb09a700 1 -- 172.21.15.97:0/1058236702 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82bc04d7d0 con 0x7f82bc034310 2023-06-23T00:59:38.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.719+0000 7f82cb09a700 1 -- 172.21.15.97:0/1058236702 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82bc0058f0 con 0x7f82bc034310 2023-06-23T00:59:38.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.719+0000 7f82ba7fc700 1 -- 172.21.15.97:0/1058236702 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f82c0023070 con 0x7f82bc034310 2023-06-23T00:59:38.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.719+0000 7f82ba7fc700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f82a80604b0 0x7f82a8062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:38.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.719+0000 7f82ba7fc700 1 -- 172.21.15.97:0/1058236702 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f82c007e200 con 0x7f82bc034310 2023-06-23T00:59:38.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.719+0000 7f82c9897700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f82a80604b0 0x7f82a8062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:38.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.723+0000 7f82c9897700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f82a80604b0 0x7f82a8062960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0079d0 tx=0x7f82b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:38.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.727+0000 7f82ba7fc700 1 -- 172.21.15.97:0/1058236702 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f82c004e4c0 con 0x7f82bc034310 2023-06-23T00:59:38.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:38.887+0000 7f82cb09a700 1 -- 172.21.15.97:0/1058236702 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f82bc0518c0 con 0x7f82bc034310 2023-06-23T00:59:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.591+0000 7f82ba7fc700 1 -- 172.21.15.97:0/1058236702 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f82c0051aa0 con 0x7f82bc034310 2023-06-23T00:59:39.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.599+0000 7f82cb09a700 1 -- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f82a80604b0 msgr2=0x7f82a8062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:39.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.599+0000 7f82cb09a700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f82a80604b0 0x7f82a8062960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0079d0 tx=0x7f82b4009040 comp rx=0 tx=0).stop 2023-06-23T00:59:39.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.599+0000 7f82cb09a700 1 -- 172.21.15.97:0/1058236702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82bc034310 msgr2=0x7f82bc0d7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:39.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.599+0000 7f82cb09a700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82bc034310 0x7f82bc0d7970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82c00091e0 tx=0x7f82c0017000 comp rx=0 tx=0).stop 2023-06-23T00:59:39.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.599+0000 7f82cb09a700 1 -- 172.21.15.97:0/1058236702 shutdown_connections 2023-06-23T00:59:39.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.599+0000 7f82cb09a700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f82a80604b0 0x7f82a8062960 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0079d0 tx=0x7f82b4009040 comp rx=0 tx=0).stop 2023-06-23T00:59:39.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.599+0000 7f82cb09a700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82bc0e3c70 0x7f82bc0df450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.599+0000 7f82cb09a700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82bc0346e0 0x7f82bc04c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.599+0000 7f82cb09a700 1 --2- 172.21.15.97:0/1058236702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82bc034310 0x7f82bc0d7970 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82c00091e0 tx=0x7f82c0017000 comp rx=0 tx=0).stop 2023-06-23T00:59:39.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.599+0000 7f82cb09a700 1 -- 172.21.15.97:0/1058236702 >> 172.21.15.97:0/1058236702 conn(0x7f82bc0520a0 msgr2=0x7f82bc006f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:39.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.623+0000 7f82cb09a700 1 -- 172.21.15.97:0/1058236702 shutdown_connections 2023-06-23T00:59:39.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.623+0000 7f82cb09a700 1 -- 172.21.15.97:0/1058236702 wait complete. 2023-06-23T00:59:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:set pool 5 allow_ec_overwrites to true 2023-06-23T00:59:39.643 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-06-23T00:59:39.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.739+0000 7f29b57a8700 1 Processor -- start 2023-06-23T00:59:39.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.739+0000 7f29b57a8700 1 -- start start 2023-06-23T00:59:39.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b57a8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f29b00cfab0 0x7f29b00cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b57a8700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b00b2bb0 con 0x7f29b00b55e0 2023-06-23T00:59:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b57a8700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b00b28b0 con 0x7f29b006c8e0 2023-06-23T00:59:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b57a8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b00cd8d0 con 0x7f29b00cfab0 2023-06-23T00:59:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29af7fe700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f29b00b55e0 0x7f29b00b3040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57896/0 (socket says 172.21.15.97:57896) 2023-06-23T00:59:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29af7fe700 1 -- 172.21.15.97:0/4290709308 learned_addr learned my addr 172.21.15.97:0/4290709308 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29affff700 1 --2- 172.21.15.97:0/4290709308 >> v2:172.21.15.149:3300/0 conn(0x7f29b00cfab0 0x7f29b00cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:39.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390150413 0 0) 0x7f29b00b2bb0 con 0x7f29b00b55e0 2023-06-23T00:59:39.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f299c003570 con 0x7f29b00b55e0 2023-06-23T00:59:39.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 389501881 0 0) 0x7f299c003570 con 0x7f29b00b55e0 2023-06-23T00:59:39.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 >> v2:172.21.15.149:3300/0 conn(0x7f29b00cfab0 msgr2=0x7f29b00cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:39.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 --2- 172.21.15.97:0/4290709308 >> v2:172.21.15.149:3300/0 conn(0x7f29b00cfab0 0x7f29b00cfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 >> v1:172.21.15.149:6789/0 conn(0x7f29b006c8e0 legacy=0x7f29b0159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:39.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b006ccf0 con 0x7f29b00b55e0 2023-06-23T00:59:39.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1366942832 0 0) 0x7f29a0001470 con 0x7f29b00b55e0 2023-06-23T00:59:39.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 >> v1:172.21.15.97:6789/0 conn(0x7f29b00b55e0 legacy=0x7f29b00b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:39.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 --2- 172.21.15.97:0/4290709308 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f299c003a60 0x7f299c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:39.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 --2- 172.21.15.97:0/4290709308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f299c004400 0x7f299c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:39.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 --2- 172.21.15.97:0/4290709308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f299c0050b0 0x7f299c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:39.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00cd8d0 con 0x7f299c004400 2023-06-23T00:59:39.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29af7fe700 1 --2- 172.21.15.97:0/4290709308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f299c004400 0x7f299c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:39.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c00bfd0 con 0x7f299c0050b0 2023-06-23T00:59:39.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c00c190 con 0x7f299c003a60 2023-06-23T00:59:39.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29affff700 1 --2- 172.21.15.97:0/4290709308 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f299c003a60 0x7f299c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:39.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b4fa7700 1 --2- 172.21.15.97:0/4290709308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f299c0050b0 0x7f299c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:39.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29af7fe700 1 -- 172.21.15.97:0/4290709308 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f299c003a60 msgr2=0x7f299c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:39.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29af7fe700 1 --2- 172.21.15.97:0/4290709308 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f299c003a60 0x7f299c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29af7fe700 1 -- 172.21.15.97:0/4290709308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f299c0050b0 msgr2=0x7f299c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:39.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29af7fe700 1 --2- 172.21.15.97:0/4290709308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f299c0050b0 0x7f299c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29af7fe700 1 -- 172.21.15.97:0/4290709308 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c003570 con 0x7f299c004400 2023-06-23T00:59:39.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b4fa7700 1 --2- 172.21.15.97:0/4290709308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f299c0050b0 0x7f299c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:39.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b4fa7700 1 -- 172.21.15.97:0/4290709308 reap_dead start 2023-06-23T00:59:39.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29af7fe700 1 --2- 172.21.15.97:0/4290709308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f299c004400 0x7f299c0048b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f29a0001eb0 tx=0x7f29a0008ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cbbb4e4dbe0aac server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:39.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a0005920 con 0x7f299c004400 2023-06-23T00:59:39.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a0005a80 con 0x7f299c004400 2023-06-23T00:59:39.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29aeffd700 1 -- 172.21.15.97:0/4290709308 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a0005e20 con 0x7f299c004400 2023-06-23T00:59:39.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b57a8700 1 -- 172.21.15.97:0/4290709308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f299c004400 msgr2=0x7f299c0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:39.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b57a8700 1 --2- 172.21.15.97:0/4290709308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f299c004400 0x7f299c0048b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f29a0001eb0 tx=0x7f29a0008ca0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b57a8700 1 -- 172.21.15.97:0/4290709308 shutdown_connections 2023-06-23T00:59:39.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b57a8700 1 --2- 172.21.15.97:0/4290709308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f299c004400 0x7f299c0048b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b57a8700 1 -- 172.21.15.97:0/4290709308 >> 172.21.15.97:0/4290709308 conn(0x7f29b006e260 msgr2=0x7f29b006c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:39.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b57a8700 1 -- 172.21.15.97:0/4290709308 shutdown_connections 2023-06-23T00:59:39.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.743+0000 7f29b57a8700 1 -- 172.21.15.97:0/4290709308 wait complete. 2023-06-23T00:59:39.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29b57a8700 1 Processor -- start 2023-06-23T00:59:39.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29b57a8700 1 -- start start 2023-06-23T00:59:39.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29b57a8700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b0168960 0x7f29b0169ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:39.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29b57a8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29b015eda0 0x7f29b016b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:39.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29b57a8700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29b016ba10 0x7f29b0166530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:39.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29b57a8700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b016a430 con 0x7f29b0168960 2023-06-23T00:59:39.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29b57a8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b016a710 con 0x7f29b015eda0 2023-06-23T00:59:39.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29b57a8700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b016a9f0 con 0x7f29b016ba10 2023-06-23T00:59:39.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29affff700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b0168960 0x7f29b0169ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:39.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29affff700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b0168960 0x7f29b0169ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35700/0 (socket says 172.21.15.97:35700) 2023-06-23T00:59:39.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29affff700 1 -- 172.21.15.97:0/202178657 learned_addr learned my addr 172.21.15.97:0/202178657 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:39.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29b4fa7700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29b016ba10 0x7f29b0166530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:39.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29af7fe700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29b015eda0 0x7f29b016b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:39.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29affff700 1 -- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29b016ba10 msgr2=0x7f29b0166530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:39.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29affff700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29b016ba10 0x7f29b0166530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29affff700 1 -- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29b015eda0 msgr2=0x7f29b016b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:39.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29affff700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29b015eda0 0x7f29b016b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29affff700 1 -- 172.21.15.97:0/202178657 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b016acd0 con 0x7f29b0168960 2023-06-23T00:59:39.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29affff700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b0168960 0x7f29b0169ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2998011d40 tx=0x7f29980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:39.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29a7fff700 1 -- 172.21.15.97:0/202178657 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299800fac0 con 0x7f29b0168960 2023-06-23T00:59:39.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29a7fff700 1 -- 172.21.15.97:0/202178657 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299800fc20 con 0x7f29b0168960 2023-06-23T00:59:39.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29b57a8700 1 -- 172.21.15.97:0/202178657 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b016afb0 con 0x7f29b0168960 2023-06-23T00:59:39.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29a7fff700 1 -- 172.21.15.97:0/202178657 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998014440 con 0x7f29b0168960 2023-06-23T00:59:39.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.747+0000 7f29b57a8700 1 -- 172.21.15.97:0/202178657 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b016a000 con 0x7f29b0168960 2023-06-23T00:59:39.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.751+0000 7f29b57a8700 1 -- 172.21.15.97:0/202178657 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b004bc30 con 0x7f29b0168960 2023-06-23T00:59:39.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.751+0000 7f29a7fff700 1 -- 172.21.15.97:0/202178657 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f2998014870 con 0x7f29b0168960 2023-06-23T00:59:39.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.751+0000 7f29a7fff700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f29900604b0 0x7f2990062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:39.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.751+0000 7f29a7fff700 1 -- 172.21.15.97:0/202178657 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f2998018030 con 0x7f29b0168960 2023-06-23T00:59:39.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.751+0000 7f29af7fe700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f29900604b0 0x7f2990062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:39.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.751+0000 7f29af7fe700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f29900604b0 0x7f2990062960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29a0008ce0 tx=0x7f29a0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:39.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.759+0000 7f29a7fff700 1 -- 172.21.15.97:0/202178657 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f299804d820 con 0x7f29b0168960 2023-06-23T00:59:39.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.959+0000 7f29b57a8700 1 -- 172.21.15.97:0/202178657 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f29b004b3f0 con 0x7f29b0168960 2023-06-23T00:59:39.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.967+0000 7f29a7fff700 1 -- 172.21.15.97:0/202178657 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f2998050e40 con 0x7f29b0168960 2023-06-23T00:59:39.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.971+0000 7f29b57a8700 1 -- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f29900604b0 msgr2=0x7f2990062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:39.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.971+0000 7f29b57a8700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f29900604b0 0x7f2990062960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29a0008ce0 tx=0x7f29a0016000 comp rx=0 tx=0).stop 2023-06-23T00:59:39.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.971+0000 7f29b57a8700 1 -- 172.21.15.97:0/202178657 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b0168960 msgr2=0x7f29b0169ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:39.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.971+0000 7f29b57a8700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b0168960 0x7f29b0169ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2998011d40 tx=0x7f29980091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.971+0000 7f29b57a8700 1 -- 172.21.15.97:0/202178657 shutdown_connections 2023-06-23T00:59:39.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.971+0000 7f29b57a8700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f29900604b0 0x7f2990062960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.971+0000 7f29b57a8700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29b016ba10 0x7f29b0166530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.971+0000 7f29b57a8700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29b015eda0 0x7f29b016b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.971+0000 7f29b57a8700 1 --2- 172.21.15.97:0/202178657 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b0168960 0x7f29b0169ac0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:39.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.971+0000 7f29b57a8700 1 -- 172.21.15.97:0/202178657 >> 172.21.15.97:0/202178657 conn(0x7f29b006e260 msgr2=0x7f29b0156910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:39.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.971+0000 7f29b57a8700 1 -- 172.21.15.97:0/202178657 shutdown_connections 2023-06-23T00:59:39.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:39.971+0000 7f29b57a8700 1 -- 172.21.15.97:0/202178657 wait complete. 2023-06-23T00:59:39.980 INFO:teuthology.orchestra.run.smithi097.stderr:added data pool 5 to fsmap 2023-06-23T00:59:39.989 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T00:59:40.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2087507700 1 Processor -- start 2023-06-23T00:59:40.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2087507700 1 -- start start 2023-06-23T00:59:40.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2087507700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f20800aed20 0x7f20800cf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2087507700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f208006c1d0 0x7f208006c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2087507700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20800ce090 con 0x7f20800ca860 2023-06-23T00:59:40.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2087507700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2080159160 con 0x7f208006c1d0 2023-06-23T00:59:40.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2087507700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20800ceef0 con 0x7f20800aed20 2023-06-23T00:59:40.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2085d04700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f208006c1d0 0x7f208006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2085d04700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f208006c1d0 0x7f208006c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35716/0 (socket says 172.21.15.97:35716) 2023-06-23T00:59:40.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2085d04700 1 -- 172.21.15.97:0/2631035062 learned_addr learned my addr 172.21.15.97:0/2631035062 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:40.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2086505700 1 --2- 172.21.15.97:0/2631035062 >> v2:172.21.15.149:3300/0 conn(0x7f20800aed20 0x7f20800cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2085d04700 1 -- 172.21.15.97:0/2631035062 >> v2:172.21.15.149:3300/0 conn(0x7f20800aed20 msgr2=0x7f20800cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:40.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2085d04700 1 --2- 172.21.15.97:0/2631035062 >> v2:172.21.15.149:3300/0 conn(0x7f20800aed20 0x7f20800cf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2085d04700 1 -- 172.21.15.97:0/2631035062 >> v1:172.21.15.149:6789/0 conn(0x7f20800ca860 legacy=0x7f208015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:40.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2085d04700 1 -- 172.21.15.97:0/2631035062 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208006cb60 con 0x7f208006c1d0 2023-06-23T00:59:40.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2085d04700 1 --2- 172.21.15.97:0/2631035062 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f208006c1d0 0x7f208006c620 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f20800d0bc0 tx=0x7f207c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ea26d0fb8ce811 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:40.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.087+0000 7f2085503700 1 -- 172.21.15.97:0/2631035062 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c00e070 con 0x7f208006c1d0 2023-06-23T00:59:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2085503700 1 -- 172.21.15.97:0/2631035062 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c00ba10 con 0x7f208006c1d0 2023-06-23T00:59:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2085503700 1 -- 172.21.15.97:0/2631035062 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c0092e0 con 0x7f208006c1d0 2023-06-23T00:59:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 -- 172.21.15.97:0/2631035062 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f208006c1d0 msgr2=0x7f208006c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 --2- 172.21.15.97:0/2631035062 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f208006c1d0 0x7f208006c620 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f20800d0bc0 tx=0x7f207c009840 comp rx=0 tx=0).stop 2023-06-23T00:59:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 -- 172.21.15.97:0/2631035062 shutdown_connections 2023-06-23T00:59:40.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 --2- 172.21.15.97:0/2631035062 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f208006c1d0 0x7f208006c620 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 --2- 172.21.15.97:0/2631035062 >> v2:172.21.15.149:3300/0 conn(0x7f20800aed20 0x7f20800cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 -- 172.21.15.97:0/2631035062 >> 172.21.15.97:0/2631035062 conn(0x7f208006e1c0 msgr2=0x7f20800cfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:40.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 -- 172.21.15.97:0/2631035062 shutdown_connections 2023-06-23T00:59:40.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 -- 172.21.15.97:0/2631035062 wait complete. 2023-06-23T00:59:40.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 Processor -- start 2023-06-23T00:59:40.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 -- start start 2023-06-23T00:59:40.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f208006c1d0 0x7f20800c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20800aed20 0x7f20800b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20800ca860 0x7f2080169620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2080159510 con 0x7f208006c1d0 2023-06-23T00:59:40.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20800c8360 con 0x7f20800aed20 2023-06-23T00:59:40.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2087507700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20800c8640 con 0x7f20800ca860 2023-06-23T00:59:40.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2086505700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f208006c1d0 0x7f20800c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2086505700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f208006c1d0 0x7f20800c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35718/0 (socket says 172.21.15.97:35718) 2023-06-23T00:59:40.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2086505700 1 -- 172.21.15.97:0/1469086369 learned_addr learned my addr 172.21.15.97:0/1469086369 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:40.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2085d04700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20800aed20 0x7f20800b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.091+0000 7f2086d06700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20800ca860 0x7f2080169620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.095+0000 7f2086505700 1 -- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20800ca860 msgr2=0x7f2080169620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.095+0000 7f2086505700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20800ca860 0x7f2080169620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.095+0000 7f2086505700 1 -- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20800aed20 msgr2=0x7f20800b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.095+0000 7f2086505700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20800aed20 0x7f20800b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.095+0000 7f2086505700 1 -- 172.21.15.97:0/1469086369 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c009ae0 con 0x7f208006c1d0 2023-06-23T00:59:40.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.095+0000 7f2086505700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f208006c1d0 0x7f20800c7b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f207800d890 tx=0x7f2078008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:40.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.095+0000 7f20767fc700 1 -- 172.21.15.97:0/1469086369 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780125f0 con 0x7f208006c1d0 2023-06-23T00:59:40.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.095+0000 7f20767fc700 1 -- 172.21.15.97:0/1469086369 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2078012770 con 0x7f208006c1d0 2023-06-23T00:59:40.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.095+0000 7f2087507700 1 -- 172.21.15.97:0/1469086369 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20800c8920 con 0x7f208006c1d0 2023-06-23T00:59:40.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.095+0000 7f20767fc700 1 -- 172.21.15.97:0/1469086369 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2078012b30 con 0x7f208006c1d0 2023-06-23T00:59:40.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.095+0000 7f2087507700 1 -- 172.21.15.97:0/1469086369 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20800b4fd0 con 0x7f208006c1d0 2023-06-23T00:59:40.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.095+0000 7f2087507700 1 -- 172.21.15.97:0/1469086369 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20800c8b60 con 0x7f208006c1d0 2023-06-23T00:59:40.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.095+0000 7f20767fc700 1 -- 172.21.15.97:0/1469086369 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f207801e460 con 0x7f208006c1d0 2023-06-23T00:59:40.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.099+0000 7f20767fc700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f206c0604b0 0x7f206c062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.099+0000 7f20767fc700 1 -- 172.21.15.97:0/1469086369 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f207807d0e0 con 0x7f208006c1d0 2023-06-23T00:59:40.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.099+0000 7f2085d04700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f206c0604b0 0x7f206c062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.099+0000 7f2085d04700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f206c0604b0 0x7f206c062960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f20800d0bc0 tx=0x7f207c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:40.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.103+0000 7f20767fc700 1 -- 172.21.15.97:0/1469086369 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f20800c8b60 con 0x7f208006c1d0 2023-06-23T00:59:40.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.303+0000 7f2087507700 1 -- 172.21.15.97:0/1469086369 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20801592e0 con 0x7f208006c1d0 2023-06-23T00:59:40.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.303+0000 7f20767fc700 1 -- 172.21.15.97:0/1469086369 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4616 (secure 0 0 0) 0x7f20801592e0 con 0x7f208006c1d0 2023-06-23T00:59:40.310 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:59:40.310 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6833/361425768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":361425768},{"type":"v1","addr":"172.21.15.97:6833","nonce":361425768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2295858768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2295858768},{"type":"v1","addr":"172.21.15.149:6835","nonce":2295858768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3038582563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3038582563},{"type":"v1","addr":"172.21.15.149:6837","nonce":3038582563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T00:59:35.539439+0000","modified":"2023-06-23T00:59:39.964160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/163806060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":163806060},{"type":"v1","addr":"172.21.15.97:6835","nonce":163806060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-06-23T00:59:40.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.307+0000 7f2087507700 1 -- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f206c0604b0 msgr2=0x7f206c062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.307+0000 7f2087507700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f206c0604b0 0x7f206c062960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f20800d0bc0 tx=0x7f207c017000 comp rx=0 tx=0).stop 2023-06-23T00:59:40.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.307+0000 7f2087507700 1 -- 172.21.15.97:0/1469086369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f208006c1d0 msgr2=0x7f20800c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.307+0000 7f2087507700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f208006c1d0 0x7f20800c7b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f207800d890 tx=0x7f2078008040 comp rx=0 tx=0).stop 2023-06-23T00:59:40.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.307+0000 7f2087507700 1 -- 172.21.15.97:0/1469086369 shutdown_connections 2023-06-23T00:59:40.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.307+0000 7f2087507700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f206c0604b0 0x7f206c062960 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.307+0000 7f2087507700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20800ca860 0x7f2080169620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.307+0000 7f2087507700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20800aed20 0x7f20800b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.307+0000 7f2087507700 1 --2- 172.21.15.97:0/1469086369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f208006c1d0 0x7f20800c7b30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.307+0000 7f2087507700 1 -- 172.21.15.97:0/1469086369 >> 172.21.15.97:0/1469086369 conn(0x7f208006e1c0 msgr2=0x7f2080157850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:40.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.307+0000 7f2087507700 1 -- 172.21.15.97:0/1469086369 shutdown_connections 2023-06-23T00:59:40.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.307+0000 7f2087507700 1 -- 172.21.15.97:0/1469086369 wait complete. 2023-06-23T00:59:40.316 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 7 2023-06-23T00:59:40.328 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T00:59:40.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f180a06a700 1 Processor -- start 2023-06-23T00:59:40.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f180a06a700 1 -- start start 2023-06-23T00:59:40.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f180a06a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f180406f000 0x7f1804069b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f180a06a700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f180406a080 0x7f18040c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f180a06a700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180406eb70 con 0x7f1804152f70 2023-06-23T00:59:40.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f180a06a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180406a500 con 0x7f180406f000 2023-06-23T00:59:40.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f180a06a700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180406dc90 con 0x7f180406a080 2023-06-23T00:59:40.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f1809068700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1804152f70 0x7f180406d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57908/0 (socket says 172.21.15.97:57908) 2023-06-23T00:59:40.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f1809068700 1 -- 172.21.15.97:0/2317799096 learned_addr learned my addr 172.21.15.97:0/2317799096 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:40.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f1809869700 1 --2- 172.21.15.97:0/2317799096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f180406a080 0x7f18040c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f1808867700 1 --2- 172.21.15.97:0/2317799096 >> v2:172.21.15.149:3300/0 conn(0x7f180406f000 0x7f1804069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f17f7fff700 1 -- 172.21.15.97:0/2317799096 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482183478 0 0) 0x7f180406eb70 con 0x7f1804152f70 2023-06-23T00:59:40.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f17f7fff700 1 -- 172.21.15.97:0/2317799096 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f0003570 con 0x7f1804152f70 2023-06-23T00:59:40.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f1809869700 1 -- 172.21.15.97:0/2317799096 >> v2:172.21.15.149:3300/0 conn(0x7f180406f000 msgr2=0x7f1804069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:40.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f1809869700 1 --2- 172.21.15.97:0/2317799096 >> v2:172.21.15.149:3300/0 conn(0x7f180406f000 0x7f1804069b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f1809869700 1 -- 172.21.15.97:0/2317799096 >> v1:172.21.15.97:6789/0 conn(0x7f1804152f70 legacy=0x7f180406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f1809869700 1 -- 172.21.15.97:0/2317799096 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180406df60 con 0x7f180406a080 2023-06-23T00:59:40.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f1809869700 1 --2- 172.21.15.97:0/2317799096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f180406a080 0x7f18040c7e80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0098e0 tx=0x7f17fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc08ac40eaaa6f91 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:40.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f17f7fff700 1 -- 172.21.15.97:0/2317799096 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc011630 con 0x7f180406a080 2023-06-23T00:59:40.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f17f7fff700 1 -- 172.21.15.97:0/2317799096 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc011790 con 0x7f180406a080 2023-06-23T00:59:40.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.423+0000 7f17f7fff700 1 -- 172.21.15.97:0/2317799096 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc011b30 con 0x7f180406a080 2023-06-23T00:59:40.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.427+0000 7f180a06a700 1 -- 172.21.15.97:0/2317799096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f180406a080 msgr2=0x7f18040c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.427+0000 7f180a06a700 1 --2- 172.21.15.97:0/2317799096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f180406a080 0x7f18040c7e80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0098e0 tx=0x7f17fc0091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.427+0000 7f180a06a700 1 -- 172.21.15.97:0/2317799096 shutdown_connections 2023-06-23T00:59:40.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.427+0000 7f180a06a700 1 --2- 172.21.15.97:0/2317799096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f180406a080 0x7f18040c7e80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.427+0000 7f180a06a700 1 --2- 172.21.15.97:0/2317799096 >> v2:172.21.15.149:3300/0 conn(0x7f180406f000 0x7f1804069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.427+0000 7f180a06a700 1 -- 172.21.15.97:0/2317799096 >> 172.21.15.97:0/2317799096 conn(0x7f18040cad80 msgr2=0x7f1804069430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:40.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.427+0000 7f180a06a700 1 -- 172.21.15.97:0/2317799096 shutdown_connections 2023-06-23T00:59:40.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.427+0000 7f180a06a700 1 -- 172.21.15.97:0/2317799096 wait complete. 2023-06-23T00:59:40.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.427+0000 7f180a06a700 1 Processor -- start 2023-06-23T00:59:40.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.427+0000 7f180a06a700 1 -- start start 2023-06-23T00:59:40.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.427+0000 7f180a06a700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f180406a080 0x7f18040ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.427+0000 7f180a06a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f180406f000 0x7f18040abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f180a06a700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1804152f70 0x7f18040ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f180a06a700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18040ab3b0 con 0x7f1804152f70 2023-06-23T00:59:40.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f180a06a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18040aa7a0 con 0x7f180406f000 2023-06-23T00:59:40.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f180a06a700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18040aaa80 con 0x7f180406a080 2023-06-23T00:59:40.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f1809869700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1804152f70 0x7f18040ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f1809869700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1804152f70 0x7f18040ac2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35732/0 (socket says 172.21.15.97:35732) 2023-06-23T00:59:40.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f1809869700 1 -- 172.21.15.97:0/965553293 learned_addr learned my addr 172.21.15.97:0/965553293 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:40.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f1809068700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f180406a080 0x7f18040ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f1808867700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f180406f000 0x7f18040abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f1809869700 1 -- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f180406a080 msgr2=0x7f18040ab840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f1809869700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f180406a080 0x7f18040ab840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f1809869700 1 -- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f180406f000 msgr2=0x7f18040abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f1809869700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f180406f000 0x7f18040abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f1809869700 1 -- 172.21.15.97:0/965553293 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc009420 con 0x7f1804152f70 2023-06-23T00:59:40.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f1809068700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f180406a080 0x7f18040ab840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:40.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f1809869700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1804152f70 0x7f18040ac2c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f180406ddd0 tx=0x7f17fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:40.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f17f57fa700 1 -- 172.21.15.97:0/965553293 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0119d0 con 0x7f1804152f70 2023-06-23T00:59:40.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f17f57fa700 1 -- 172.21.15.97:0/965553293 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc026430 con 0x7f1804152f70 2023-06-23T00:59:40.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f180a06a700 1 -- 172.21.15.97:0/965553293 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18040aad60 con 0x7f1804152f70 2023-06-23T00:59:40.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f17f57fa700 1 -- 172.21.15.97:0/965553293 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0267f0 con 0x7f1804152f70 2023-06-23T00:59:40.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f180a06a700 1 -- 172.21.15.97:0/965553293 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180414fb60 con 0x7f1804152f70 2023-06-23T00:59:40.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.431+0000 7f180a06a700 1 -- 172.21.15.97:0/965553293 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18040ab520 con 0x7f1804152f70 2023-06-23T00:59:40.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.435+0000 7f17f57fa700 1 -- 172.21.15.97:0/965553293 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f17fc023030 con 0x7f1804152f70 2023-06-23T00:59:40.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.435+0000 7f17f57fa700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f17e80604b0 0x7f17e8062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.435+0000 7f17f57fa700 1 -- 172.21.15.97:0/965553293 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f17fc07d9f0 con 0x7f1804152f70 2023-06-23T00:59:40.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.435+0000 7f1809068700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f17e80604b0 0x7f17e8062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.435+0000 7f1809068700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f17e80604b0 0x7f17e8062960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1800005c50 tx=0x7f1800009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:40.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.443+0000 7f17f57fa700 1 -- 172.21.15.97:0/965553293 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f17fc04dbb0 con 0x7f1804152f70 2023-06-23T00:59:40.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.603+0000 7f180a06a700 1 -- 172.21.15.97:0/965553293 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f180406e240 con 0x7f1804152f70 2023-06-23T00:59:40.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.607+0000 7f17f57fa700 1 -- 172.21.15.97:0/965553293 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f17fc0511d0 con 0x7f1804152f70 2023-06-23T00:59:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:59:40.614 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":30,"fsid":"6b52ccf4-99f4-48c9-9a8a-9a183942c228","created":"2023-06-23T00:59:11.989322+0000","modified":"2023-06-23T00:59:39.963836+0000","last_up_change":"2023-06-23T00:59:22.950578+0000","last_in_change":"2023-06-23T00:59:14.057374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T00:59:24.275869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T00:59:29.802618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T00:59:33.890862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T00:59:34.526165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T00:59:37.609350+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"291bc189-d5fb-482f-92d6-f7ecfb0a388c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":32817},{"type":"v1","addr":"172.21.15.97:6801","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":32817},{"type":"v1","addr":"172.21.15.97:6803","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":32817},{"type":"v1","addr":"172.21.15.97:6807","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":32817},{"type":"v1","addr":"172.21.15.97:6805","nonce":32817}]},"public_addr":"172.21.15.97:6801/32817","cluster_addr":"172.21.15.97:6803/32817","heartbeat_back_addr":"172.21.15.97:6807/32817","heartbeat_front_addr":"172.21.15.97:6805/32817","state":["exists","up"]},{"osd":1,"uuid":"693551b5-827b-4530-80b1-a836095efbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":32818},{"type":"v1","addr":"172.21.15.97:6817","nonce":32818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":32818},{"type":"v1","addr":"172.21.15.97:6819","nonce":32818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":32818},{"type":"v1","addr":"172.21.15.97:6823","nonce":32818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":32818},{"type":"v1","addr":"172.21.15.97:6821","nonce":32818}]},"public_addr":"172.21.15.97:6817/32818","cluster_addr":"172.21.15.97:6819/32818","heartbeat_back_addr":"172.21.15.97:6823/32818","heartbeat_front_addr":"172.21.15.97:6821/32818","state":["exists","up"]},{"osd":2,"uuid":"a100d026-e382-4e71-bda5-ffa59f6b596b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":32820},{"type":"v1","addr":"172.21.15.97:6825","nonce":32820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":32820},{"type":"v1","addr":"172.21.15.97:6827","nonce":32820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":32820},{"type":"v1","addr":"172.21.15.97:6831","nonce":32820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":32820},{"type":"v1","addr":"172.21.15.97:6829","nonce":32820}]},"public_addr":"172.21.15.97:6825/32820","cluster_addr":"172.21.15.97:6827/32820","heartbeat_back_addr":"172.21.15.97:6831/32820","heartbeat_front_addr":"172.21.15.97:6829/32820","state":["exists","up"]},{"osd":3,"uuid":"91783241-7821-458e-996f-a740274b18ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":32819},{"type":"v1","addr":"172.21.15.97:6809","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":32819},{"type":"v1","addr":"172.21.15.97:6811","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":32819},{"type":"v1","addr":"172.21.15.97:6815","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":32819},{"type":"v1","addr":"172.21.15.97:6813","nonce":32819}]},"public_addr":"172.21.15.97:6809/32819","cluster_addr":"172.21.15.97:6811/32819","heartbeat_back_addr":"172.21.15.97:6815/32819","heartbeat_front_addr":"172.21.15.97:6813/32819","state":["exists","up"]},{"osd":4,"uuid":"67c375d3-ec8f-4d1a-bea7-e47896705fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":32992},{"type":"v1","addr":"172.21.15.149:6801","nonce":32992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":32992},{"type":"v1","addr":"172.21.15.149:6803","nonce":32992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":32992},{"type":"v1","addr":"172.21.15.149:6807","nonce":32992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":32992},{"type":"v1","addr":"172.21.15.149:6805","nonce":32992}]},"public_addr":"172.21.15.149:6801/32992","cluster_addr":"172.21.15.149:6803/32992","heartbeat_back_addr":"172.21.15.149:6807/32992","heartbeat_front_addr":"172.21.15.149:6805/32992","state":["exists","up"]},{"osd":5,"uuid":"9de42b7c-cf51-4adf-9cc1-11c8d9863574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":32995},{"type":"v1","addr":"172.21.15.149:6809","nonce":32995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":32995},{"type":"v1","addr":"172.21.15.149:6811","nonce":32995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":32995},{"type":"v1","addr":"172.21.15.149:6815","nonce":32995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":32995},{"type":"v1","addr":"172.21.15.149:6813","nonce":32995}]},"public_addr":"172.21.15.149:6809/32995","cluster_addr":"172.21.15.149:6811/32995","heartbeat_back_addr":"172.21.15.149:6815/32995","heartbeat_front_addr":"172.21.15.149:6813/32995","state":["exists","up"]},{"osd":6,"uuid":"ffa4ef96-2528-45cb-b2c9-a6c671b234e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":32996},{"type":"v1","addr":"172.21.15.149:6825","nonce":32996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":32996},{"type":"v1","addr":"172.21.15.149:6827","nonce":32996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":32996},{"type":"v1","addr":"172.21.15.149:6831","nonce":32996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":32996},{"type":"v1","addr":"172.21.15.149:6829","nonce":32996}]},"public_addr":"172.21.15.149:6825/32996","cluster_addr":"172.21.15.149:6827/32996","heartbeat_back_addr":"172.21.15.149:6831/32996","heartbeat_front_addr":"172.21.15.149:6829/32996","state":["exists","up"]},{"osd":7,"uuid":"de849aa4-8494-4aeb-b1b6-6dd30458923c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":32994},{"type":"v1","addr":"172.21.15.149:6817","nonce":32994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":32994},{"type":"v1","addr":"172.21.15.149:6819","nonce":32994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":32994},{"type":"v1","addr":"172.21.15.149:6823","nonce":32994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":32994},{"type":"v1","addr":"172.21.15.149:6821","nonce":32994}]},"public_addr":"172.21.15.149:6817/32994","cluster_addr":"172.21.15.149:6819/32994","heartbeat_back_addr":"172.21.15.149:6823/32994","heartbeat_front_addr":"172.21.15.149:6821/32994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.027722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.241225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.289939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.257873+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.443455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.479909+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.521773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.560641+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T00:59:40.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.607+0000 7f180a06a700 1 -- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f17e80604b0 msgr2=0x7f17e8062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.607+0000 7f180a06a700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f17e80604b0 0x7f17e8062960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1800005c50 tx=0x7f1800009040 comp rx=0 tx=0).stop 2023-06-23T00:59:40.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.607+0000 7f180a06a700 1 -- 172.21.15.97:0/965553293 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1804152f70 msgr2=0x7f18040ac2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.607+0000 7f180a06a700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1804152f70 0x7f18040ac2c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f180406ddd0 tx=0x7f17fc017000 comp rx=0 tx=0).stop 2023-06-23T00:59:40.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.607+0000 7f180a06a700 1 -- 172.21.15.97:0/965553293 shutdown_connections 2023-06-23T00:59:40.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.607+0000 7f180a06a700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f17e80604b0 0x7f17e8062960 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.607+0000 7f180a06a700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1804152f70 0x7f18040ac2c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.607+0000 7f180a06a700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f180406f000 0x7f18040abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.607+0000 7f180a06a700 1 --2- 172.21.15.97:0/965553293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f180406a080 0x7f18040ab840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.607+0000 7f180a06a700 1 -- 172.21.15.97:0/965553293 >> 172.21.15.97:0/965553293 conn(0x7f18040cad80 msgr2=0x7f18040c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:40.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.607+0000 7f180a06a700 1 -- 172.21.15.97:0/965553293 shutdown_connections 2023-06-23T00:59:40.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.607+0000 7f180a06a700 1 -- 172.21.15.97:0/965553293 wait complete. 2023-06-23T00:59:40.628 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T00:59:40.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.723+0000 7f9bc9787700 1 Processor -- start 2023-06-23T00:59:40.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.723+0000 7f9bc9787700 1 -- start start 2023-06-23T00:59:40.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bc9787700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9bc40cab90 0x7f9bc406a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bc9787700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc40c6d10 con 0x7f9bc414c1a0 2023-06-23T00:59:40.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bc9787700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc406b640 con 0x7f9bc414bdd0 2023-06-23T00:59:40.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bc9787700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc406bee0 con 0x7f9bc40cab90 2023-06-23T00:59:40.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bc8f86700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9bc414c1a0 0x7f9bc406ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57916/0 (socket says 172.21.15.97:57916) 2023-06-23T00:59:40.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bc8f86700 1 -- 172.21.15.97:0/550042007 learned_addr learned my addr 172.21.15.97:0/550042007 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:40.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bbbfff700 1 --2- 172.21.15.97:0/550042007 >> v2:172.21.15.149:3300/0 conn(0x7f9bc40cab90 0x7f9bc406a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bc37fe700 1 -- 172.21.15.97:0/550042007 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734994659 0 0) 0x7f9bc40c6d10 con 0x7f9bc414c1a0 2023-06-23T00:59:40.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bc37fe700 1 -- 172.21.15.97:0/550042007 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bb0004680 con 0x7f9bc414c1a0 2023-06-23T00:59:40.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bc37fe700 1 -- 172.21.15.97:0/550042007 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069216446 0 0) 0x7f9bc406b640 con 0x7f9bc414bdd0 2023-06-23T00:59:40.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bc37fe700 1 -- 172.21.15.97:0/550042007 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bc40c6d10 con 0x7f9bc414bdd0 2023-06-23T00:59:40.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bbbfff700 1 -- 172.21.15.97:0/550042007 >> v1:172.21.15.149:6789/0 conn(0x7f9bc414bdd0 legacy=0x7f9bc40ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bbbfff700 1 -- 172.21.15.97:0/550042007 >> v1:172.21.15.97:6789/0 conn(0x7f9bc414c1a0 legacy=0x7f9bc406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bbbfff700 1 -- 172.21.15.97:0/550042007 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc406b920 con 0x7f9bc40cab90 2023-06-23T00:59:40.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bbbfff700 1 --2- 172.21.15.97:0/550042007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc40cab90 0x7f9bc406a8a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0098e0 tx=0x7f9bac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a09af801b9cf003 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:40.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bc37fe700 1 -- 172.21.15.97:0/550042007 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac011630 con 0x7f9bc40cab90 2023-06-23T00:59:40.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bc37fe700 1 -- 172.21.15.97:0/550042007 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac011790 con 0x7f9bc40cab90 2023-06-23T00:59:40.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.727+0000 7f9bc37fe700 1 -- 172.21.15.97:0/550042007 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac011b10 con 0x7f9bc40cab90 2023-06-23T00:59:40.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.731+0000 7f9bc9787700 1 -- 172.21.15.97:0/550042007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc40cab90 msgr2=0x7f9bc406a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.731+0000 7f9bc9787700 1 --2- 172.21.15.97:0/550042007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc40cab90 0x7f9bc406a8a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0098e0 tx=0x7f9bac0091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.731+0000 7f9bc9787700 1 -- 172.21.15.97:0/550042007 shutdown_connections 2023-06-23T00:59:40.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.731+0000 7f9bc9787700 1 --2- 172.21.15.97:0/550042007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc40cab90 0x7f9bc406a8a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.731+0000 7f9bc9787700 1 -- 172.21.15.97:0/550042007 >> 172.21.15.97:0/550042007 conn(0x7f9bc40cc9b0 msgr2=0x7f9bc40c8910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:40.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.731+0000 7f9bc9787700 1 -- 172.21.15.97:0/550042007 shutdown_connections 2023-06-23T00:59:40.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.731+0000 7f9bc9787700 1 -- 172.21.15.97:0/550042007 wait complete. 2023-06-23T00:59:40.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.731+0000 7f9bc9787700 1 Processor -- start 2023-06-23T00:59:40.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.731+0000 7f9bc9787700 1 -- start start 2023-06-23T00:59:40.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc9787700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc40cab90 0x7f9bc40af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc9787700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9bc414bdd0 0x7f9bc40c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc9787700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bc414c1a0 0x7f9bc41644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc9787700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4153060 con 0x7f9bc414c1a0 2023-06-23T00:59:40.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc9787700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4153900 con 0x7f9bc40cab90 2023-06-23T00:59:40.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc9787700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40afee0 con 0x7f9bc414bdd0 2023-06-23T00:59:40.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc8f86700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bc414c1a0 0x7f9bc41644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc8f86700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bc414c1a0 0x7f9bc41644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35738/0 (socket says 172.21.15.97:35738) 2023-06-23T00:59:40.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc8f86700 1 -- 172.21.15.97:0/997507386 learned_addr learned my addr 172.21.15.97:0/997507386 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:40.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bbbfff700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9bc414bdd0 0x7f9bc40c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc3fff700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc40cab90 0x7f9bc40af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc8f86700 1 -- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9bc414bdd0 msgr2=0x7f9bc40c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc8f86700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9bc414bdd0 0x7f9bc40c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc8f86700 1 -- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc40cab90 msgr2=0x7f9bc40af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc8f86700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc40cab90 0x7f9bc40af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc8f86700 1 -- 172.21.15.97:0/997507386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac009420 con 0x7f9bc414c1a0 2023-06-23T00:59:40.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc8f86700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bc414c1a0 0x7f9bc41644b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00cbc0 tx=0x7f9bbc001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:40.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc0ff9700 1 -- 172.21.15.97:0/997507386 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00a850 con 0x7f9bc414c1a0 2023-06-23T00:59:40.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc0ff9700 1 -- 172.21.15.97:0/997507386 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc00a9b0 con 0x7f9bc414c1a0 2023-06-23T00:59:40.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc9787700 1 -- 172.21.15.97:0/997507386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc40c5600 con 0x7f9bc414c1a0 2023-06-23T00:59:40.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc0ff9700 1 -- 172.21.15.97:0/997507386 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00ad70 con 0x7f9bc414c1a0 2023-06-23T00:59:40.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc9787700 1 -- 172.21.15.97:0/997507386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc4153590 con 0x7f9bc414c1a0 2023-06-23T00:59:40.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc0ff9700 1 -- 172.21.15.97:0/997507386 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f9bbc007300 con 0x7f9bc414c1a0 2023-06-23T00:59:40.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.735+0000 7f9bc9787700 1 -- 172.21.15.97:0/997507386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc404bc30 con 0x7f9bc414c1a0 2023-06-23T00:59:40.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.739+0000 7f9bc0ff9700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f9ba40604b0 0x7f9ba4062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:40.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.739+0000 7f9bc0ff9700 1 -- 172.21.15.97:0/997507386 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9bbc07ce10 con 0x7f9bc414c1a0 2023-06-23T00:59:40.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.739+0000 7f9bc3fff700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f9ba40604b0 0x7f9ba4062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:40.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.739+0000 7f9bc3fff700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f9ba40604b0 0x7f9ba4062960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4007fd0 tx=0x7f9bb4007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:40.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.743+0000 7f9bc0ff9700 1 -- 172.21.15.97:0/997507386 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f9bbc04d0f0 con 0x7f9bc414c1a0 2023-06-23T00:59:40.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.903+0000 7f9bc9787700 1 -- 172.21.15.97:0/997507386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bc4153a40 con 0x7f9bc414c1a0 2023-06-23T00:59:40.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.907+0000 7f9bc0ff9700 1 -- 172.21.15.97:0/997507386 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f9bbc050710 con 0x7f9bc414c1a0 2023-06-23T00:59:40.913 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:59:40.914 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":30,"fsid":"6b52ccf4-99f4-48c9-9a8a-9a183942c228","created":"2023-06-23T00:59:11.989322+0000","modified":"2023-06-23T00:59:39.963836+0000","last_up_change":"2023-06-23T00:59:22.950578+0000","last_in_change":"2023-06-23T00:59:14.057374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T00:59:24.275869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T00:59:29.802618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T00:59:33.890862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T00:59:34.526165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T00:59:37.609350+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"291bc189-d5fb-482f-92d6-f7ecfb0a388c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":32817},{"type":"v1","addr":"172.21.15.97:6801","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":32817},{"type":"v1","addr":"172.21.15.97:6803","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":32817},{"type":"v1","addr":"172.21.15.97:6807","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":32817},{"type":"v1","addr":"172.21.15.97:6805","nonce":32817}]},"public_addr":"172.21.15.97:6801/32817","cluster_addr":"172.21.15.97:6803/32817","heartbeat_back_addr":"172.21.15.97:6807/32817","heartbeat_front_addr":"172.21.15.97:6805/32817","state":["exists","up"]},{"osd":1,"uuid":"693551b5-827b-4530-80b1-a836095efbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":32818},{"type":"v1","addr":"172.21.15.97:6817","nonce":32818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":32818},{"type":"v1","addr":"172.21.15.97:6819","nonce":32818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":32818},{"type":"v1","addr":"172.21.15.97:6823","nonce":32818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":32818},{"type":"v1","addr":"172.21.15.97:6821","nonce":32818}]},"public_addr":"172.21.15.97:6817/32818","cluster_addr":"172.21.15.97:6819/32818","heartbeat_back_addr":"172.21.15.97:6823/32818","heartbeat_front_addr":"172.21.15.97:6821/32818","state":["exists","up"]},{"osd":2,"uuid":"a100d026-e382-4e71-bda5-ffa59f6b596b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":32820},{"type":"v1","addr":"172.21.15.97:6825","nonce":32820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":32820},{"type":"v1","addr":"172.21.15.97:6827","nonce":32820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":32820},{"type":"v1","addr":"172.21.15.97:6831","nonce":32820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":32820},{"type":"v1","addr":"172.21.15.97:6829","nonce":32820}]},"public_addr":"172.21.15.97:6825/32820","cluster_addr":"172.21.15.97:6827/32820","heartbeat_back_addr":"172.21.15.97:6831/32820","heartbeat_front_addr":"172.21.15.97:6829/32820","state":["exists","up"]},{"osd":3,"uuid":"91783241-7821-458e-996f-a740274b18ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":32819},{"type":"v1","addr":"172.21.15.97:6809","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":32819},{"type":"v1","addr":"172.21.15.97:6811","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":32819},{"type":"v1","addr":"172.21.15.97:6815","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":32819},{"type":"v1","addr":"172.21.15.97:6813","nonce":32819}]},"public_addr":"172.21.15.97:6809/32819","cluster_addr":"172.21.15.97:6811/32819","heartbeat_back_addr":"172.21.15.97:6815/32819","heartbeat_front_addr":"172.21.15.97:6813/32819","state":["exists","up"]},{"osd":4,"uuid":"67c375d3-ec8f-4d1a-bea7-e47896705fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":32992},{"type":"v1","addr":"172.21.15.149:6801","nonce":32992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":32992},{"type":"v1","addr":"172.21.15.149:6803","nonce":32992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":32992},{"type":"v1","addr":"172.21.15.149:6807","nonce":32992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":32992},{"type":"v1","addr":"172.21.15.149:6805","nonce":32992}]},"public_addr":"172.21.15.149:6801/32992","cluster_addr":"172.21.15.149:6803/32992","heartbeat_back_addr":"172.21.15.149:6807/32992","heartbeat_front_addr":"172.21.15.149:6805/32992","state":["exists","up"]},{"osd":5,"uuid":"9de42b7c-cf51-4adf-9cc1-11c8d9863574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":32995},{"type":"v1","addr":"172.21.15.149:6809","nonce":32995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":32995},{"type":"v1","addr":"172.21.15.149:6811","nonce":32995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":32995},{"type":"v1","addr":"172.21.15.149:6815","nonce":32995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":32995},{"type":"v1","addr":"172.21.15.149:6813","nonce":32995}]},"public_addr":"172.21.15.149:6809/32995","cluster_addr":"172.21.15.149:6811/32995","heartbeat_back_addr":"172.21.15.149:6815/32995","heartbeat_front_addr":"172.21.15.149:6813/32995","state":["exists","up"]},{"osd":6,"uuid":"ffa4ef96-2528-45cb-b2c9-a6c671b234e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":32996},{"type":"v1","addr":"172.21.15.149:6825","nonce":32996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":32996},{"type":"v1","addr":"172.21.15.149:6827","nonce":32996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":32996},{"type":"v1","addr":"172.21.15.149:6831","nonce":32996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":32996},{"type":"v1","addr":"172.21.15.149:6829","nonce":32996}]},"public_addr":"172.21.15.149:6825/32996","cluster_addr":"172.21.15.149:6827/32996","heartbeat_back_addr":"172.21.15.149:6831/32996","heartbeat_front_addr":"172.21.15.149:6829/32996","state":["exists","up"]},{"osd":7,"uuid":"de849aa4-8494-4aeb-b1b6-6dd30458923c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":32994},{"type":"v1","addr":"172.21.15.149:6817","nonce":32994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":32994},{"type":"v1","addr":"172.21.15.149:6819","nonce":32994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":32994},{"type":"v1","addr":"172.21.15.149:6823","nonce":32994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":32994},{"type":"v1","addr":"172.21.15.149:6821","nonce":32994}]},"public_addr":"172.21.15.149:6817/32994","cluster_addr":"172.21.15.149:6819/32994","heartbeat_back_addr":"172.21.15.149:6823/32994","heartbeat_front_addr":"172.21.15.149:6821/32994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.027722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.241225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.289939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.257873+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.443455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.479909+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.521773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.560641+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T00:59:40.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.907+0000 7f9bc9787700 1 -- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f9ba40604b0 msgr2=0x7f9ba4062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.907+0000 7f9bc9787700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f9ba40604b0 0x7f9ba4062960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4007fd0 tx=0x7f9bb4007d50 comp rx=0 tx=0).stop 2023-06-23T00:59:40.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.907+0000 7f9bc9787700 1 -- 172.21.15.97:0/997507386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bc414c1a0 msgr2=0x7f9bc41644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:40.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.907+0000 7f9bc9787700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bc414c1a0 0x7f9bc41644b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00cbc0 tx=0x7f9bbc001a20 comp rx=0 tx=0).stop 2023-06-23T00:59:40.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.907+0000 7f9bc9787700 1 -- 172.21.15.97:0/997507386 shutdown_connections 2023-06-23T00:59:40.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.907+0000 7f9bc9787700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f9ba40604b0 0x7f9ba4062960 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.907+0000 7f9bc9787700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bc414c1a0 0x7f9bc41644b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.907+0000 7f9bc9787700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9bc414bdd0 0x7f9bc40c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.907+0000 7f9bc9787700 1 --2- 172.21.15.97:0/997507386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc40cab90 0x7f9bc40af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:40.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.907+0000 7f9bc9787700 1 -- 172.21.15.97:0/997507386 >> 172.21.15.97:0/997507386 conn(0x7f9bc40cc9b0 msgr2=0x7f9bc40c1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:40.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.907+0000 7f9bc9787700 1 -- 172.21.15.97:0/997507386 shutdown_connections 2023-06-23T00:59:40.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:40.907+0000 7f9bc9787700 1 -- 172.21.15.97:0/997507386 wait complete. 2023-06-23T00:59:40.944 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T00:59:41.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.047+0000 7f64b3a9d700 1 Processor -- start 2023-06-23T00:59:41.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.047+0000 7f64b3a9d700 1 -- start start 2023-06-23T00:59:41.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b3a9d700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f64ac155660 0x7f64ac0684b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b3a9d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac155a30 0x7f64ac0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b3a9d700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac06dfa0 con 0x7f64ac06d2e0 2023-06-23T00:59:41.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b3a9d700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ac0ca530 con 0x7f64ac155660 2023-06-23T00:59:41.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b3a9d700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac06e280 con 0x7f64ac155a30 2023-06-23T00:59:41.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b1839700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f64ac155660 0x7f64ac0684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b1839700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f64ac155660 0x7f64ac0684b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35754/0 (socket says 172.21.15.97:35754) 2023-06-23T00:59:41.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b1839700 1 -- 172.21.15.97:0/2643006437 learned_addr learned my addr 172.21.15.97:0/2643006437 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:41.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b203a700 1 --1- 172.21.15.97:0/2643006437 >> v1:172.21.15.97:6789/0 conn(0x7f64ac06d2e0 0x7f64ac06d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57922/0 (socket says 172.21.15.97:57922) 2023-06-23T00:59:41.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b1038700 1 --2- 172.21.15.97:0/2643006437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac155a30 0x7f64ac0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b1839700 1 -- 172.21.15.97:0/2643006437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac155a30 msgr2=0x7f64ac0689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:41.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b1839700 1 --2- 172.21.15.97:0/2643006437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac155a30 0x7f64ac0689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b1839700 1 -- 172.21.15.97:0/2643006437 >> v1:172.21.15.97:6789/0 conn(0x7f64ac06d2e0 legacy=0x7f64ac06d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b1839700 1 -- 172.21.15.97:0/2643006437 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac06e560 con 0x7f64ac155660 2023-06-23T00:59:41.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b1038700 1 --2- 172.21.15.97:0/2643006437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac155a30 0x7f64ac0689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T00:59:41.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b1839700 1 --2- 172.21.15.97:0/2643006437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64ac155660 0x7f64ac0684b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f64a80099b0 tx=0x7f64a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38714e57cbd86aa2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:41.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b0837700 1 -- 172.21.15.97:0/2643006437 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a800b860 con 0x7f64ac155660 2023-06-23T00:59:41.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b0837700 1 -- 172.21.15.97:0/2643006437 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a800b9c0 con 0x7f64ac155660 2023-06-23T00:59:41.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b0837700 1 -- 172.21.15.97:0/2643006437 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a800bd60 con 0x7f64ac155660 2023-06-23T00:59:41.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2643006437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64ac155660 msgr2=0x7f64ac0684b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b3a9d700 1 --2- 172.21.15.97:0/2643006437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64ac155660 0x7f64ac0684b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f64a80099b0 tx=0x7f64a8009250 comp rx=0 tx=0).stop 2023-06-23T00:59:41.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2643006437 shutdown_connections 2023-06-23T00:59:41.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b3a9d700 1 --2- 172.21.15.97:0/2643006437 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac155a30 0x7f64ac0689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b3a9d700 1 --2- 172.21.15.97:0/2643006437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64ac155660 0x7f64ac0684b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2643006437 >> 172.21.15.97:0/2643006437 conn(0x7f64ac0c92a0 msgr2=0x7f64ac0c96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:41.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2643006437 shutdown_connections 2023-06-23T00:59:41.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.051+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2643006437 wait complete. 2023-06-23T00:59:41.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.055+0000 7f64b3a9d700 1 Processor -- start 2023-06-23T00:59:41.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.055+0000 7f64b3a9d700 1 -- start start 2023-06-23T00:59:41.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.055+0000 7f64b3a9d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac06d2e0 0x7f64ac14b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.055+0000 7f64b3a9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64ac155660 0x7f64ac0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.055+0000 7f64b3a9d700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64ac155a30 0x7f64ac0afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b3a9d700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0c4bc0 con 0x7f64ac155a30 2023-06-23T00:59:41.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b3a9d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac166dd0 con 0x7f64ac155660 2023-06-23T00:59:41.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b3a9d700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0b01b0 con 0x7f64ac06d2e0 2023-06-23T00:59:41.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b203a700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64ac155a30 0x7f64ac0afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b203a700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64ac155a30 0x7f64ac0afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35758/0 (socket says 172.21.15.97:35758) 2023-06-23T00:59:41.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b203a700 1 -- 172.21.15.97:0/2370165965 learned_addr learned my addr 172.21.15.97:0/2370165965 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:41.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b1839700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac06d2e0 0x7f64ac14b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b1038700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64ac155660 0x7f64ac0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b203a700 1 -- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac06d2e0 msgr2=0x7f64ac14b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b203a700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac06d2e0 0x7f64ac14b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b203a700 1 -- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64ac155660 msgr2=0x7f64ac0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b203a700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64ac155660 0x7f64ac0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b203a700 1 -- 172.21.15.97:0/2370165965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a80094f0 con 0x7f64ac155a30 2023-06-23T00:59:41.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b1839700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac06d2e0 0x7f64ac14b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:41.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b1038700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64ac155660 0x7f64ac0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:41.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b203a700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64ac155a30 0x7f64ac0afb10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f64a400cd00 tx=0x7f64a4001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:41.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64a1ffb700 1 -- 172.21.15.97:0/2370165965 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4005df0 con 0x7f64ac155a30 2023-06-23T00:59:41.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64a1ffb700 1 -- 172.21.15.97:0/2370165965 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a400a960 con 0x7f64ac155a30 2023-06-23T00:59:41.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2370165965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac0b0490 con 0x7f64ac155a30 2023-06-23T00:59:41.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64a1ffb700 1 -- 172.21.15.97:0/2370165965 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a400ad00 con 0x7f64ac155a30 2023-06-23T00:59:41.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2370165965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac0b0a50 con 0x7f64ac155a30 2023-06-23T00:59:41.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2370165965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac04bc30 con 0x7f64ac155a30 2023-06-23T00:59:41.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.059+0000 7f64a1ffb700 1 -- 172.21.15.97:0/2370165965 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f64a4007300 con 0x7f64ac155a30 2023-06-23T00:59:41.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.063+0000 7f64a1ffb700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f64900604b0 0x7f6490062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.063+0000 7f64a1ffb700 1 -- 172.21.15.97:0/2370165965 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f64a407ccb0 con 0x7f64ac155a30 2023-06-23T00:59:41.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.063+0000 7f64b1839700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f64900604b0 0x7f6490062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.063+0000 7f64b1839700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f64900604b0 0x7f6490062960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f64a80099b0 tx=0x7f64a8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:41.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.071+0000 7f64a1ffb700 1 -- 172.21.15.97:0/2370165965 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f64a404cf90 con 0x7f64ac155a30 2023-06-23T00:59:41.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.259+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2370165965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64ac159700 con 0x7f64ac155a30 2023-06-23T00:59:41.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.259+0000 7f64a1ffb700 1 -- 172.21.15.97:0/2370165965 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4616 (secure 0 0 0) 0x7f64a400ae60 con 0x7f64ac155a30 2023-06-23T00:59:41.268 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:59:41.268 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6833/361425768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":361425768},{"type":"v1","addr":"172.21.15.97:6833","nonce":361425768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2295858768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2295858768},{"type":"v1","addr":"172.21.15.149:6835","nonce":2295858768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3038582563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3038582563},{"type":"v1","addr":"172.21.15.149:6837","nonce":3038582563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T00:59:35.539439+0000","modified":"2023-06-23T00:59:39.964160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6835/163806060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":163806060},{"type":"v1","addr":"172.21.15.97:6835","nonce":163806060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-06-23T00:59:41.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.263+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f64900604b0 msgr2=0x7f6490062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.263+0000 7f64b3a9d700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f64900604b0 0x7f6490062960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f64a80099b0 tx=0x7f64a8017000 comp rx=0 tx=0).stop 2023-06-23T00:59:41.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.263+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2370165965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64ac155a30 msgr2=0x7f64ac0afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.263+0000 7f64b3a9d700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64ac155a30 0x7f64ac0afb10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f64a400cd00 tx=0x7f64a4001b10 comp rx=0 tx=0).stop 2023-06-23T00:59:41.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.263+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2370165965 shutdown_connections 2023-06-23T00:59:41.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.263+0000 7f64b3a9d700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f64900604b0 0x7f6490062960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.263+0000 7f64b3a9d700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64ac155a30 0x7f64ac0afb10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.263+0000 7f64b3a9d700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64ac155660 0x7f64ac0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.263+0000 7f64b3a9d700 1 --2- 172.21.15.97:0/2370165965 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64ac06d2e0 0x7f64ac14b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.263+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2370165965 >> 172.21.15.97:0/2370165965 conn(0x7f64ac0c92a0 msgr2=0x7f64ac158480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:41.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.263+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2370165965 shutdown_connections 2023-06-23T00:59:41.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.263+0000 7f64b3a9d700 1 -- 172.21.15.97:0/2370165965 wait complete. 2023-06-23T00:59:41.273 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 7 2023-06-23T00:59:41.685 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-23T00:59:35.539439+0000', 'modified': '2023-06-23T00:59:39.964160+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.97:6835/163806060', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6834', 'nonce': 163806060}, {'type': 'v1', 'addr': '172.21.15.97:6835', 'nonce': 163806060}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-06-23T00:59:41.685 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-23T00:59:41.686 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-06-23T00:59:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f7671c05700 1 Processor -- start 2023-06-23T00:59:41.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f7671c05700 1 -- start start 2023-06-23T00:59:41.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f7671c05700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f766c069c60 0x7f766c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f7671c05700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f766c06a740 0x7f766c15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f7671c05700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766c0c6540 con 0x7f766c06c1d0 2023-06-23T00:59:41.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f7671c05700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766c0c73a0 con 0x7f766c06a740 2023-06-23T00:59:41.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f7671c05700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c155660 con 0x7f766c069c60 2023-06-23T00:59:41.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f766bfff700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f766c06a740 0x7f766c15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f766bfff700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f766c06a740 0x7f766c15ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35766/0 (socket says 172.21.15.97:35766) 2023-06-23T00:59:41.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f766bfff700 1 -- 172.21.15.97:0/2700675942 learned_addr learned my addr 172.21.15.97:0/2700675942 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:41.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f766b7fe700 1 --2- 172.21.15.97:0/2700675942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f766c069c60 0x7f766c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f766bfff700 1 -- 172.21.15.97:0/2700675942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f766c069c60 msgr2=0x7f766c06d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:41.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f766bfff700 1 --2- 172.21.15.97:0/2700675942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f766c069c60 0x7f766c06d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f766bfff700 1 -- 172.21.15.97:0/2700675942 >> v1:172.21.15.149:6789/0 conn(0x7f766c06c1d0 legacy=0x7f766c06a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.795+0000 7f766a7fc700 1 -- 172.21.15.97:0/2700675942 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211942112 0 0) 0x7f766c0c6540 con 0x7f766c06c1d0 2023-06-23T00:59:41.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f766bfff700 1 -- 172.21.15.97:0/2700675942 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c0c6790 con 0x7f766c06a740 2023-06-23T00:59:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f766bfff700 1 --2- 172.21.15.97:0/2700675942 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766c06a740 0x7f766c15ee20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7664009f20 tx=0x7f7664009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6418a9b79192b9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f766a7fc700 1 -- 172.21.15.97:0/2700675942 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766400e070 con 0x7f766c06a740 2023-06-23T00:59:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f766a7fc700 1 -- 172.21.15.97:0/2700675942 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766400b9d0 con 0x7f766c06a740 2023-06-23T00:59:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f766a7fc700 1 -- 172.21.15.97:0/2700675942 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76640092e0 con 0x7f766c06a740 2023-06-23T00:59:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f7671c05700 1 -- 172.21.15.97:0/2700675942 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766c06a740 msgr2=0x7f766c15ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f7671c05700 1 --2- 172.21.15.97:0/2700675942 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766c06a740 0x7f766c15ee20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7664009f20 tx=0x7f7664009840 comp rx=0 tx=0).stop 2023-06-23T00:59:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f7671c05700 1 -- 172.21.15.97:0/2700675942 shutdown_connections 2023-06-23T00:59:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f7671c05700 1 --2- 172.21.15.97:0/2700675942 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766c06a740 0x7f766c15ee20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f7671c05700 1 --2- 172.21.15.97:0/2700675942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f766c069c60 0x7f766c06d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f7671c05700 1 -- 172.21.15.97:0/2700675942 >> 172.21.15.97:0/2700675942 conn(0x7f766c06f020 msgr2=0x7f766c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f7671c05700 1 -- 172.21.15.97:0/2700675942 shutdown_connections 2023-06-23T00:59:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f7671c05700 1 -- 172.21.15.97:0/2700675942 wait complete. 2023-06-23T00:59:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f7671c05700 1 Processor -- start 2023-06-23T00:59:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.799+0000 7f7671c05700 1 -- start start 2023-06-23T00:59:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f7671c05700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766c069c60 0x7f766c151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f7671c05700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f766c06a740 0x7f766c151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f7671c05700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f766c06c1d0 0x7f766c146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f7671c05700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0c5820 con 0x7f766c069c60 2023-06-23T00:59:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f7671c05700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0c3400 con 0x7f766c06c1d0 2023-06-23T00:59:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f7671c05700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c1542b0 con 0x7f766c06a740 2023-06-23T00:59:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f766b7fe700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766c069c60 0x7f766c151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f766b7fe700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766c069c60 0x7f766c151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35776/0 (socket says 172.21.15.97:35776) 2023-06-23T00:59:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f766b7fe700 1 -- 172.21.15.97:0/1596077812 learned_addr learned my addr 172.21.15.97:0/1596077812 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f766affd700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f766c06a740 0x7f766c151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f766bfff700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f766c06c1d0 0x7f766c146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f766b7fe700 1 -- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f766c06a740 msgr2=0x7f766c151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f766b7fe700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f766c06a740 0x7f766c151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f766b7fe700 1 -- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f766c06c1d0 msgr2=0x7f766c146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f766b7fe700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f766c06c1d0 0x7f766c146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f766b7fe700 1 -- 172.21.15.97:0/1596077812 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7664009ae0 con 0x7f766c069c60 2023-06-23T00:59:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f766b7fe700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766c069c60 0x7f766c151150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f765400ec80 tx=0x7f76540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f76637fe700 1 -- 172.21.15.97:0/1596077812 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765400c850 con 0x7f766c069c60 2023-06-23T00:59:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f76637fe700 1 -- 172.21.15.97:0/1596077812 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765400c9b0 con 0x7f766c069c60 2023-06-23T00:59:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f7671c05700 1 -- 172.21.15.97:0/1596077812 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c0c2db0 con 0x7f766c069c60 2023-06-23T00:59:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f76637fe700 1 -- 172.21.15.97:0/1596077812 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765400cd50 con 0x7f766c069c60 2023-06-23T00:59:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.803+0000 7f7671c05700 1 -- 172.21.15.97:0/1596077812 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c154590 con 0x7f766c069c60 2023-06-23T00:59:41.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.807+0000 7f76637fe700 1 -- 172.21.15.97:0/1596077812 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f7654013680 con 0x7f766c069c60 2023-06-23T00:59:41.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.807+0000 7f76637fe700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f764c0604b0 0x7f764c062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.807+0000 7f76637fe700 1 -- 172.21.15.97:0/1596077812 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f765407cdc0 con 0x7f766c069c60 2023-06-23T00:59:41.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.807+0000 7f766affd700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f764c0604b0 0x7f764c062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.807+0000 7f7673eaf740 1 Processor -- start 2023-06-23T00:59:41.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.807+0000 7f7673eaf740 1 -- start start 2023-06-23T00:59:41.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.807+0000 7f766affd700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f764c0604b0 0x7f764c062960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f766c0b1290 tx=0x7f765c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:41.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.807+0000 7f7673eaf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5ae0 0x2b71e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.807+0000 7f7673eaf740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5710 0x2b723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.807+0000 7f7673eaf740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x2940790 0x2b72900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.807+0000 7f7673eaf740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x2aa2e20 con 0x28f5710 2023-06-23T00:59:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7673eaf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a9c610 con 0x28f5ae0 2023-06-23T00:59:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7673eaf740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a630b0 con 0x2940790 2023-06-23T00:59:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f766affd700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5710 0x2b723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f766affd700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5710 0x2b723c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35786/0 (socket says 172.21.15.97:35786) 2023-06-23T00:59:41.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f766affd700 1 -- 172.21.15.97:0/1085383090 learned_addr learned my addr 172.21.15.97:0/1085383090 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f766b7fe700 1 --2- 172.21.15.97:0/1085383090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5ae0 0x2b71e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f766bfff700 1 --2- 172.21.15.97:0/1085383090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x2940790 0x2b72900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f766affd700 1 -- 172.21.15.97:0/1085383090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x2940790 msgr2=0x2b72900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f766affd700 1 --2- 172.21.15.97:0/1085383090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x2940790 0x2b72900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f766affd700 1 -- 172.21.15.97:0/1085383090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5ae0 msgr2=0x2b71e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f766affd700 1 --2- 172.21.15.97:0/1085383090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5ae0 0x2b71e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f766affd700 1 -- 172.21.15.97:0/1085383090 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29419e0 con 0x28f5710 2023-06-23T00:59:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f766affd700 1 --2- 172.21.15.97:0/1085383090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5710 0x2b723c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f765c002a90 tx=0x7f765c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6242ec8aa6a2fb8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:41.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7660ff9700 1 -- 172.21.15.97:0/1085383090 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c014660 con 0x28f5710 2023-06-23T00:59:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7660ff9700 1 -- 172.21.15.97:0/1085383090 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c0147c0 con 0x28f5710 2023-06-23T00:59:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7660ff9700 1 -- 172.21.15.97:0/1085383090 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c014b80 con 0x28f5710 2023-06-23T00:59:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7673eaf740 1 -- 172.21.15.97:0/1085383090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5710 msgr2=0x2b723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7673eaf740 1 --2- 172.21.15.97:0/1085383090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5710 0x2b723c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f765c002a90 tx=0x7f765c015000 comp rx=0 tx=0).stop 2023-06-23T00:59:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7673eaf740 1 -- 172.21.15.97:0/1085383090 shutdown_connections 2023-06-23T00:59:41.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7673eaf740 1 --2- 172.21.15.97:0/1085383090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x2940790 0x2b72900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7673eaf740 1 --2- 172.21.15.97:0/1085383090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5710 0x2b723c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7673eaf740 1 --2- 172.21.15.97:0/1085383090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5ae0 0x2b71e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7673eaf740 1 -- 172.21.15.97:0/1085383090 >> 172.21.15.97:0/1085383090 conn(0x28f5eb0 msgr2=0x2b2e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7673eaf740 1 -- 172.21.15.97:0/1085383090 shutdown_connections 2023-06-23T00:59:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7673eaf740 1 -- 172.21.15.97:0/1085383090 wait complete. 2023-06-23T00:59:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.811+0000 7f7673eaf740 1 -- start start 2023-06-23T00:59:41.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7673eaf740 1 Processor -- start 2023-06-23T00:59:41.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7673eaf740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5710 0x2b2e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7673eaf740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5ae0 0x2b57c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7673eaf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x2940790 0x2b58170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7673eaf740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a62d50 con 0x28f5ae0 2023-06-23T00:59:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7673eaf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a3b970 con 0x2940790 2023-06-23T00:59:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7673eaf740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x28f3430 con 0x28f5710 2023-06-23T00:59:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7673eaf740 10 client.0 _ll_register_callbacks cb 0x2ae5b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T00:59:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f766affd700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5ae0 0x2b57c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f766affd700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5ae0 0x2b57c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35798/0 (socket says 172.21.15.97:35798) 2023-06-23T00:59:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f766affd700 1 -- 172.21.15.97:0/2006700013 learned_addr learned my addr 172.21.15.97:0/2006700013 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f766b7fe700 1 --2- 172.21.15.97:0/2006700013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5710 0x2b2e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f766bfff700 1 --2- 172.21.15.97:0/2006700013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x2940790 0x2b58170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f766affd700 1 -- 172.21.15.97:0/2006700013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5710 msgr2=0x2b2e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f766affd700 1 --2- 172.21.15.97:0/2006700013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5710 0x2b2e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f766affd700 1 -- 172.21.15.97:0/2006700013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x2940790 msgr2=0x2b58170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f766affd700 1 --2- 172.21.15.97:0/2006700013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x2940790 0x2b58170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f766affd700 1 -- 172.21.15.97:0/2006700013 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c0026d0 con 0x28f5ae0 2023-06-23T00:59:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f766affd700 1 --2- 172.21.15.97:0/2006700013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5ae0 0x2b57c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f765c020740 tx=0x7f765c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0dc82f396c3cb34 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7649ffb700 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-06-23T00:59:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7649ffb700 1 -- 172.21.15.97:0/2006700013 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c014660 con 0x28f5ae0 2023-06-23T00:59:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7649ffb700 1 -- 172.21.15.97:0/2006700013 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f765c01c040 con 0x28f5ae0 2023-06-23T00:59:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7673eaf740 1 -- 172.21.15.97:0/2006700013 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2a3ee80 con 0x28f5ae0 2023-06-23T00:59:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7649ffb700 1 -- 172.21.15.97:0/2006700013 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f765c003770 con 0x28f5ae0 2023-06-23T00:59:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7673eaf740 10 client.4443 fetch_fsmap learned FSMap version 7 2023-06-23T00:59:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.815+0000 7f7673eaf740 1 -- 172.21.15.97:0/2006700013 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x2a6b370 con 0x28f5ae0 2023-06-23T00:59:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7649ffb700 1 -- 172.21.15.97:0/2006700013 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2a3ee80 con 0x28f5ae0 2023-06-23T00:59:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7649ffb700 1 -- 172.21.15.97:0/2006700013 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 7) v1 ==== 3116+0+0 (secure 0 0 0) 0x7f765c02b420 con 0x28f5ae0 2023-06-23T00:59:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 10 client.4443 fetch_fsmap finished waiting for FSMap version 7 2023-06-23T00:59:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 10 client.4443 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-23T00:59:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 20 client.4443 populate_metadata read hostname 'smithi097' 2023-06-23T00:59:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 1 --2- 172.21.15.97:0/2006700013 >> [v2:172.21.15.97:6834/163806060,v1:172.21.15.97:6835/163806060] conn(0x2b763b0 0x2b76780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 4 client.4443 mds_command: new command op to 4294 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-23T00:59:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 1 -- 172.21.15.97:0/2006700013 --> [v2:172.21.15.97:6834/163806060,v1:172.21.15.97:6835/163806060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2a71410 con 0x2b763b0 2023-06-23T00:59:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f766b7fe700 1 --2- 172.21.15.97:0/2006700013 >> [v2:172.21.15.97:6834/163806060,v1:172.21.15.97:6835/163806060] conn(0x2b763b0 0x2b76780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7649ffb700 10 client.4443 ms_handle_connect on v2:172.21.15.97:6834/163806060 2023-06-23T00:59:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f766b7fe700 1 --2- 172.21.15.97:0/2006700013 >> [v2:172.21.15.97:6834/163806060,v1:172.21.15.97:6835/163806060] conn(0x2b763b0 0x2b76780 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59b67ad8cf9df059 server_cookie=11be8fbd24a3977c in_seq=0 out_seq=0 2023-06-23T00:59:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7649ffb700 1 -- 172.21.15.97:0/2006700013 <== mds.0 v2:172.21.15.97:6834/163806060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17215 (crc 0 0 0) 0x2a71410 con 0x2b763b0 2023-06-23T00:59:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7649ffb700 10 client.4443 handle_command_reply: tid=0 2023-06-23T00:59:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 1 client.4443 shutdown 2023-06-23T00:59:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 1 -- 172.21.15.97:0/2006700013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5ae0 msgr2=0x2b57c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 1 --2- 172.21.15.97:0/2006700013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5ae0 0x2b57c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f765c020740 tx=0x7f765c01f000 comp rx=0 tx=0).stop 2023-06-23T00:59:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 1 -- 172.21.15.97:0/2006700013 shutdown_connections 2023-06-23T00:59:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 1 --2- 172.21.15.97:0/2006700013 >> [v2:172.21.15.97:6834/163806060,v1:172.21.15.97:6835/163806060] conn(0x2b763b0 0x2b76780 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 1 --2- 172.21.15.97:0/2006700013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x2940790 0x2b58170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 1 --2- 172.21.15.97:0/2006700013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x28f5ae0 0x2b57c30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7649ffb700 0 client.4443 ms_handle_reset on v2:172.21.15.97:6834/163806060 2023-06-23T00:59:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 1 --2- 172.21.15.97:0/2006700013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5710 0x2b2e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 1 -- 172.21.15.97:0/2006700013 >> 172.21.15.97:0/2006700013 conn(0x28f5eb0 msgr2=0x2b26f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:41.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 1 -- 172.21.15.97:0/2006700013 shutdown_connections 2023-06-23T00:59:41.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 1 -- 172.21.15.97:0/2006700013 wait complete. 2023-06-23T00:59:41.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.819+0000 7f7673eaf740 20 client.4443 trim_cache size 0 max 16384 2023-06-23T00:59:41.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 Processor -- start 2023-06-23T00:59:41.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 -- start start 2023-06-23T00:59:41.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5710 0x2b26f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5ae0 0x2b27440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 0x2b7f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a9ecd0 con 0x2940790 2023-06-23T00:59:41.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x2aa28c0 con 0x28f5ae0 2023-06-23T00:59:41.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x2aa2750 con 0x28f5710 2023-06-23T00:59:41.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f766bfff700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 0x2b7f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f766bfff700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 0x2b7f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35810/0 (socket says 172.21.15.97:35810) 2023-06-23T00:59:41.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f766bfff700 1 -- 172.21.15.97:0/1250705452 learned_addr learned my addr 172.21.15.97:0/1250705452 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:41.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f766b7fe700 1 --2- 172.21.15.97:0/1250705452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5710 0x2b26f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f766affd700 1 --2- 172.21.15.97:0/1250705452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5ae0 0x2b27440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f766bfff700 1 -- 172.21.15.97:0/1250705452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5710 msgr2=0x2b26f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f766bfff700 1 --2- 172.21.15.97:0/1250705452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5710 0x2b26f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f766bfff700 1 -- 172.21.15.97:0/1250705452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5ae0 msgr2=0x2b27440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f766bfff700 1 --2- 172.21.15.97:0/1250705452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5ae0 0x2b27440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f766bfff700 1 -- 172.21.15.97:0/1250705452 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2a51d80 con 0x2940790 2023-06-23T00:59:41.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f766bfff700 1 --2- 172.21.15.97:0/1250705452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 0x2b7f410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f766c05e8e0 tx=0x7f7664018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123d2d8993fcda9b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f76617fa700 1 -- 172.21.15.97:0/1250705452 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7664024040 con 0x2940790 2023-06-23T00:59:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f76617fa700 1 -- 172.21.15.97:0/1250705452 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766401d570 con 0x2940790 2023-06-23T00:59:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f76617fa700 1 -- 172.21.15.97:0/1250705452 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766401d930 con 0x2940790 2023-06-23T00:59:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 -- 172.21.15.97:0/1250705452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 msgr2=0x2b7f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 --2- 172.21.15.97:0/1250705452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 0x2b7f410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f766c05e8e0 tx=0x7f7664018000 comp rx=0 tx=0).stop 2023-06-23T00:59:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 -- 172.21.15.97:0/1250705452 shutdown_connections 2023-06-23T00:59:41.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 --2- 172.21.15.97:0/1250705452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 0x2b7f410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 --2- 172.21.15.97:0/1250705452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5ae0 0x2b27440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 --2- 172.21.15.97:0/1250705452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5710 0x2b26f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 -- 172.21.15.97:0/1250705452 >> 172.21.15.97:0/1250705452 conn(0x28f5eb0 msgr2=0x2b56c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 -- 172.21.15.97:0/1250705452 shutdown_connections 2023-06-23T00:59:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.839+0000 7f7673eaf740 1 -- 172.21.15.97:0/1250705452 wait complete. 2023-06-23T00:59:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 1 -- start start 2023-06-23T00:59:41.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 1 Processor -- start 2023-06-23T00:59:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5710 0x2bc7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5ae0 0x2bc8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 0x2bc8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a6a240 con 0x2940790 2023-06-23T00:59:41.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a9f840 con 0x28f5710 2023-06-23T00:59:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b09bc0 con 0x28f5ae0 2023-06-23T00:59:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 10 client.0 _ll_register_callbacks cb 0x2a68110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T00:59:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f766bfff700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 0x2bc8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f766bfff700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 0x2bc8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35822/0 (socket says 172.21.15.97:35822) 2023-06-23T00:59:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f766bfff700 1 -- 172.21.15.97:0/886575614 learned_addr learned my addr 172.21.15.97:0/886575614 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f766b7fe700 1 --2- 172.21.15.97:0/886575614 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5710 0x2bc7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f766affd700 1 --2- 172.21.15.97:0/886575614 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5ae0 0x2bc8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f766bfff700 1 -- 172.21.15.97:0/886575614 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5ae0 msgr2=0x2bc8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:41.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f766bfff700 1 --2- 172.21.15.97:0/886575614 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5ae0 0x2bc8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f766bfff700 1 -- 172.21.15.97:0/886575614 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5710 msgr2=0x2bc7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:41.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f766bfff700 1 --2- 172.21.15.97:0/886575614 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5710 0x2bc7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f766bfff700 1 -- 172.21.15.97:0/886575614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c0c6790 con 0x2940790 2023-06-23T00:59:41.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f766bfff700 1 --2- 172.21.15.97:0/886575614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 0x2bc8540 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7664009a60 tx=0x7f7664025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949119d2b22ad3ee server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:41.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7649ffb700 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-06-23T00:59:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7649ffb700 1 -- 172.21.15.97:0/886575614 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7664024050 con 0x2940790 2023-06-23T00:59:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7649ffb700 1 -- 172.21.15.97:0/886575614 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7664029470 con 0x2940790 2023-06-23T00:59:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 1 -- 172.21.15.97:0/886575614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f765c0147c0 con 0x2940790 2023-06-23T00:59:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7649ffb700 1 -- 172.21.15.97:0/886575614 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f766402e070 con 0x2940790 2023-06-23T00:59:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 10 client.4449 fetch_fsmap learned FSMap version 7 2023-06-23T00:59:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 1 -- 172.21.15.97:0/886575614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x2a46130 con 0x2940790 2023-06-23T00:59:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7649ffb700 1 -- 172.21.15.97:0/886575614 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c0147c0 con 0x2940790 2023-06-23T00:59:41.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7649ffb700 1 -- 172.21.15.97:0/886575614 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 7) v1 ==== 3116+0+0 (secure 0 0 0) 0x7f7664019050 con 0x2940790 2023-06-23T00:59:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 10 client.4449 fetch_fsmap finished waiting for FSMap version 7 2023-06-23T00:59:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 10 client.4449 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-23T00:59:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 20 client.4449 populate_metadata read hostname 'smithi097' 2023-06-23T00:59:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 1 --2- 172.21.15.97:0/886575614 >> [v2:172.21.15.97:6834/163806060,v1:172.21.15.97:6835/163806060] conn(0x2bd15f0 0x2bd39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 4 client.4449 mds_command: new command op to 4294 tid=0[{"prefix": "status"}] 2023-06-23T00:59:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f7673eaf740 1 -- 172.21.15.97:0/886575614 --> [v2:172.21.15.97:6834/163806060,v1:172.21.15.97:6835/163806060] -- command(tid 0: {"prefix": "status"}) v1 -- 0x294d4e0 con 0x2bd15f0 2023-06-23T00:59:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.843+0000 7f766b7fe700 1 --2- 172.21.15.97:0/886575614 >> [v2:172.21.15.97:6834/163806060,v1:172.21.15.97:6835/163806060] conn(0x2bd15f0 0x2bd39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7649ffb700 10 client.4449 ms_handle_connect on v2:172.21.15.97:6834/163806060 2023-06-23T00:59:41.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f766b7fe700 1 --2- 172.21.15.97:0/886575614 >> [v2:172.21.15.97:6834/163806060,v1:172.21.15.97:6835/163806060] conn(0x2bd15f0 0x2bd39d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaf4fae147356b2e server_cookie=b0fa0bd21c56a36d in_seq=0 out_seq=0 2023-06-23T00:59:41.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7649ffb700 1 -- 172.21.15.97:0/886575614 <== mds.0 v2:172.21.15.97:6834/163806060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x294d4e0 con 0x2bd15f0 2023-06-23T00:59:41.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7649ffb700 10 client.4449 handle_command_reply: tid=0 2023-06-23T00:59:41.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7673eaf740 1 client.4449 shutdown 2023-06-23T00:59:41.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7673eaf740 1 -- 172.21.15.97:0/886575614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 msgr2=0x2bc8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7673eaf740 1 --2- 172.21.15.97:0/886575614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 0x2bc8540 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7664009a60 tx=0x7f7664025000 comp rx=0 tx=0).stop 2023-06-23T00:59:41.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7673eaf740 1 -- 172.21.15.97:0/886575614 shutdown_connections 2023-06-23T00:59:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7673eaf740 1 --2- 172.21.15.97:0/886575614 >> [v2:172.21.15.97:6834/163806060,v1:172.21.15.97:6835/163806060] conn(0x2bd15f0 0x2bd39d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7673eaf740 1 --2- 172.21.15.97:0/886575614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x2940790 0x2bc8540 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7649ffb700 0 client.4449 ms_handle_reset on v2:172.21.15.97:6834/163806060 2023-06-23T00:59:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7673eaf740 1 --2- 172.21.15.97:0/886575614 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x28f5ae0 0x2bc8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7673eaf740 1 --2- 172.21.15.97:0/886575614 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x28f5710 0x2bc7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7673eaf740 1 -- 172.21.15.97:0/886575614 >> 172.21.15.97:0/886575614 conn(0x28f5eb0 msgr2=0x2b279a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7673eaf740 1 -- 172.21.15.97:0/886575614 shutdown_connections 2023-06-23T00:59:41.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7673eaf740 1 -- 172.21.15.97:0/886575614 wait complete. 2023-06-23T00:59:41.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7673eaf740 20 client.4449 trim_cache size 0 max 16384 2023-06-23T00:59:41.861 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-06-23T00:59:41.861 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_fsid": "6b52ccf4-99f4-48c9-9a8a-9a183942c228", 2023-06-23T00:59:41.861 INFO:teuthology.orchestra.run.smithi097.stdout: "whoami": 0, 2023-06-23T00:59:41.861 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 4294, 2023-06-23T00:59:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: "want_state": "up:active", 2023-06-23T00:59:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: "state": "up:active", 2023-06-23T00:59:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs", 2023-06-23T00:59:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: "rank_uptime": 6.3052747260000004, 2023-06-23T00:59:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: "mdsmap_epoch": 7, 2023-06-23T00:59:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch": 30, 2023-06-23T00:59:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch_barrier": 29, 2023-06-23T00:59:41.862 INFO:teuthology.orchestra.run.smithi097.stdout: "uptime": 10.697499446 2023-06-23T00:59:41.863 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-06-23T00:59:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7671c05700 1 -- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f764c0604b0 msgr2=0x7f764c062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7671c05700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f764c0604b0 0x7f764c062960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f766c0b1290 tx=0x7f765c007ec0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7671c05700 1 -- 172.21.15.97:0/1596077812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766c069c60 msgr2=0x7f766c151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7671c05700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766c069c60 0x7f766c151150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f765400ec80 tx=0x7f76540091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7671c05700 1 -- 172.21.15.97:0/1596077812 shutdown_connections 2023-06-23T00:59:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7671c05700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f764c0604b0 0x7f764c062960 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7671c05700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f766c06c1d0 0x7f766c146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7671c05700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f766c06a740 0x7f766c151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7671c05700 1 --2- 172.21.15.97:0/1596077812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f766c069c60 0x7f766c151150 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7671c05700 1 -- 172.21.15.97:0/1596077812 >> 172.21.15.97:0/1596077812 conn(0x7f766c06f020 msgr2=0x7f766c06a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:41.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7671c05700 1 -- 172.21.15.97:0/1596077812 shutdown_connections 2023-06-23T00:59:41.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.847+0000 7f7671c05700 1 -- 172.21.15.97:0/1596077812 wait complete. 2023-06-23T00:59:41.872 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-23T00:59:41.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.975+0000 7f9766fa4700 1 Processor -- start 2023-06-23T00:59:41.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.975+0000 7f9766fa4700 1 -- start start 2023-06-23T00:59:41.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9766fa4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f97601529c0 0x7f9760152d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9766fa4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f976006abe0 0x7f9760156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9766fa4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9760069bd0 con 0x7f97600adcc0 2023-06-23T00:59:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9766fa4700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97600c8f90 con 0x7f97601529c0 2023-06-23T00:59:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9766fa4700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976006a750 con 0x7f976006abe0 2023-06-23T00:59:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f975ffff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f976006abe0 0x7f9760156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f975ffff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f976006abe0 0x7f9760156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.97:45550/0 (socket says 172.21.15.97:45550) 2023-06-23T00:59:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f975ffff700 1 -- 172.21.15.97:0/2805820333 learned_addr learned my addr 172.21.15.97:0/2805820333 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9764d40700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f97601529c0 0x7f9760152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f975ffff700 1 -- 172.21.15.97:0/2805820333 >> v2:172.21.15.149:3300/0 conn(0x7f97601529c0 msgr2=0x7f9760152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:41.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f975ffff700 1 --2- 172.21.15.97:0/2805820333 >> v2:172.21.15.149:3300/0 conn(0x7f97601529c0 0x7f9760152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f975ffff700 1 -- 172.21.15.97:0/2805820333 >> v1:172.21.15.149:6789/0 conn(0x7f97600adcc0 legacy=0x7f97600c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f975f7fe700 1 -- 172.21.15.97:0/2805820333 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061114245 0 0) 0x7f9760069bd0 con 0x7f97600adcc0 2023-06-23T00:59:41.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f975ffff700 1 -- 172.21.15.97:0/2805820333 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97600ae140 con 0x7f976006abe0 2023-06-23T00:59:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f975ffff700 1 --2- 172.21.15.97:0/2805820333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f976006abe0 0x7f9760156130 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f97500099b0 tx=0x7f9750009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54dd2e0ab6804dd4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f975f7fe700 1 -- 172.21.15.97:0/2805820333 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750009ea0 con 0x7f976006abe0 2023-06-23T00:59:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f975f7fe700 1 -- 172.21.15.97:0/2805820333 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975000b860 con 0x7f976006abe0 2023-06-23T00:59:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f975f7fe700 1 -- 172.21.15.97:0/2805820333 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000bc20 con 0x7f976006abe0 2023-06-23T00:59:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9766fa4700 1 -- 172.21.15.97:0/2805820333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f976006abe0 msgr2=0x7f9760156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9766fa4700 1 --2- 172.21.15.97:0/2805820333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f976006abe0 0x7f9760156130 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f97500099b0 tx=0x7f9750009250 comp rx=0 tx=0).stop 2023-06-23T00:59:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9766fa4700 1 -- 172.21.15.97:0/2805820333 shutdown_connections 2023-06-23T00:59:41.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9766fa4700 1 --2- 172.21.15.97:0/2805820333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f976006abe0 0x7f9760156130 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9766fa4700 1 --2- 172.21.15.97:0/2805820333 >> v2:172.21.15.149:3300/0 conn(0x7f97601529c0 0x7f9760152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9766fa4700 1 -- 172.21.15.97:0/2805820333 >> 172.21.15.97:0/2805820333 conn(0x7f97600cc190 msgr2=0x7f97600c8170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:41.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9766fa4700 1 -- 172.21.15.97:0/2805820333 shutdown_connections 2023-06-23T00:59:41.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.979+0000 7f9766fa4700 1 -- 172.21.15.97:0/2805820333 wait complete. 2023-06-23T00:59:41.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9766fa4700 1 Processor -- start 2023-06-23T00:59:41.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9766fa4700 1 -- start start 2023-06-23T00:59:41.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9766fa4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f976006abe0 0x7f97600c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9766fa4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97600adcc0 0x7f97601676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9766fa4700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97601529c0 0x7f976014b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9766fa4700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97600c2cf0 con 0x7f97601529c0 2023-06-23T00:59:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9766fa4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97600c2fd0 con 0x7f97600adcc0 2023-06-23T00:59:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9766fa4700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97600c32b0 con 0x7f976006abe0 2023-06-23T00:59:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9765541700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97601529c0 0x7f976014b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9764d40700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f976006abe0 0x7f97600c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9765541700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97601529c0 0x7f976014b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35830/0 (socket says 172.21.15.97:35830) 2023-06-23T00:59:41.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f975ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97600adcc0 0x7f97601676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9765541700 1 -- 172.21.15.97:0/867069261 learned_addr learned my addr 172.21.15.97:0/867069261 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:41.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9765541700 1 -- 172.21.15.97:0/867069261 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f976006abe0 msgr2=0x7f97600c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9765541700 1 --2- 172.21.15.97:0/867069261 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f976006abe0 0x7f97600c2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9765541700 1 -- 172.21.15.97:0/867069261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97600adcc0 msgr2=0x7f97601676e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:41.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9765541700 1 --2- 172.21.15.97:0/867069261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97600adcc0 0x7f97601676e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:41.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9765541700 1 -- 172.21.15.97:0/867069261 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500094f0 con 0x7f97601529c0 2023-06-23T00:59:41.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9764d40700 1 --2- 172.21.15.97:0/867069261 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f976006abe0 0x7f97600c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:41.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9765541700 1 --2- 172.21.15.97:0/867069261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97601529c0 0x7f976014b430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f975800c8e0 tx=0x7f97580016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:41.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f975cff9700 1 -- 172.21.15.97:0/867069261 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758012630 con 0x7f97601529c0 2023-06-23T00:59:41.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f975cff9700 1 -- 172.21.15.97:0/867069261 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97580127b0 con 0x7f97601529c0 2023-06-23T00:59:41.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f9766fa4700 1 -- 172.21.15.97:0/867069261 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97600c3590 con 0x7f97601529c0 2023-06-23T00:59:41.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.983+0000 7f975cff9700 1 -- 172.21.15.97:0/867069261 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758012b70 con 0x7f97601529c0 2023-06-23T00:59:41.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.987+0000 7f9766fa4700 1 -- 172.21.15.97:0/867069261 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97601562d0 con 0x7f97601529c0 2023-06-23T00:59:41.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.987+0000 7f9766fa4700 1 -- 172.21.15.97:0/867069261 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976004bc30 con 0x7f97601529c0 2023-06-23T00:59:41.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.987+0000 7f975cff9700 1 -- 172.21.15.97:0/867069261 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f9758003030 con 0x7f97601529c0 2023-06-23T00:59:41.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.987+0000 7f975cff9700 1 --2- 172.21.15.97:0/867069261 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f97400604b0 0x7f9740062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:41.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.987+0000 7f975cff9700 1 -- 172.21.15.97:0/867069261 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f975807cad0 con 0x7f97601529c0 2023-06-23T00:59:41.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.987+0000 7f9764d40700 1 --2- 172.21.15.97:0/867069261 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f97400604b0 0x7f9740062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:41.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.991+0000 7f9764d40700 1 --2- 172.21.15.97:0/867069261 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f97400604b0 0x7f9740062960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9748011480 tx=0x7f97480091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:42.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:41.995+0000 7f975cff9700 1 -- 172.21.15.97:0/867069261 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f975804cd30 con 0x7f97601529c0 2023-06-23T00:59:42.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.191+0000 7f9766fa4700 1 -- 172.21.15.97:0/867069261 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9760069e20 con 0x7f97601529c0 2023-06-23T00:59:42.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.191+0000 7f975cff9700 1 -- 172.21.15.97:0/867069261 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9758050350 con 0x7f97601529c0 2023-06-23T00:59:42.200 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-23T00:59:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.195+0000 7f9766fa4700 1 -- 172.21.15.97:0/867069261 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f97400604b0 msgr2=0x7f9740062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.195+0000 7f9766fa4700 1 --2- 172.21.15.97:0/867069261 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f97400604b0 0x7f9740062960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9748011480 tx=0x7f97480091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.195+0000 7f9766fa4700 1 -- 172.21.15.97:0/867069261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97601529c0 msgr2=0x7f976014b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.195+0000 7f9766fa4700 1 --2- 172.21.15.97:0/867069261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97601529c0 0x7f976014b430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f975800c8e0 tx=0x7f97580016c0 comp rx=0 tx=0).stop 2023-06-23T00:59:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.195+0000 7f9766fa4700 1 -- 172.21.15.97:0/867069261 shutdown_connections 2023-06-23T00:59:42.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.195+0000 7f9766fa4700 1 --2- 172.21.15.97:0/867069261 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f97400604b0 0x7f9740062960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.195+0000 7f9766fa4700 1 --2- 172.21.15.97:0/867069261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97601529c0 0x7f976014b430 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.195+0000 7f9766fa4700 1 --2- 172.21.15.97:0/867069261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97600adcc0 0x7f97601676e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.195+0000 7f9766fa4700 1 --2- 172.21.15.97:0/867069261 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f976006abe0 0x7f97600c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.195+0000 7f9766fa4700 1 -- 172.21.15.97:0/867069261 >> 172.21.15.97:0/867069261 conn(0x7f97600cc190 msgr2=0x7f976014c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.195+0000 7f9766fa4700 1 -- 172.21.15.97:0/867069261 shutdown_connections 2023-06-23T00:59:42.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:42.195+0000 7f9766fa4700 1 -- 172.21.15.97:0/867069261 wait complete. 2023-06-23T00:59:42.213 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-23T00:59:42.213 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-23T00:59:42.214 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-06-23T00:59:42.214 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-06-23T00:59:42.214 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-23T00:59:42.214 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-23T00:59:42.215 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-23T00:59:42.215 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-23T00:59:42.215 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-06-23T00:59:42.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T00:59:42.216 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-06-23T00:59:42.223 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T00:59:42.224 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T00:59:42.224 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T00:59:42.224 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-06-23T00:59:42.224 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-06-23T00:59:42.224 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-06-23T00:59:42.224 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T00:59:42.224 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-06-23T00:59:42.225 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T00:59:42.225 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-06-23T00:59:42.225 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T00:59:42.225 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-06-23T00:59:42.225 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-23T00:59:42.225 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-06-23T00:59:42.225 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-23T00:59:42.226 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42552sec preferred_lft 42552sec 2023-06-23T00:59:42.226 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-06-23T00:59:42.226 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-06-23T00:59:42.226 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-23T00:59:42.226 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:b0:64:a7:a6 brd ff:ff:ff:ff:ff:ff 2023-06-23T00:59:42.226 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-23T00:59:42.226 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-06-23T00:59:42.227 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-23T00:59:42.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T00:59:42.228 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-06-23T00:59:42.228 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-06-23T00:59:42.228 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add name ceph-brx type bridge 2023-06-23T00:59:42.228 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip addr flush dev ceph-brx 2023-06-23T00:59:42.229 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set ceph-brx up 2023-06-23T00:59:42.229 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-23T00:59:42.229 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-06-23T00:59:42.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T00:59:42.307 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-23T00:59:42.317 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-06-23T00:59:42.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T00:59:42.320 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-06-23T00:59:42.349 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-06-23T00:59:42.349 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-23T00:59:42.349 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-23T00:59:42.349 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-23T00:59:42.350 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-23T00:59:42.350 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-23T00:59:42.350 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-23T00:59:42.350 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-23T00:59:42.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T00:59:42.351 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-06-23T00:59:42.352 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-06-23T00:59:42.353 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-23T00:59:42.353 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-23T00:59:42.354 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-23T00:59:42.354 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-06-23T00:59:42.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T00:59:42.434 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-06-23T00:59:42.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T00:59:42.442 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list-id 2023-06-23T00:59:42.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T00:59:42.449 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-06-23T00:59:42.449 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-06-23T00:59:42.449 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-23T00:59:42.450 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-06-23T00:59:42.450 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-06-23T00:59:42.481 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-06-23T00:59:42.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T00:59:42.482 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-06-23T00:59:42.482 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-06-23T00:59:42.483 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-06-23T00:59:42.483 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-23T00:59:42.483 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-06-23T00:59:42.483 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-06-23T00:59:42.484 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-06-23T00:59:42.484 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-06-23T00:59:42.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T00:59:42.555 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-06-23T00:59:42.555 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-06-23T00:59:42.556 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-06-23T00:59:42.557 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set dev brx.0 master ceph-brx 2023-06-23T00:59:42.558 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-06-23T00:59:42.583 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-06-23T00:59:42.583 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T00:59:42.584 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-06-23T00:59:42.632 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-06-23T00:59:42.633 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T00:59:42.633 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-06-23T00:59:42.642 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2023-06-23T00:59:42.657 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T00:59:42.658 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T00:59:42.672 INFO:teuthology.orchestra.run.smithi097.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T00:59:42.672 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T00:59:42.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-06-23T00:59:42.673 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2023-06-23T00:59:42.723 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-23T00:59:42.724 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-06-23T00:59:42.727 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2023-06-23T00:59:42.745 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T00:59:42.746 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T00:59:42.803 INFO:teuthology.orchestra.run.smithi097.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T00:59:42.804 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T00:59:42.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-06-23T00:59:42.805 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2023-06-23T00:59:42.812 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi097.stderr:2023-06-23T00:59:42.807+0000 7fd3d40ea380 -1 init, newargv = 0x56018769c830 newargc=15 2023-06-23T00:59:42.813 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi097.stderr:ceph-fuse[38905]: starting ceph client 2023-06-23T00:59:42.824 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi097.stderr:ceph-fuse[38905]: starting fuse 2023-06-23T00:59:43.912 DEBUG:teuthology.orchestra.run.smithi097:> sudo modprobe fuse 2023-06-23T00:59:43.931 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T00:59:43.932 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T00:59:43.991 INFO:teuthology.orchestra.run.smithi097.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T00:59:43.993 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T00:59:43.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-06-23T00:59:43.994 DEBUG:teuthology.orchestra.run.smithi097:> ls /sys/fs/fuse/connections 2023-06-23T00:59:44.001 INFO:teuthology.orchestra.run.smithi097.stdout:52 2023-06-23T00:59:44.001 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-06-23T00:59:44.002 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-23T00:59:44.002 DEBUG:teuthology.orchestra.run.smithi097:> import glob 2023-06-23T00:59:44.003 DEBUG:teuthology.orchestra.run.smithi097:> import re 2023-06-23T00:59:44.003 DEBUG:teuthology.orchestra.run.smithi097:> import os 2023-06-23T00:59:44.004 DEBUG:teuthology.orchestra.run.smithi097:> import subprocess 2023-06-23T00:59:44.004 DEBUG:teuthology.orchestra.run.smithi097:> 2023-06-23T00:59:44.004 DEBUG:teuthology.orchestra.run.smithi097:> def _find_admin_socket(client_name): 2023-06-23T00:59:44.005 DEBUG:teuthology.orchestra.run.smithi097:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-06-23T00:59:44.005 DEBUG:teuthology.orchestra.run.smithi097:> files = glob.glob(asok_path) 2023-06-23T00:59:44.005 DEBUG:teuthology.orchestra.run.smithi097:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-06-23T00:59:44.005 DEBUG:teuthology.orchestra.run.smithi097:> 2023-06-23T00:59:44.006 DEBUG:teuthology.orchestra.run.smithi097:> # Given a non-glob path, it better be there 2023-06-23T00:59:44.006 DEBUG:teuthology.orchestra.run.smithi097:> if "*" not in asok_path: 2023-06-23T00:59:44.006 DEBUG:teuthology.orchestra.run.smithi097:> assert(len(files) == 1) 2023-06-23T00:59:44.007 DEBUG:teuthology.orchestra.run.smithi097:> return files[0] 2023-06-23T00:59:44.007 DEBUG:teuthology.orchestra.run.smithi097:> 2023-06-23T00:59:44.007 DEBUG:teuthology.orchestra.run.smithi097:> for f in files: 2023-06-23T00:59:44.008 DEBUG:teuthology.orchestra.run.smithi097:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-23T00:59:44.008 DEBUG:teuthology.orchestra.run.smithi097:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-23T00:59:44.008 DEBUG:teuthology.orchestra.run.smithi097:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-23T00:59:44.009 DEBUG:teuthology.orchestra.run.smithi097:> contents = proc_f.read() 2023-06-23T00:59:44.009 DEBUG:teuthology.orchestra.run.smithi097:> if mountpoint in contents: 2023-06-23T00:59:44.009 DEBUG:teuthology.orchestra.run.smithi097:> return f 2023-06-23T00:59:44.010 DEBUG:teuthology.orchestra.run.smithi097:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-23T00:59:44.010 DEBUG:teuthology.orchestra.run.smithi097:> 2023-06-23T00:59:44.010 DEBUG:teuthology.orchestra.run.smithi097:> print(_find_admin_socket("client.admin")) 2023-06-23T00:59:44.010 DEBUG:teuthology.orchestra.run.smithi097:> ' 2023-06-23T00:59:44.096 INFO:teuthology.orchestra.run.smithi097.stdout:/var/run/ceph/ceph-client.admin.38905.asok 2023-06-23T00:59:44.279 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.38905.asok 2023-06-23T00:59:44.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-06-23T00:59:44.280 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.38905.asok status 2023-06-23T00:59:44.418 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-06-23T00:59:44.418 INFO:teuthology.orchestra.run.smithi097.stdout: "metadata": { 2023-06-23T00:59:44.418 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_sha1": "42ddc46e6e6582d8e29a5a982a81886fe028be2c", 2023-06-23T00:59:44.418 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_version": "ceph version 17.2.6-719-g42ddc46e (42ddc46e6e6582d8e29a5a982a81886fe028be2c) quincy (stable)", 2023-06-23T00:59:44.418 INFO:teuthology.orchestra.run.smithi097.stdout: "entity_id": "admin", 2023-06-23T00:59:44.419 INFO:teuthology.orchestra.run.smithi097.stdout: "hostname": "smithi097", 2023-06-23T00:59:44.419 INFO:teuthology.orchestra.run.smithi097.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-06-23T00:59:44.419 INFO:teuthology.orchestra.run.smithi097.stdout: "pid": "38905", 2023-06-23T00:59:44.419 INFO:teuthology.orchestra.run.smithi097.stdout: "root": "/" 2023-06-23T00:59:44.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-06-23T00:59:44.419 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_count": 0, 2023-06-23T00:59:44.419 INFO:teuthology.orchestra.run.smithi097.stdout: "dentry_pinned_count": 0, 2023-06-23T00:59:44.419 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 4458, 2023-06-23T00:59:44.420 INFO:teuthology.orchestra.run.smithi097.stdout: "inst": { 2023-06-23T00:59:44.420 INFO:teuthology.orchestra.run.smithi097.stdout: "name": { 2023-06-23T00:59:44.420 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "client", 2023-06-23T00:59:44.420 INFO:teuthology.orchestra.run.smithi097.stdout: "num": 4458 2023-06-23T00:59:44.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-06-23T00:59:44.420 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2023-06-23T00:59:44.420 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2023-06-23T00:59:44.421 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "192.168.0.1:0", 2023-06-23T00:59:44.421 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2157349595 2023-06-23T00:59:44.421 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-06-23T00:59:44.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-06-23T00:59:44.421 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": { 2023-06-23T00:59:44.421 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2023-06-23T00:59:44.421 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "192.168.0.1:0", 2023-06-23T00:59:44.421 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2157349595 2023-06-23T00:59:44.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-06-23T00:59:44.422 INFO:teuthology.orchestra.run.smithi097.stdout: "inst_str": "client.4458 192.168.0.1:0/2157349595", 2023-06-23T00:59:44.422 INFO:teuthology.orchestra.run.smithi097.stdout: "addr_str": "192.168.0.1:0/2157349595", 2023-06-23T00:59:44.422 INFO:teuthology.orchestra.run.smithi097.stdout: "inode_count": 1, 2023-06-23T00:59:44.422 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_epoch": 7, 2023-06-23T00:59:44.422 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch": 30, 2023-06-23T00:59:44.423 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_epoch_barrier": 0, 2023-06-23T00:59:44.423 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklisted": false, 2023-06-23T00:59:44.423 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs" 2023-06-23T00:59:44.423 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-06-23T00:59:44.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-06-23T00:59:44.427 DEBUG:teuthology.orchestra.run.smithi097:> stat --file-system '--printf=%T 2023-06-23T00:59:44.427 DEBUG:teuthology.orchestra.run.smithi097:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-06-23T00:59:44.435 INFO:teuthology.orchestra.run.smithi097.stdout:fuseblk 2023-06-23T00:59:44.435 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-06-23T00:59:44.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-06-23T00:59:44.436 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-06-23T00:59:44.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-06-23T00:59:44.448 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-06-23T00:59:44.583 INFO:teuthology.orchestra.run.smithi097.stdout:# file: . 2023-06-23T00:59:44.584 INFO:teuthology.orchestra.run.smithi097.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-06-23T00:59:44.584 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:59:44.585 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi097.front.sepia.ceph.com... 2023-06-23T00:59:44.585 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-06-23T00:59:44.586 DEBUG:teuthology.orchestra.run.smithi097:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-06-23T00:59:44.730 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi097.stderr:ceph-fuse[38905]: fuse finished with error 0 and tester_r 0 2023-06-23T00:59:44.733 INFO:teuthology.orchestra.run:waiting for 900 2023-06-23T00:59:44.803 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-06-23T00:59:44.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T00:59:44.804 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-06-23T00:59:44.909 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T00:59:45.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 Processor -- start 2023-06-23T00:59:45.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 -- start start 2023-06-23T00:59:45.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff904156680 0x7ff904156a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90415a5a0 0x7ff9040ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff9040cad40 0x7ff9040b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9040cbdf0 con 0x7ff904156680 2023-06-23T00:59:45.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9040cb1e0 con 0x7ff9040cad40 2023-06-23T00:59:45.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9040cb4c0 con 0x7ff90415a5a0 2023-06-23T00:59:45.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff9094a6700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff904156680 0x7ff904156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff9094a6700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff904156680 0x7ff904156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35840/0 (socket says 172.21.15.97:35840) 2023-06-23T00:59:45.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff9094a6700 1 -- 172.21.15.97:0/4166539861 learned_addr learned my addr 172.21.15.97:0/4166539861 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:45.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff908ca5700 1 --2- 172.21.15.97:0/4166539861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90415a5a0 0x7ff9040ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff9094a6700 1 -- 172.21.15.97:0/4166539861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90415a5a0 msgr2=0x7ff9040ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:45.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff9094a6700 1 --2- 172.21.15.97:0/4166539861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90415a5a0 0x7ff9040ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff909ca7700 1 --2- 172.21.15.97:0/4166539861 >> v2:172.21.15.149:3300/0 conn(0x7ff9040cad40 0x7ff9040b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff9094a6700 1 -- 172.21.15.97:0/4166539861 >> v2:172.21.15.149:3300/0 conn(0x7ff9040cad40 msgr2=0x7ff9040b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:45.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff9094a6700 1 --2- 172.21.15.97:0/4166539861 >> v2:172.21.15.149:3300/0 conn(0x7ff9040cad40 0x7ff9040b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff9094a6700 1 -- 172.21.15.97:0/4166539861 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9040cb7a0 con 0x7ff904156680 2023-06-23T00:59:45.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff908ca5700 1 --2- 172.21.15.97:0/4166539861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90415a5a0 0x7ff9040ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T00:59:45.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff909ca7700 1 --2- 172.21.15.97:0/4166539861 >> v2:172.21.15.149:3300/0 conn(0x7ff9040cad40 0x7ff9040b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T00:59:45.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff9094a6700 1 --2- 172.21.15.97:0/4166539861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff904156680 0x7ff904156a50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009f20 tx=0x7ff8fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b458dda99b386f0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:45.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff8fbfff700 1 -- 172.21.15.97:0/4166539861 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc00e070 con 0x7ff904156680 2023-06-23T00:59:45.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff8fbfff700 1 -- 172.21.15.97:0/4166539861 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc00ba40 con 0x7ff904156680 2023-06-23T00:59:45.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff8fbfff700 1 -- 172.21.15.97:0/4166539861 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0092e0 con 0x7ff904156680 2023-06-23T00:59:45.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 -- 172.21.15.97:0/4166539861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff904156680 msgr2=0x7ff904156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 --2- 172.21.15.97:0/4166539861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff904156680 0x7ff904156a50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009f20 tx=0x7ff8fc009840 comp rx=0 tx=0).stop 2023-06-23T00:59:45.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 -- 172.21.15.97:0/4166539861 shutdown_connections 2023-06-23T00:59:45.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 --2- 172.21.15.97:0/4166539861 >> v2:172.21.15.149:3300/0 conn(0x7ff9040cad40 0x7ff9040b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 --2- 172.21.15.97:0/4166539861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90415a5a0 0x7ff9040ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 --2- 172.21.15.97:0/4166539861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff904156680 0x7ff904156a50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 -- 172.21.15.97:0/4166539861 >> 172.21.15.97:0/4166539861 conn(0x7ff9040683b0 msgr2=0x7ff9040687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:45.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 -- 172.21.15.97:0/4166539861 shutdown_connections 2023-06-23T00:59:45.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.019+0000 7ff90a4a8700 1 -- 172.21.15.97:0/4166539861 wait complete. 2023-06-23T00:59:45.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.023+0000 7ff90a4a8700 1 Processor -- start 2023-06-23T00:59:45.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.023+0000 7ff90a4a8700 1 -- start start 2023-06-23T00:59:45.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.023+0000 7ff90a4a8700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9040cad40 0x7ff904154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.023+0000 7ff90a4a8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff904156680 0x7ff904153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.023+0000 7ff90a4a8700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90415a5a0 0x7ff9040b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.023+0000 7ff90a4a8700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9040b0ef0 con 0x7ff9040cad40 2023-06-23T00:59:45.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.023+0000 7ff90a4a8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff904154fa0 con 0x7ff904156680 2023-06-23T00:59:45.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.023+0000 7ff90a4a8700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff904152e20 con 0x7ff90415a5a0 2023-06-23T00:59:45.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.023+0000 7ff9094a6700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9040cad40 0x7ff904154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.023+0000 7ff9094a6700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9040cad40 0x7ff904154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35844/0 (socket says 172.21.15.97:35844) 2023-06-23T00:59:45.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.023+0000 7ff9094a6700 1 -- 172.21.15.97:0/42238436 learned_addr learned my addr 172.21.15.97:0/42238436 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:45.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.023+0000 7ff908ca5700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff904156680 0x7ff904153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.023+0000 7ff909ca7700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90415a5a0 0x7ff9040b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff9094a6700 1 -- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90415a5a0 msgr2=0x7ff9040b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff9094a6700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90415a5a0 0x7ff9040b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff9094a6700 1 -- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff904156680 msgr2=0x7ff904153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff9094a6700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff904156680 0x7ff904153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff9094a6700 1 -- 172.21.15.97:0/42238436 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc009ae0 con 0x7ff9040cad40 2023-06-23T00:59:45.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff908ca5700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff904156680 0x7ff904153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T00:59:45.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff9094a6700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9040cad40 0x7ff904154930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00b6c0 tx=0x7ff8fc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:45.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff8f97fa700 1 -- 172.21.15.97:0/42238436 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc007040 con 0x7ff9040cad40 2023-06-23T00:59:45.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff8f97fa700 1 -- 172.21.15.97:0/42238436 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc0079e0 con 0x7ff9040cad40 2023-06-23T00:59:45.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff90a4a8700 1 -- 172.21.15.97:0/42238436 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff904153100 con 0x7ff9040cad40 2023-06-23T00:59:45.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff8f97fa700 1 -- 172.21.15.97:0/42238436 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc007da0 con 0x7ff9040cad40 2023-06-23T00:59:45.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff90a4a8700 1 -- 172.21.15.97:0/42238436 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9041536c0 con 0x7ff9040cad40 2023-06-23T00:59:45.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff90a4a8700 1 -- 172.21.15.97:0/42238436 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9041538e0 con 0x7ff9040cad40 2023-06-23T00:59:45.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.027+0000 7ff8f97fa700 1 -- 172.21.15.97:0/42238436 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7ff8fc01d420 con 0x7ff9040cad40 2023-06-23T00:59:45.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.031+0000 7ff8f97fa700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7ff8e80604b0 0x7ff8e8062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.031+0000 7ff8f97fa700 1 -- 172.21.15.97:0/42238436 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff8fc07e9e0 con 0x7ff9040cad40 2023-06-23T00:59:45.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.031+0000 7ff908ca5700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7ff8e80604b0 0x7ff8e8062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.031+0000 7ff908ca5700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7ff8e80604b0 0x7ff8e8062960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff90406dab0 tx=0x7ff8f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:45.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.035+0000 7ff8f97fa700 1 -- 172.21.15.97:0/42238436 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7ff8fc04ecf0 con 0x7ff9040cad40 2023-06-23T00:59:45.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.195+0000 7ff90a4a8700 1 -- 172.21.15.97:0/42238436 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9040cba80 con 0x7ff9040cad40 2023-06-23T00:59:45.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.199+0000 7ff8f97fa700 1 -- 172.21.15.97:0/42238436 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18707 (secure 0 0 0) 0x7ff8fc052310 con 0x7ff9040cad40 2023-06-23T00:59:45.209 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:59:45.209 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":30,"fsid":"6b52ccf4-99f4-48c9-9a8a-9a183942c228","created":"2023-06-23T00:59:11.989322+0000","modified":"2023-06-23T00:59:39.963836+0000","last_up_change":"2023-06-23T00:59:22.950578+0000","last_in_change":"2023-06-23T00:59:14.057374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T00:59:24.275869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T00:59:29.802618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T00:59:33.890862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T00:59:34.526165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T00:59:37.609350+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"291bc189-d5fb-482f-92d6-f7ecfb0a388c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":32817},{"type":"v1","addr":"172.21.15.97:6801","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":32817},{"type":"v1","addr":"172.21.15.97:6803","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":32817},{"type":"v1","addr":"172.21.15.97:6807","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":32817},{"type":"v1","addr":"172.21.15.97:6805","nonce":32817}]},"public_addr":"172.21.15.97:6801/32817","cluster_addr":"172.21.15.97:6803/32817","heartbeat_back_addr":"172.21.15.97:6807/32817","heartbeat_front_addr":"172.21.15.97:6805/32817","state":["exists","up"]},{"osd":1,"uuid":"693551b5-827b-4530-80b1-a836095efbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":32818},{"type":"v1","addr":"172.21.15.97:6817","nonce":32818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":32818},{"type":"v1","addr":"172.21.15.97:6819","nonce":32818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":32818},{"type":"v1","addr":"172.21.15.97:6823","nonce":32818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":32818},{"type":"v1","addr":"172.21.15.97:6821","nonce":32818}]},"public_addr":"172.21.15.97:6817/32818","cluster_addr":"172.21.15.97:6819/32818","heartbeat_back_addr":"172.21.15.97:6823/32818","heartbeat_front_addr":"172.21.15.97:6821/32818","state":["exists","up"]},{"osd":2,"uuid":"a100d026-e382-4e71-bda5-ffa59f6b596b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":32820},{"type":"v1","addr":"172.21.15.97:6825","nonce":32820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":32820},{"type":"v1","addr":"172.21.15.97:6827","nonce":32820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":32820},{"type":"v1","addr":"172.21.15.97:6831","nonce":32820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":32820},{"type":"v1","addr":"172.21.15.97:6829","nonce":32820}]},"public_addr":"172.21.15.97:6825/32820","cluster_addr":"172.21.15.97:6827/32820","heartbeat_back_addr":"172.21.15.97:6831/32820","heartbeat_front_addr":"172.21.15.97:6829/32820","state":["exists","up"]},{"osd":3,"uuid":"91783241-7821-458e-996f-a740274b18ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":32819},{"type":"v1","addr":"172.21.15.97:6809","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":32819},{"type":"v1","addr":"172.21.15.97:6811","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":32819},{"type":"v1","addr":"172.21.15.97:6815","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":32819},{"type":"v1","addr":"172.21.15.97:6813","nonce":32819}]},"public_addr":"172.21.15.97:6809/32819","cluster_addr":"172.21.15.97:6811/32819","heartbeat_back_addr":"172.21.15.97:6815/32819","heartbeat_front_addr":"172.21.15.97:6813/32819","state":["exists","up"]},{"osd":4,"uuid":"67c375d3-ec8f-4d1a-bea7-e47896705fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":32992},{"type":"v1","addr":"172.21.15.149:6801","nonce":32992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":32992},{"type":"v1","addr":"172.21.15.149:6803","nonce":32992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":32992},{"type":"v1","addr":"172.21.15.149:6807","nonce":32992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":32992},{"type":"v1","addr":"172.21.15.149:6805","nonce":32992}]},"public_addr":"172.21.15.149:6801/32992","cluster_addr":"172.21.15.149:6803/32992","heartbeat_back_addr":"172.21.15.149:6807/32992","heartbeat_front_addr":"172.21.15.149:6805/32992","state":["exists","up"]},{"osd":5,"uuid":"9de42b7c-cf51-4adf-9cc1-11c8d9863574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":32995},{"type":"v1","addr":"172.21.15.149:6809","nonce":32995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":32995},{"type":"v1","addr":"172.21.15.149:6811","nonce":32995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":32995},{"type":"v1","addr":"172.21.15.149:6815","nonce":32995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":32995},{"type":"v1","addr":"172.21.15.149:6813","nonce":32995}]},"public_addr":"172.21.15.149:6809/32995","cluster_addr":"172.21.15.149:6811/32995","heartbeat_back_addr":"172.21.15.149:6815/32995","heartbeat_front_addr":"172.21.15.149:6813/32995","state":["exists","up"]},{"osd":6,"uuid":"ffa4ef96-2528-45cb-b2c9-a6c671b234e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":32996},{"type":"v1","addr":"172.21.15.149:6825","nonce":32996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":32996},{"type":"v1","addr":"172.21.15.149:6827","nonce":32996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":32996},{"type":"v1","addr":"172.21.15.149:6831","nonce":32996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":32996},{"type":"v1","addr":"172.21.15.149:6829","nonce":32996}]},"public_addr":"172.21.15.149:6825/32996","cluster_addr":"172.21.15.149:6827/32996","heartbeat_back_addr":"172.21.15.149:6831/32996","heartbeat_front_addr":"172.21.15.149:6829/32996","state":["exists","up"]},{"osd":7,"uuid":"de849aa4-8494-4aeb-b1b6-6dd30458923c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":32994},{"type":"v1","addr":"172.21.15.149:6817","nonce":32994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":32994},{"type":"v1","addr":"172.21.15.149:6819","nonce":32994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":32994},{"type":"v1","addr":"172.21.15.149:6823","nonce":32994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":32994},{"type":"v1","addr":"172.21.15.149:6821","nonce":32994}]},"public_addr":"172.21.15.149:6817/32994","cluster_addr":"172.21.15.149:6819/32994","heartbeat_back_addr":"172.21.15.149:6823/32994","heartbeat_front_addr":"172.21.15.149:6821/32994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.027722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.241225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.289939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.257873+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.443455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.479909+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.521773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.560641+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T00:59:45.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.203+0000 7ff90a4a8700 1 -- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7ff8e80604b0 msgr2=0x7ff8e8062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.203+0000 7ff90a4a8700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7ff8e80604b0 0x7ff8e8062960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff90406dab0 tx=0x7ff8f4008040 comp rx=0 tx=0).stop 2023-06-23T00:59:45.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.203+0000 7ff90a4a8700 1 -- 172.21.15.97:0/42238436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9040cad40 msgr2=0x7ff904154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.203+0000 7ff90a4a8700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9040cad40 0x7ff904154930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00b6c0 tx=0x7ff8fc018000 comp rx=0 tx=0).stop 2023-06-23T00:59:45.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.203+0000 7ff90a4a8700 1 -- 172.21.15.97:0/42238436 shutdown_connections 2023-06-23T00:59:45.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.203+0000 7ff90a4a8700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7ff8e80604b0 0x7ff8e8062960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.203+0000 7ff90a4a8700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff90415a5a0 0x7ff9040b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.203+0000 7ff90a4a8700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff904156680 0x7ff904153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.203+0000 7ff90a4a8700 1 --2- 172.21.15.97:0/42238436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff9040cad40 0x7ff904154930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.203+0000 7ff90a4a8700 1 -- 172.21.15.97:0/42238436 >> 172.21.15.97:0/42238436 conn(0x7ff9040683b0 msgr2=0x7ff904151390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:45.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.203+0000 7ff90a4a8700 1 -- 172.21.15.97:0/42238436 shutdown_connections 2023-06-23T00:59:45.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.203+0000 7ff90a4a8700 1 -- 172.21.15.97:0/42238436 wait complete. 2023-06-23T00:59:45.221 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T00:59:45.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f9958fbf700 1 Processor -- start 2023-06-23T00:59:45.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f9958fbf700 1 -- start start 2023-06-23T00:59:45.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f9958fbf700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f99540c8880 0x7f99540c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f9958fbf700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99540ca900 con 0x7f99540c7570 2023-06-23T00:59:45.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f9958fbf700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9954067ff0 con 0x7f99540ad820 2023-06-23T00:59:45.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f9958fbf700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9954156ed0 con 0x7f99540c8880 2023-06-23T00:59:45.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f9951d9b700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f99540c8880 0x7f99540c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f995259c700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f99540c7570 0x7f9954155e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57936/0 (socket says 172.21.15.97:57936) 2023-06-23T00:59:45.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f995259c700 1 -- 172.21.15.97:0/2777016912 learned_addr learned my addr 172.21.15.97:0/2777016912 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:45.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f9951d9b700 1 -- 172.21.15.97:0/2777016912 >> v1:172.21.15.149:6789/0 conn(0x7f99540ad820 legacy=0x7f99540adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f9951d9b700 1 -- 172.21.15.97:0/2777016912 >> v1:172.21.15.97:6789/0 conn(0x7f99540c7570 legacy=0x7f9954155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f995159a700 1 -- 172.21.15.97:0/2777016912 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225694485 0 0) 0x7f994c001490 con 0x7f99540ad820 2023-06-23T00:59:45.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f9951d9b700 1 -- 172.21.15.97:0/2777016912 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9954156630 con 0x7f99540c8880 2023-06-23T00:59:45.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f9951d9b700 1 --2- 172.21.15.97:0/2777016912 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99540c8880 0x7f99540c7940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f993c0098e0 tx=0x7f993c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25da3eb39f2ca483 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:45.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f995159a700 1 -- 172.21.15.97:0/2777016912 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c009e80 con 0x7f99540c8880 2023-06-23T00:59:45.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f995159a700 1 -- 172.21.15.97:0/2777016912 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c00b760 con 0x7f99540c8880 2023-06-23T00:59:45.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.315+0000 7f995159a700 1 -- 172.21.15.97:0/2777016912 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00bae0 con 0x7f99540c8880 2023-06-23T00:59:45.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 -- 172.21.15.97:0/2777016912 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99540c8880 msgr2=0x7f99540c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 --2- 172.21.15.97:0/2777016912 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99540c8880 0x7f99540c7940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f993c0098e0 tx=0x7f993c0091a0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 -- 172.21.15.97:0/2777016912 shutdown_connections 2023-06-23T00:59:45.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 --2- 172.21.15.97:0/2777016912 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99540c8880 0x7f99540c7940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 -- 172.21.15.97:0/2777016912 >> 172.21.15.97:0/2777016912 conn(0x7f99540cc190 msgr2=0x7f99540c8170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:45.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 -- 172.21.15.97:0/2777016912 shutdown_connections 2023-06-23T00:59:45.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 -- 172.21.15.97:0/2777016912 wait complete. 2023-06-23T00:59:45.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 Processor -- start 2023-06-23T00:59:45.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 -- start start 2023-06-23T00:59:45.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99540ad820 0x7f9954166cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99540c7570 0x7f9954144190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99540c8880 0x7f99540c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99541593e0 con 0x7f99540c7570 2023-06-23T00:59:45.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99541446d0 con 0x7f99540c8880 2023-06-23T00:59:45.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9958fbf700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9954167320 con 0x7f99540ad820 2023-06-23T00:59:45.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9951d9b700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99540c7570 0x7f9954144190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9951d9b700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99540c7570 0x7f9954144190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35870/0 (socket says 172.21.15.97:35870) 2023-06-23T00:59:45.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9951d9b700 1 -- 172.21.15.97:0/2670565536 learned_addr learned my addr 172.21.15.97:0/2670565536 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:45.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f9952d9d700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99540c8880 0x7f99540c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.319+0000 7f995259c700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99540ad820 0x7f9954166cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.323+0000 7f9952d9d700 1 -- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99540ad820 msgr2=0x7f9954166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.323+0000 7f9952d9d700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99540ad820 0x7f9954166cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.323+0000 7f9952d9d700 1 -- 172.21.15.97:0/2670565536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99540c7570 msgr2=0x7f9954144190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.323+0000 7f9952d9d700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99540c7570 0x7f9954144190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.323+0000 7f9952d9d700 1 -- 172.21.15.97:0/2670565536 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c009420 con 0x7f99540c8880 2023-06-23T00:59:45.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.323+0000 7f9951d9b700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99540c7570 0x7f9954144190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T00:59:45.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.323+0000 7f9952d9d700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99540c8880 0x7f99540c51d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f99540ae390 tx=0x7f994c007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:45.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.323+0000 7f994a7fc700 1 -- 172.21.15.97:0/2670565536 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c012630 con 0x7f99540c8880 2023-06-23T00:59:45.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.323+0000 7f994a7fc700 1 -- 172.21.15.97:0/2670565536 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c012790 con 0x7f99540c8880 2023-06-23T00:59:45.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.323+0000 7f9958fbf700 1 -- 172.21.15.97:0/2670565536 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9954167600 con 0x7f99540c8880 2023-06-23T00:59:45.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.323+0000 7f994a7fc700 1 -- 172.21.15.97:0/2670565536 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c012b50 con 0x7f99540c8880 2023-06-23T00:59:45.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.323+0000 7f9958fbf700 1 -- 172.21.15.97:0/2670565536 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9954167bc0 con 0x7f99540c8880 2023-06-23T00:59:45.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.323+0000 7f9958fbf700 1 -- 172.21.15.97:0/2670565536 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9954159550 con 0x7f99540c8880 2023-06-23T00:59:45.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.327+0000 7f994a7fc700 1 -- 172.21.15.97:0/2670565536 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f994c01a3a0 con 0x7f99540c8880 2023-06-23T00:59:45.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.327+0000 7f994a7fc700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f99380604e0 0x7f9938062990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.327+0000 7f994a7fc700 1 -- 172.21.15.97:0/2670565536 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f994c07cc50 con 0x7f99540c8880 2023-06-23T00:59:45.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.327+0000 7f995259c700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f99380604e0 0x7f9938062990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.327+0000 7f995259c700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f99380604e0 0x7f9938062990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99440058d0 tx=0x7f9944009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:45.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.335+0000 7f994a7fc700 1 -- 172.21.15.97:0/2670565536 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f994c04ce10 con 0x7f99540c8880 2023-06-23T00:59:45.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.495+0000 7f9958fbf700 1 -- 172.21.15.97:0/2670565536 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9954067ff0 con 0x7f99540c8880 2023-06-23T00:59:45.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.499+0000 7f994a7fc700 1 -- 172.21.15.97:0/2670565536 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f9954067ff0 con 0x7f99540c8880 2023-06-23T00:59:45.506 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-06-23T00:59:45.507 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":30,"fsid":"6b52ccf4-99f4-48c9-9a8a-9a183942c228","created":"2023-06-23T00:59:11.989322+0000","modified":"2023-06-23T00:59:39.963836+0000","last_up_change":"2023-06-23T00:59:22.950578+0000","last_in_change":"2023-06-23T00:59:14.057374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T00:59:24.275869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T00:59:29.802618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T00:59:33.890862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T00:59:34.526165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T00:59:37.609350+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"291bc189-d5fb-482f-92d6-f7ecfb0a388c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":32817},{"type":"v1","addr":"172.21.15.97:6801","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":32817},{"type":"v1","addr":"172.21.15.97:6803","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":32817},{"type":"v1","addr":"172.21.15.97:6807","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":32817},{"type":"v1","addr":"172.21.15.97:6805","nonce":32817}]},"public_addr":"172.21.15.97:6801/32817","cluster_addr":"172.21.15.97:6803/32817","heartbeat_back_addr":"172.21.15.97:6807/32817","heartbeat_front_addr":"172.21.15.97:6805/32817","state":["exists","up"]},{"osd":1,"uuid":"693551b5-827b-4530-80b1-a836095efbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":32818},{"type":"v1","addr":"172.21.15.97:6817","nonce":32818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":32818},{"type":"v1","addr":"172.21.15.97:6819","nonce":32818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":32818},{"type":"v1","addr":"172.21.15.97:6823","nonce":32818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":32818},{"type":"v1","addr":"172.21.15.97:6821","nonce":32818}]},"public_addr":"172.21.15.97:6817/32818","cluster_addr":"172.21.15.97:6819/32818","heartbeat_back_addr":"172.21.15.97:6823/32818","heartbeat_front_addr":"172.21.15.97:6821/32818","state":["exists","up"]},{"osd":2,"uuid":"a100d026-e382-4e71-bda5-ffa59f6b596b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":32820},{"type":"v1","addr":"172.21.15.97:6825","nonce":32820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":32820},{"type":"v1","addr":"172.21.15.97:6827","nonce":32820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":32820},{"type":"v1","addr":"172.21.15.97:6831","nonce":32820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":32820},{"type":"v1","addr":"172.21.15.97:6829","nonce":32820}]},"public_addr":"172.21.15.97:6825/32820","cluster_addr":"172.21.15.97:6827/32820","heartbeat_back_addr":"172.21.15.97:6831/32820","heartbeat_front_addr":"172.21.15.97:6829/32820","state":["exists","up"]},{"osd":3,"uuid":"91783241-7821-458e-996f-a740274b18ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":32819},{"type":"v1","addr":"172.21.15.97:6809","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":32819},{"type":"v1","addr":"172.21.15.97:6811","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":32819},{"type":"v1","addr":"172.21.15.97:6815","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":32819},{"type":"v1","addr":"172.21.15.97:6813","nonce":32819}]},"public_addr":"172.21.15.97:6809/32819","cluster_addr":"172.21.15.97:6811/32819","heartbeat_back_addr":"172.21.15.97:6815/32819","heartbeat_front_addr":"172.21.15.97:6813/32819","state":["exists","up"]},{"osd":4,"uuid":"67c375d3-ec8f-4d1a-bea7-e47896705fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":32992},{"type":"v1","addr":"172.21.15.149:6801","nonce":32992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":32992},{"type":"v1","addr":"172.21.15.149:6803","nonce":32992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":32992},{"type":"v1","addr":"172.21.15.149:6807","nonce":32992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":32992},{"type":"v1","addr":"172.21.15.149:6805","nonce":32992}]},"public_addr":"172.21.15.149:6801/32992","cluster_addr":"172.21.15.149:6803/32992","heartbeat_back_addr":"172.21.15.149:6807/32992","heartbeat_front_addr":"172.21.15.149:6805/32992","state":["exists","up"]},{"osd":5,"uuid":"9de42b7c-cf51-4adf-9cc1-11c8d9863574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":32995},{"type":"v1","addr":"172.21.15.149:6809","nonce":32995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":32995},{"type":"v1","addr":"172.21.15.149:6811","nonce":32995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":32995},{"type":"v1","addr":"172.21.15.149:6815","nonce":32995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":32995},{"type":"v1","addr":"172.21.15.149:6813","nonce":32995}]},"public_addr":"172.21.15.149:6809/32995","cluster_addr":"172.21.15.149:6811/32995","heartbeat_back_addr":"172.21.15.149:6815/32995","heartbeat_front_addr":"172.21.15.149:6813/32995","state":["exists","up"]},{"osd":6,"uuid":"ffa4ef96-2528-45cb-b2c9-a6c671b234e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":32996},{"type":"v1","addr":"172.21.15.149:6825","nonce":32996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":32996},{"type":"v1","addr":"172.21.15.149:6827","nonce":32996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":32996},{"type":"v1","addr":"172.21.15.149:6831","nonce":32996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":32996},{"type":"v1","addr":"172.21.15.149:6829","nonce":32996}]},"public_addr":"172.21.15.149:6825/32996","cluster_addr":"172.21.15.149:6827/32996","heartbeat_back_addr":"172.21.15.149:6831/32996","heartbeat_front_addr":"172.21.15.149:6829/32996","state":["exists","up"]},{"osd":7,"uuid":"de849aa4-8494-4aeb-b1b6-6dd30458923c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":32994},{"type":"v1","addr":"172.21.15.149:6817","nonce":32994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":32994},{"type":"v1","addr":"172.21.15.149:6819","nonce":32994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":32994},{"type":"v1","addr":"172.21.15.149:6823","nonce":32994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":32994},{"type":"v1","addr":"172.21.15.149:6821","nonce":32994}]},"public_addr":"172.21.15.149:6817/32994","cluster_addr":"172.21.15.149:6819/32994","heartbeat_back_addr":"172.21.15.149:6823/32994","heartbeat_front_addr":"172.21.15.149:6821/32994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.027722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.241225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.289939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.257873+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.443455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.479909+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.521773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T00:59:19.560641+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T00:59:45.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.503+0000 7f9958fbf700 1 -- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f99380604e0 msgr2=0x7f9938062990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.503+0000 7f9958fbf700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f99380604e0 0x7f9938062990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99440058d0 tx=0x7f9944009040 comp rx=0 tx=0).stop 2023-06-23T00:59:45.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.503+0000 7f9958fbf700 1 -- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99540c8880 msgr2=0x7f99540c51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.503+0000 7f9958fbf700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99540c8880 0x7f99540c51d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f99540ae390 tx=0x7f994c007ec0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.503+0000 7f9958fbf700 1 -- 172.21.15.97:0/2670565536 shutdown_connections 2023-06-23T00:59:45.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.503+0000 7f9958fbf700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f99380604e0 0x7f9938062990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.503+0000 7f9958fbf700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99540c8880 0x7f99540c51d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.503+0000 7f9958fbf700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99540c7570 0x7f9954144190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.503+0000 7f9958fbf700 1 --2- 172.21.15.97:0/2670565536 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99540ad820 0x7f9954166cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.503+0000 7f9958fbf700 1 -- 172.21.15.97:0/2670565536 >> 172.21.15.97:0/2670565536 conn(0x7f99540cc190 msgr2=0x7f995406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:45.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.503+0000 7f9958fbf700 1 -- 172.21.15.97:0/2670565536 shutdown_connections 2023-06-23T00:59:45.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.503+0000 7f9958fbf700 1 -- 172.21.15.97:0/2670565536 wait complete. 2023-06-23T00:59:45.525 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-23T00:59:45.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f450cb6a700 1 Processor -- start 2023-06-23T00:59:45.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f450cb6a700 1 -- start start 2023-06-23T00:59:45.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f450cb6a700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f450806d8b0 0x7f45080c6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f450cb6a700 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450806cd10 con 0x7f45080c6350 2023-06-23T00:59:45.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f450cb6a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450806c3e0 con 0x7f450806ab10 2023-06-23T00:59:45.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f450cb6a700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450806c1d0 con 0x7f450806d8b0 2023-06-23T00:59:45.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f45077fe700 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f45080c6350 0x7f45080ae840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57940/0 (socket says 172.21.15.97:57940) 2023-06-23T00:59:45.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f45077fe700 1 -- 172.21.15.97:0/1449427948 learned_addr learned my addr 172.21.15.97:0/1449427948 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-06-23T00:59:45.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f4507fff700 1 --2- 172.21.15.97:0/1449427948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f450806d8b0 0x7f45080c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f4506ffd700 1 -- 172.21.15.97:0/1449427948 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948196082 0 0) 0x7f450806cd10 con 0x7f45080c6350 2023-06-23T00:59:45.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f4506ffd700 1 -- 172.21.15.97:0/1449427948 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f4003570 con 0x7f45080c6350 2023-06-23T00:59:45.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f4506ffd700 1 -- 172.21.15.97:0/1449427948 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489287181 0 0) 0x7f450806c3e0 con 0x7f450806ab10 2023-06-23T00:59:45.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f4506ffd700 1 -- 172.21.15.97:0/1449427948 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f450806cd10 con 0x7f450806ab10 2023-06-23T00:59:45.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f4507fff700 1 -- 172.21.15.97:0/1449427948 >> v1:172.21.15.149:6789/0 conn(0x7f450806ab10 legacy=0x7f450806d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f4507fff700 1 -- 172.21.15.97:0/1449427948 >> v1:172.21.15.97:6789/0 conn(0x7f45080c6350 legacy=0x7f45080ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f4507fff700 1 -- 172.21.15.97:0/1449427948 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450806c6c0 con 0x7f450806d8b0 2023-06-23T00:59:45.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f4507fff700 1 --2- 172.21.15.97:0/1449427948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f450806d8b0 0x7f45080c6720 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4500009e90 tx=0x7f4500009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c38fce1b1e2d90f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:45.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f4506ffd700 1 -- 172.21.15.97:0/1449427948 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450000e070 con 0x7f450806d8b0 2023-06-23T00:59:45.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f4506ffd700 1 -- 172.21.15.97:0/1449427948 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450000bb80 con 0x7f450806d8b0 2023-06-23T00:59:45.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f4506ffd700 1 -- 172.21.15.97:0/1449427948 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4500012430 con 0x7f450806d8b0 2023-06-23T00:59:45.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f450cb6a700 1 -- 172.21.15.97:0/1449427948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f450806d8b0 msgr2=0x7f45080c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f450cb6a700 1 --2- 172.21.15.97:0/1449427948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f450806d8b0 0x7f45080c6720 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4500009e90 tx=0x7f4500009780 comp rx=0 tx=0).stop 2023-06-23T00:59:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f450cb6a700 1 -- 172.21.15.97:0/1449427948 shutdown_connections 2023-06-23T00:59:45.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f450cb6a700 1 --2- 172.21.15.97:0/1449427948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f450806d8b0 0x7f45080c6720 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f450cb6a700 1 -- 172.21.15.97:0/1449427948 >> 172.21.15.97:0/1449427948 conn(0x7f45080cc100 msgr2=0x7f450806e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:45.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f450cb6a700 1 -- 172.21.15.97:0/1449427948 shutdown_connections 2023-06-23T00:59:45.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.631+0000 7f450cb6a700 1 -- 172.21.15.97:0/1449427948 wait complete. 2023-06-23T00:59:45.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f450cb6a700 1 Processor -- start 2023-06-23T00:59:45.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f450cb6a700 1 -- start start 2023-06-23T00:59:45.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f450cb6a700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f450806ab10 0x7f4508168a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f450cb6a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f450806d8b0 0x7f450815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f450cb6a700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45080c6350 0x7f45080a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f450cb6a700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45080c9200 con 0x7f450806ab10 2023-06-23T00:59:45.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f450cb6a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45080ca020 con 0x7f450806d8b0 2023-06-23T00:59:45.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f450cb6a700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45080c9410 con 0x7f45080c6350 2023-06-23T00:59:45.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f45077fe700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f450806ab10 0x7f4508168a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f45077fe700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f450806ab10 0x7f4508168a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35886/0 (socket says 172.21.15.97:35886) 2023-06-23T00:59:45.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f45077fe700 1 -- 172.21.15.97:0/2390995274 learned_addr learned my addr 172.21.15.97:0/2390995274 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:45.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f44feffd700 1 --2- 172.21.15.97:0/2390995274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f450806d8b0 0x7f450815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f4507fff700 1 --2- 172.21.15.97:0/2390995274 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45080c6350 0x7f45080a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f45077fe700 1 -- 172.21.15.97:0/2390995274 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45080c6350 msgr2=0x7f45080a4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f45077fe700 1 --2- 172.21.15.97:0/2390995274 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45080c6350 0x7f45080a4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f45077fe700 1 -- 172.21.15.97:0/2390995274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f450806d8b0 msgr2=0x7f450815ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f45077fe700 1 --2- 172.21.15.97:0/2390995274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f450806d8b0 0x7f450815ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f45077fe700 1 -- 172.21.15.97:0/2390995274 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4500009a20 con 0x7f450806ab10 2023-06-23T00:59:45.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f45077fe700 1 --2- 172.21.15.97:0/2390995274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f450806ab10 0x7f4508168a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c790 tx=0x7f44f8007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:45.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f44fffff700 1 -- 172.21.15.97:0/2390995274 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8005b30 con 0x7f450806ab10 2023-06-23T00:59:45.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f44fffff700 1 -- 172.21.15.97:0/2390995274 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f8005cd0 con 0x7f450806ab10 2023-06-23T00:59:45.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f450cb6a700 1 -- 172.21.15.97:0/2390995274 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45080c96f0 con 0x7f450806ab10 2023-06-23T00:59:45.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f44fffff700 1 -- 172.21.15.97:0/2390995274 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8007320 con 0x7f450806ab10 2023-06-23T00:59:45.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.635+0000 7f450cb6a700 1 -- 172.21.15.97:0/2390995274 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45080c9cb0 con 0x7f450806ab10 2023-06-23T00:59:45.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.639+0000 7f450cb6a700 1 -- 172.21.15.97:0/2390995274 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4508068870 con 0x7f450806ab10 2023-06-23T00:59:45.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.639+0000 7f44fffff700 1 -- 172.21.15.97:0/2390995274 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f44f8012400 con 0x7f450806ab10 2023-06-23T00:59:45.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.639+0000 7f44fffff700 1 --2- 172.21.15.97:0/2390995274 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f44e80604e0 0x7f44e8062990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.639+0000 7f44fffff700 1 -- 172.21.15.97:0/2390995274 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f44f807bf00 con 0x7f450806ab10 2023-06-23T00:59:45.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.639+0000 7f44feffd700 1 --2- 172.21.15.97:0/2390995274 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f44e80604e0 0x7f44e8062990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.639+0000 7f44feffd700 1 --2- 172.21.15.97:0/2390995274 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7f44e80604e0 0x7f44e8062990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f45080c8e30 tx=0x7f44f0007d20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:45.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.647+0000 7f44fffff700 1 -- 172.21.15.97:0/2390995274 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f44f804c210 con 0x7f450806ab10 2023-06-23T00:59:45.851 INFO:teuthology.orchestra.run.smithi097.stderr:no valid command found; 1 closest matches: 2023-06-23T00:59:45.851 INFO:teuthology.orchestra.run.smithi097.stderr:fs set |refuse_client_session|max_xattr_size [--yes-i-really-mean-it] [--yes-i-really-really-mean-it] 2023-06-23T00:59:45.851 INFO:teuthology.orchestra.run.smithi097.stderr:Error EINVAL: invalid command 2023-06-23T00:59:45.854 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-06-23T00:59:45.855 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-06-23T00:59:45.855 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-23T00:59:45.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 Processor -- start 2023-06-23T00:59:45.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 -- start start 2023-06-23T00:59:45.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb618156670 0x7fb618156a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6180ccba0 0x7fb6180afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6180cc710 con 0x7fb6180cb320 2023-06-23T00:59:45.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6180cbb00 con 0x7fb618156670 2023-06-23T00:59:45.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6180cbde0 con 0x7fb6180ccba0 2023-06-23T00:59:45.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61de94700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb618156670 0x7fb618156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61de94700 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb618156670 0x7fb618156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35900/0 (socket says 172.21.15.97:35900) 2023-06-23T00:59:45.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61de94700 1 -- 172.21.15.97:0/2057081471 learned_addr learned my addr 172.21.15.97:0/2057081471 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:45.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61d693700 1 --2- 172.21.15.97:0/2057081471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6180ccba0 0x7fb6180afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61de94700 1 -- 172.21.15.97:0/2057081471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6180ccba0 msgr2=0x7fb6180afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T00:59:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61de94700 1 --2- 172.21.15.97:0/2057081471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6180ccba0 0x7fb6180afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61de94700 1 -- 172.21.15.97:0/2057081471 >> v1:172.21.15.149:6789/0 conn(0x7fb6180cb320 legacy=0x7fb6180ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61de94700 1 -- 172.21.15.97:0/2057081471 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6180cc0c0 con 0x7fb618156670 2023-06-23T00:59:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61de94700 1 --2- 172.21.15.97:0/2057081471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb618156670 0x7fb618156a40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb6140099b0 tx=0x7fb614009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843e557a1fc47675 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ce92700 1 -- 172.21.15.97:0/2057081471 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614009ea0 con 0x7fb618156670 2023-06-23T00:59:45.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ce92700 1 -- 172.21.15.97:0/2057081471 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61400b860 con 0x7fb618156670 2023-06-23T00:59:45.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ce92700 1 -- 172.21.15.97:0/2057081471 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61400bc00 con 0x7fb618156670 2023-06-23T00:59:45.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 -- 172.21.15.97:0/2057081471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb618156670 msgr2=0x7fb618156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 --2- 172.21.15.97:0/2057081471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb618156670 0x7fb618156a40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb6140099b0 tx=0x7fb614009250 comp rx=0 tx=0).stop 2023-06-23T00:59:45.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 -- 172.21.15.97:0/2057081471 shutdown_connections 2023-06-23T00:59:45.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 --2- 172.21.15.97:0/2057081471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6180ccba0 0x7fb6180afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 --2- 172.21.15.97:0/2057081471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb618156670 0x7fb618156a40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 -- 172.21.15.97:0/2057081471 >> 172.21.15.97:0/2057081471 conn(0x7fb6180ca260 msgr2=0x7fb6180ca660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T00:59:45.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 -- 172.21.15.97:0/2057081471 shutdown_connections 2023-06-23T00:59:45.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.959+0000 7fb61ee96700 1 -- 172.21.15.97:0/2057081471 wait complete. 2023-06-23T00:59:45.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61ee96700 1 Processor -- start 2023-06-23T00:59:45.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61ee96700 1 -- start start 2023-06-23T00:59:45.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61ee96700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6180cb320 0x7fb61816c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61ee96700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6180ccba0 0x7fb61816ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61ee96700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb618156670 0x7fb6181583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61ee96700 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6180c42a0 con 0x7fb618156670 2023-06-23T00:59:45.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61ee96700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb618158fe0 con 0x7fb6180cb320 2023-06-23T00:59:45.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61ee96700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6181592c0 con 0x7fb6180ccba0 2023-06-23T00:59:45.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61e695700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb618156670 0x7fb6181583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61e695700 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb618156670 0x7fb6181583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35908/0 (socket says 172.21.15.97:35908) 2023-06-23T00:59:45.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61e695700 1 -- 172.21.15.97:0/2454049758 learned_addr learned my addr 172.21.15.97:0/2454049758 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-06-23T00:59:45.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61de94700 1 --2- 172.21.15.97:0/2454049758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6180cb320 0x7fb61816c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61d693700 1 --2- 172.21.15.97:0/2454049758 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6180ccba0 0x7fb61816ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61e695700 1 -- 172.21.15.97:0/2454049758 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6180ccba0 msgr2=0x7fb61816ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61e695700 1 --2- 172.21.15.97:0/2454049758 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6180ccba0 0x7fb61816ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61e695700 1 -- 172.21.15.97:0/2454049758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6180cb320 msgr2=0x7fb61816c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T00:59:45.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61e695700 1 --2- 172.21.15.97:0/2454049758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6180cb320 0x7fb61816c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T00:59:45.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61e695700 1 -- 172.21.15.97:0/2454049758 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140094f0 con 0x7fb618156670 2023-06-23T00:59:45.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61e695700 1 --2- 172.21.15.97:0/2454049758 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb618156670 0x7fb6181583d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb61000c840 tx=0x7fb610001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:45.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb60dffb700 1 -- 172.21.15.97:0/2454049758 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb610012630 con 0x7fb618156670 2023-06-23T00:59:45.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61ee96700 1 -- 172.21.15.97:0/2454049758 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61806d6e0 con 0x7fb618156670 2023-06-23T00:59:45.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb60dffb700 1 -- 172.21.15.97:0/2454049758 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6100127b0 con 0x7fb618156670 2023-06-23T00:59:45.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb60dffb700 1 -- 172.21.15.97:0/2454049758 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb610012b30 con 0x7fb618156670 2023-06-23T00:59:45.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.963+0000 7fb61ee96700 1 -- 172.21.15.97:0/2454049758 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61806dca0 con 0x7fb618156670 2023-06-23T00:59:45.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.967+0000 7fb61ee96700 1 -- 172.21.15.97:0/2454049758 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61806dec0 con 0x7fb618156670 2023-06-23T00:59:45.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.967+0000 7fb60dffb700 1 -- 172.21.15.97:0/2454049758 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fb610011380 con 0x7fb618156670 2023-06-23T00:59:45.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.967+0000 7fb60dffb700 1 --2- 172.21.15.97:0/2454049758 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fb5fc0604b0 0x7fb5fc062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T00:59:45.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.967+0000 7fb60dffb700 1 -- 172.21.15.97:0/2454049758 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb61007cc90 con 0x7fb618156670 2023-06-23T00:59:45.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.967+0000 7fb61de94700 1 --2- 172.21.15.97:0/2454049758 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fb5fc0604b0 0x7fb5fc062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T00:59:45.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.967+0000 7fb61de94700 1 --2- 172.21.15.97:0/2454049758 >> [v2:172.21.15.149:6832/32655,v1:172.21.15.149:6833/32655] conn(0x7fb5fc0604b0 0x7fb5fc062960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb6140099b0 tx=0x7fb614017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T00:59:45.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-06-23T00:59:45.975+0000 7fb60dffb700 1 -- 172.21.15.97:0/2454049758 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fb61004cef0 con 0x7fb618156670 2023-06-23T00:59:46.181 INFO:teuthology.orchestra.run.smithi097.stderr:no valid command found; 1 closest matches: 2023-06-23T00:59:46.182 INFO:teuthology.orchestra.run.smithi097.stderr:fs set |refuse_client_session|max_xattr_size [--yes-i-really-mean-it] [--yes-i-really-really-mean-it] 2023-06-23T00:59:46.182 INFO:teuthology.orchestra.run.smithi097.stderr:Error EINVAL: invalid command 2023-06-23T00:59:46.186 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-06-23T00:59:46.187 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 450, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 514, in __init__ self.create() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 717, in create self.set_allow_standby_replay(standby_replay) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 589, in set_allow_standby_replay self.set_var("allow_standby_replay", yes) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 574, in set_var self.mon_manager.raw_cluster_cmd("fs", "set", self.name, var, *a) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi097 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false' 2023-06-23T00:59:46.187 INFO:teuthology.misc:Shutting down mds daemons... 2023-06-23T00:59:46.188 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-23T00:59:46.188 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.204 INFO:tasks.ceph.mds.a:Stopped 2023-06-23T00:59:46.204 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-23T00:59:46.205 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.215 INFO:tasks.ceph.mds.c:Stopped 2023-06-23T00:59:46.215 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-23T00:59:46.216 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.230 INFO:tasks.ceph.mds.b:Stopped 2023-06-23T00:59:46.231 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-23T00:59:46.231 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.243 INFO:tasks.ceph.mds.d:Stopped 2023-06-23T00:59:46.243 INFO:teuthology.misc:Shutting down osd daemons... 2023-06-23T00:59:46.244 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-06-23T00:59:46.244 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.302 INFO:tasks.ceph.osd.0:Stopped 2023-06-23T00:59:46.302 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-06-23T00:59:46.303 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.380 INFO:tasks.ceph.osd.1:Stopped 2023-06-23T00:59:46.381 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-06-23T00:59:46.382 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.458 INFO:tasks.ceph.osd.2:Stopped 2023-06-23T00:59:46.459 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-06-23T00:59:46.459 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.544 INFO:tasks.ceph.osd.3:Stopped 2023-06-23T00:59:46.545 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-06-23T00:59:46.546 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.632 INFO:tasks.ceph.osd.4:Stopped 2023-06-23T00:59:46.633 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-06-23T00:59:46.634 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.703 INFO:tasks.ceph.osd.5:Stopped 2023-06-23T00:59:46.704 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-06-23T00:59:46.704 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.803 INFO:tasks.ceph.osd.6:Stopped 2023-06-23T00:59:46.804 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-06-23T00:59:46.805 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.885 INFO:tasks.ceph.osd.7:Stopped 2023-06-23T00:59:46.886 INFO:teuthology.misc:Shutting down mgr daemons... 2023-06-23T00:59:46.886 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-06-23T00:59:46.887 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.912 INFO:tasks.ceph.mgr.y:Stopped 2023-06-23T00:59:46.913 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-06-23T00:59:46.913 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.940 INFO:tasks.ceph.mgr.x:Stopped 2023-06-23T00:59:46.941 INFO:teuthology.misc:Shutting down mon daemons... 2023-06-23T00:59:46.941 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-06-23T00:59:46.941 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.974 INFO:tasks.ceph.mon.a:Stopped 2023-06-23T00:59:46.975 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-06-23T00:59:46.975 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:46.999 INFO:tasks.ceph.mon.b:Stopped 2023-06-23T00:59:47.000 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-06-23T00:59:47.000 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T00:59:47.016 INFO:tasks.ceph.mon.c:Stopped 2023-06-23T00:59:47.017 INFO:tasks.ceph:Checking cluster log for badness... 2023-06-23T00:59:47.018 DEBUG:teuthology.orchestra.run.smithi097:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'Error loading MDS rank' | egrep -v 'missing journal object' | egrep -v 'Error recovering journal' | egrep -v 'error decoding table object' | egrep -v 'failed to read JournalPointer' | egrep -v 'Corrupt directory entry' | egrep -v 'Corrupt fnode header' | egrep -v 'corrupt sessionmap header' | egrep -v 'Corrupt dentry' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_READ_ONLY | egrep -v 'force file system read-only' | egrep -v 'with standby daemon mds' | head -n 1 2023-06-23T00:59:47.042 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi097.front.sepia.ceph.com 2023-06-23T00:59:47.043 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-06-23T00:59:47.873 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi097.front.sepia.ceph.com 2023-06-23T00:59:47.874 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-06-23T00:59:48.092 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi097.front.sepia.ceph.com 2023-06-23T00:59:48.093 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-06-23T00:59:48.274 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi097.front.sepia.ceph.com 2023-06-23T00:59:48.274 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-06-23T00:59:48.441 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-23T00:59:48.442 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-06-23T00:59:48.807 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-23T00:59:48.808 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-06-23T00:59:49.098 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-23T00:59:49.098 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-06-23T00:59:49.275 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-23T00:59:49.275 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-06-23T00:59:49.431 INFO:tasks.ceph:Archiving mon data... 2023-06-23T00:59:49.433 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916/data/mon.a.tgz 2023-06-23T00:59:49.433 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-06-23T00:59:49.441 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.rufdTVJDBu 2023-06-23T00:59:49.442 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rufdTVJDBu 2023-06-23T00:59:49.547 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.rufdTVJDBu 2023-06-23T00:59:49.570 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.rufdTVJDBu is 211KB 2023-06-23T00:59:49.630 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.rufdTVJDBu 2023-06-23T00:59:49.638 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916/data/mon.b.tgz 2023-06-23T00:59:49.639 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2023-06-23T00:59:49.647 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.ZijKxdE8wt 2023-06-23T00:59:49.647 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ZijKxdE8wt 2023-06-23T00:59:49.763 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.ZijKxdE8wt 2023-06-23T00:59:49.790 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.ZijKxdE8wt is 290KB 2023-06-23T00:59:49.848 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.ZijKxdE8wt 2023-06-23T00:59:49.856 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916/data/mon.c.tgz 2023-06-23T00:59:49.857 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2023-06-23T00:59:49.864 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.H4vEEONRbm 2023-06-23T00:59:49.864 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.H4vEEONRbm 2023-06-23T00:59:49.984 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.H4vEEONRbm 2023-06-23T00:59:50.005 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.H4vEEONRbm is 290KB 2023-06-23T00:59:50.065 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.H4vEEONRbm 2023-06-23T00:59:50.073 INFO:tasks.ceph:Cleaning ceph cluster... 2023-06-23T00:59:50.073 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-23T00:59:50.076 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-23T00:59:50.090 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-06-23T00:59:50.091 DEBUG:teuthology.orchestra.run.smithi097:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-23T00:59:50.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-23T00:59:50.161 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-23T00:59:50.165 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-23T00:59:50.170 INFO:tasks.ceph:Archiving crash dumps... 2023-06-23T00:59:50.172 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916/remote/smithi097/crash 2023-06-23T00:59:50.173 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-23T00:59:50.188 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916/remote/smithi149/crash 2023-06-23T00:59:50.189 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-23T00:59:50.204 INFO:tasks.ceph:Shutting down logrotate 2023-06-23T00:59:50.205 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T00:59:50.233 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T00:59:50.293 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-23T00:59:50.306 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-23T00:59:50.322 INFO:tasks.ceph:Compressing logs... 2023-06-23T00:59:50.323 DEBUG:teuthology.orchestra.run.smithi097:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-23T00:59:50.325 DEBUG:teuthology.orchestra.run.smithi149:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-23T00:59:52.871 INFO:tasks.ceph:Archiving logs... 2023-06-23T00:59:52.872 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916/remote/smithi097/log 2023-06-23T00:59:52.874 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-23T00:59:53.207 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916/remote/smithi149/log 2023-06-23T00:59:53.208 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-23T00:59:53.495 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 1893, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 450, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 514, in __init__ self.create() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 717, in create self.set_allow_standby_replay(standby_replay) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 589, in set_allow_standby_replay self.set_var("allow_standby_replay", yes) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 574, in set_var self.mon_manager.raw_cluster_cmd("fs", "set", self.name, var, *a) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi097 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false' 2023-06-23T00:59:53.574 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c5e4d526ff794be783e6509818a80b75 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 1893, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 450, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 514, in __init__ self.create() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 717, in create self.set_allow_standby_replay(standby_replay) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 589, in set_allow_standby_replay self.set_var("allow_standby_replay", yes) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 574, in set_var self.mon_manager.raw_cluster_cmd("fs", "set", self.name, var, *a) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi097 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false' 2023-06-23T00:59:53.580 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-06-23T00:59:53.589 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-06-23T00:59:53.608 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-06-23T00:59:53.609 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-23T00:59:53.621 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-23T00:59:53.689 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-06-23T00:59:53.700 INFO:teuthology.task.clock:Checking final clock skew... 2023-06-23T00:59:53.700 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T00:59:53.703 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T00:59:53.723 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T00:59:53.724 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2023-06-23T00:59:53.724 INFO:teuthology.orchestra.run.smithi097.stdout:*hv01.front.sepi 44.4.53.2 2 u 11 64 37 0.097 -1.764 1.202 2023-06-23T00:59:53.725 INFO:teuthology.orchestra.run.smithi097.stdout:+hv02.front.sepi 63.231.80.2 3 u 12 64 37 0.124 2.190 1.223 2023-06-23T00:59:53.725 INFO:teuthology.orchestra.run.smithi097.stdout:+hv03.front.sepi 74.6.168.72 3 u 10 64 37 0.077 0.606 1.427 2023-06-23T00:59:53.725 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T00:59:53.727 INFO:teuthology.orchestra.run.smithi149.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T00:59:53.727 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================== 2023-06-23T00:59:53.728 INFO:teuthology.orchestra.run.smithi149.stdout:*hv01.front.sepi 44.4.53.2 2 u 10 64 37 0.074 -1.690 1.955 2023-06-23T00:59:53.728 INFO:teuthology.orchestra.run.smithi149.stdout:+hv02.front.sepi 63.231.80.2 3 u 3 64 37 0.110 0.959 1.049 2023-06-23T00:59:53.728 INFO:teuthology.orchestra.run.smithi149.stdout:+hv03.front.sepi 74.6.168.72 3 u 6 64 37 0.106 0.451 1.934 2023-06-23T00:59:53.729 INFO:teuthology.orchestra.run.smithi149.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T00:59:53.729 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-06-23T00:59:53.739 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-06-23T00:59:53.740 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-06-23T00:59:53.749 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-06-23T00:59:53.759 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-06-23T00:59:53.768 INFO:teuthology.task.internal:Duration was 626.709131 seconds 2023-06-23T00:59:53.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-06-23T00:59:53.777 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-06-23T00:59:53.778 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-23T00:59:53.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-23T00:59:53.831 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-06-23T00:59:53.832 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2023-06-23T00:59:53.832 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-23T00:59:53.842 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2023-06-23T00:59:53.843 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-23T00:59:53.853 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-06-23T00:59:53.853 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-23T00:59:53.886 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-23T00:59:53.922 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-06-23T00:59:53.922 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-23T00:59:53.925 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-23T00:59:54.029 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-06-23T00:59:54.043 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-06-23T00:59:54.043 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-23T00:59:54.060 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-23T00:59:54.078 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-06-23T00:59:54.087 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-23T00:59:54.090 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-23T00:59:54.102 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2023-06-23T00:59:54.106 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2023-06-23T00:59:54.135 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-23T00:59:54.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T00:59:54.166 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-23T00:59:54.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T00:59:54.184 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-06-23T00:59:54.195 INFO:teuthology.task.internal:Transferring archived files... 2023-06-23T00:59:54.197 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916/remote/smithi097 2023-06-23T00:59:54.197 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-23T00:59:54.226 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916/remote/smithi149 2023-06-23T00:59:54.227 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-23T00:59:54.250 INFO:teuthology.task.internal:Removing archive directory... 2023-06-23T00:59:54.250 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-23T00:59:54.253 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-23T00:59:54.259 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-06-23T00:59:54.270 INFO:teuthology.task.internal:Not uploading archives. 2023-06-23T00:59:54.271 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-06-23T00:59:54.280 INFO:teuthology.task.internal:Tidying up after the test... 2023-06-23T00:59:54.280 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-23T00:59:54.302 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-23T00:59:54.307 INFO:teuthology.orchestra.run.smithi097.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 23 00:59 /home/ubuntu/cephtest 2023-06-23T00:59:54.309 INFO:teuthology.orchestra.run.smithi149.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 23 00:59 /home/ubuntu/cephtest 2023-06-23T00:59:54.312 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-06-23T00:59:54.323 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-06-23T00:59:54.350 INFO:teuthology.nuke:Checking targets against current locks 2023-06-23T00:59:54.387 DEBUG:teuthology.nuke:shortname: smithi097 2023-06-23T00:59:54.387 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T00:59:54.412 DEBUG:teuthology.nuke:shortname: smithi149 2023-06-23T00:59:54.412 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T00:59:54.416 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:40:14.936087', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-23T00:59:54.443 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311916', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:40:14.937979', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-23T00:59:54.474 INFO:teuthology.orchestra.console:Power off smithi097 2023-06-23T00:59:54.475 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:59:54.497 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:59:54.517 INFO:teuthology.orchestra.console:Power off smithi149 2023-06-23T00:59:54.519 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:59:54.546 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:59:58.534 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:59:58.575 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T01:00:02.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T01:00:02.687 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T01:00:02.865 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2023-06-23T01:00:02.900 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-06-23T01:00:03.005 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} duration: 626.7091307640076 failure_reason: 'Command failed on smithi097 with status 22: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=c5e4d526ff794be783e6509818a80b75 status: fail success: false 2023-06-23T01:00:03.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:00:03.095 INFO:teuthology.run:FAIL