2023-06-22T16:10:05.311 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-22T16:10:05.312 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} --archive /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787 --verbose --owner scheduled_yuriw@teuthology --name yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787/orig.config.yaml 2023-06-22T16:10:05.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T16:10:05.448 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787 branch: wip-yuri4-testing-2023-06-21-0846-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} email: yweinste@redhat.com first_in_suite: false job_id: '7311787' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri4-testing-2023-06-21-0846-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2023-06-21-0846-quincy sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9037 sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri4-testing-2023-06-21-0846-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c targets: smithi149.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 076bbebc42a14f7d568aaa78eabb0038327bcb23 timestamp: 2023-06-22_15:25:25 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-22T16:10:05.448 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa; will attempt to use it 2023-06-22T16:10:05.449 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks 2023-06-22T16:10:05.449 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-22T16:10:05.451 INFO:teuthology.task.internal:Checking packages... 2023-06-22T16:10:05.479 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '42ddc46e6e6582d8e29a5a982a81886fe028be2c' 2023-06-22T16:10:05.479 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-22T16:10:05.480 INFO:teuthology.packaging:ref: None 2023-06-22T16:10:05.480 INFO:teuthology.packaging:tag: None 2023-06-22T16:10:05.480 INFO:teuthology.packaging:branch: wip-yuri4-testing-2023-06-21-0846-quincy 2023-06-22T16:10:05.480 INFO:teuthology.packaging:sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-22T16:10:05.481 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri4-testing-2023-06-21-0846-quincy 2023-06-22T16:10:05.619 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-719-g42ddc46e-1focal 2023-06-22T16:10:05.620 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-22T16:10:05.630 INFO:teuthology.task.internal:no buildpackages task found 2023-06-22T16:10:05.630 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-22T16:10:05.648 INFO:teuthology.task.internal:Saving configuration 2023-06-22T16:10:05.663 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-22T16:10:05.670 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T16:10:05.698 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 16:02:27.303590', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-22T16:10:05.724 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 16:02:27.305836', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-22T16:10:05.725 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-22T16:10:05.732 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-22T16:10:05.732 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-22T16:10:05.732 INFO:teuthology.run_tasks:Running task console_log... 2023-06-22T16:10:05.813 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3eb7f00040>, signals=[15]) 2023-06-22T16:10:05.815 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-22T16:10:05.822 INFO:teuthology.task.internal:Opening connections... 2023-06-22T16:10:05.822 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2023-06-22T16:10:05.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T16:10:15.880 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2023-06-22T16:10:15.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T16:10:15.929 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-22T16:10:15.936 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-06-22T16:10:16.043 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-06-22T16:10:16.044 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-06-22T16:10:16.049 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-06-22T16:10:16.049 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-22T16:10:16.049 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-06-22T16:10:16.050 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-06-22T16:10:16.050 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-22T16:10:16.050 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-06-22T16:10:16.050 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-22T16:10:16.050 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-22T16:10:16.050 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-22T16:10:16.050 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-22T16:10:16.050 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-06-22T16:10:16.051 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-06-22T16:10:16.051 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-06-22T16:10:21.079 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2023-06-22T16:10:21.086 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2023-06-22T16:10:21.087 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2023-06-22T16:10:21.092 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2023-06-22T16:10:21.092 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-22T16:10:21.093 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2023-06-22T16:10:21.093 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2023-06-22T16:10:21.093 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-22T16:10:21.093 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="20.04" 2023-06-22T16:10:21.093 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-22T16:10:21.093 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-22T16:10:21.094 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-22T16:10:21.094 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-22T16:10:21.094 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=focal 2023-06-22T16:10:21.094 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=focal 2023-06-22T16:10:21.094 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2023-06-22T16:10:26.127 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-22T16:10:26.142 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-22T16:10:26.161 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-22T16:10:26.162 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2023-06-22T16:10:26.166 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2023-06-22T16:10:26.172 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-22T16:10:26.182 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-22T16:10:26.183 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2023-06-22T16:10:26.214 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2023-06-22T16:10:26.237 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-22T16:10:36.306 INFO:teuthology.run_tasks:Running task kernel... 2023-06-22T16:10:36.321 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-06-22T16:10:36.322 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-06-22T16:10:36.322 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-22T16:10:36.323 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-22T16:10:36.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T16:10:36.329 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2023-06-22T16:10:36.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T16:10:36.330 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2023-06-22T16:10:36.378 INFO:teuthology.orchestra.run.smithi149.stdout:5.4.0-124-generic 2023-06-22T16:10:36.378 INFO:teuthology.task.kernel:Running kernel on smithi149: 5.4.0-124-generic 2023-06-22T16:10:36.378 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get clean 2023-06-22T16:10:36.379 INFO:teuthology.orchestra.run.smithi196.stdout:5.4.0-124-generic 2023-06-22T16:10:36.380 INFO:teuthology.task.kernel:Running kernel on smithi196: 5.4.0-124-generic 2023-06-22T16:10:36.380 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get clean 2023-06-22T16:10:36.479 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get update 2023-06-22T16:10:36.494 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2023-06-22T16:10:36.653 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-06-22T16:10:36.655 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-06-22T16:10:36.763 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-22T16:10:36.769 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-22T16:10:36.845 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-06-22T16:10:36.851 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-06-22T16:10:36.935 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [613 kB] 2023-06-22T16:10:36.946 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [613 kB] 2023-06-22T16:10:37.016 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,267 kB] 2023-06-22T16:10:37.024 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,267 kB] 2023-06-22T16:10:37.060 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [362 kB] 2023-06-22T16:10:37.060 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.0 kB] 2023-06-22T16:10:37.060 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,885 kB] 2023-06-22T16:10:37.072 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [30.3 kB] 2023-06-22T16:10:37.072 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [264 kB] 2023-06-22T16:10:37.073 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [362 kB] 2023-06-22T16:10:37.073 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.0 kB] 2023-06-22T16:10:37.073 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [30.3 kB] 2023-06-22T16:10:37.073 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,885 kB] 2023-06-22T16:10:37.074 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [640 B] 2023-06-22T16:10:37.074 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [603 kB] 2023-06-22T16:10:37.078 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [849 kB] 2023-06-22T16:10:37.084 INFO:teuthology.orchestra.run.smithi149.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [264 kB] 2023-06-22T16:10:37.086 INFO:teuthology.orchestra.run.smithi149.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [640 B] 2023-06-22T16:10:37.086 INFO:teuthology.orchestra.run.smithi149.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [603 kB] 2023-06-22T16:10:37.090 INFO:teuthology.orchestra.run.smithi149.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [849 kB] 2023-06-22T16:10:37.118 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [176 kB] 2023-06-22T16:10:37.129 INFO:teuthology.orchestra.run.smithi149.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [176 kB] 2023-06-22T16:10:37.187 INFO:teuthology.orchestra.run.smithi149.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-06-22T16:10:37.194 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-06-22T16:10:37.202 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [18.6 kB] 2023-06-22T16:10:37.203 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [22.9 kB] 2023-06-22T16:10:37.205 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2023-06-22T16:10:37.206 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,488 B] 2023-06-22T16:10:37.206 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2023-06-22T16:10:37.213 INFO:teuthology.orchestra.run.smithi149.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [18.6 kB] 2023-06-22T16:10:37.214 INFO:teuthology.orchestra.run.smithi149.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [22.9 kB] 2023-06-22T16:10:37.216 INFO:teuthology.orchestra.run.smithi149.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2023-06-22T16:10:37.216 INFO:teuthology.orchestra.run.smithi149.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,488 B] 2023-06-22T16:10:37.217 INFO:teuthology.orchestra.run.smithi149.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2023-06-22T16:10:37.329 INFO:teuthology.orchestra.run.smithi149.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,649 kB] 2023-06-22T16:10:37.336 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [844 kB] 2023-06-22T16:10:37.576 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,649 kB] 2023-06-22T16:10:37.698 INFO:teuthology.orchestra.run.smithi149.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [844 kB] 2023-06-22T16:10:37.730 INFO:teuthology.orchestra.run.smithi149.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [444 kB] 2023-06-22T16:10:37.739 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [444 kB] 2023-06-22T16:10:37.743 INFO:teuthology.orchestra.run.smithi149.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.9 kB] 2023-06-22T16:10:37.743 INFO:teuthology.orchestra.run.smithi149.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,994 kB] 2023-06-22T16:10:37.752 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.9 kB] 2023-06-22T16:10:37.752 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [31.6 kB] 2023-06-22T16:10:37.753 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,994 kB] 2023-06-22T16:10:37.795 INFO:teuthology.orchestra.run.smithi149.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [31.6 kB] 2023-06-22T16:10:37.796 INFO:teuthology.orchestra.run.smithi149.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [280 kB] 2023-06-22T16:10:37.801 INFO:teuthology.orchestra.run.smithi149.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [636 B] 2023-06-22T16:10:37.806 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [280 kB] 2023-06-22T16:10:37.811 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [636 B] 2023-06-22T16:10:37.965 INFO:teuthology.orchestra.run.smithi149.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [733 kB] 2023-06-22T16:10:37.975 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [733 kB] 2023-06-22T16:10:38.548 INFO:teuthology.orchestra.run.smithi149.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,074 kB] 2023-06-22T16:10:38.558 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,074 kB] 2023-06-22T16:10:38.655 INFO:teuthology.orchestra.run.smithi149.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [256 kB] 2023-06-22T16:10:38.664 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [256 kB] 2023-06-22T16:10:38.675 INFO:teuthology.orchestra.run.smithi149.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.1 kB] 2023-06-22T16:10:38.677 INFO:teuthology.orchestra.run.smithi149.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-06-22T16:10:38.679 INFO:teuthology.orchestra.run.smithi149.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-06-22T16:10:38.679 INFO:teuthology.orchestra.run.smithi149.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-06-22T16:10:38.680 INFO:teuthology.orchestra.run.smithi149.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [612 B] 2023-06-22T16:10:38.681 INFO:teuthology.orchestra.run.smithi149.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-06-22T16:10:38.683 INFO:teuthology.orchestra.run.smithi149.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-06-22T16:10:38.685 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.1 kB] 2023-06-22T16:10:38.686 INFO:teuthology.orchestra.run.smithi149.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-06-22T16:10:38.687 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-06-22T16:10:38.688 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-06-22T16:10:38.689 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-06-22T16:10:38.690 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [612 B] 2023-06-22T16:10:38.690 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-06-22T16:10:38.693 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-06-22T16:10:38.696 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-06-22T16:10:38.850 INFO:teuthology.orchestra.run.smithi149.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-06-22T16:10:38.860 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-06-22T16:10:39.013 INFO:teuthology.orchestra.run.smithi149.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-06-22T16:10:39.023 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-06-22T16:10:39.064 INFO:teuthology.orchestra.run.smithi149.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-06-22T16:10:39.074 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-06-22T16:10:40.948 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 16.0 MB in 3s (6,357 kB/s) 2023-06-22T16:10:41.008 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 16.0 MB in 3s (6,364 kB/s) 2023-06-22T16:10:42.366 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-22T16:10:42.390 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-22T16:10:42.421 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2023-06-22T16:10:42.447 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-22T16:10:42.472 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-22T16:10:42.521 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2023-06-22T16:10:42.666 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2023-06-22T16:10:42.667 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2023-06-22T16:10:42.716 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2023-06-22T16:10:42.717 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2023-06-22T16:10:42.841 INFO:teuthology.orchestra.run.smithi149.stdout:The following additional packages will be installed: 2023-06-22T16:10:42.841 INFO:teuthology.orchestra.run.smithi149.stdout: linux-generic linux-headers-5.4.0-152 linux-headers-5.4.0-152-generic 2023-06-22T16:10:42.841 INFO:teuthology.orchestra.run.smithi149.stdout: linux-headers-generic linux-image-5.4.0-152-generic 2023-06-22T16:10:42.842 INFO:teuthology.orchestra.run.smithi149.stdout: linux-modules-5.4.0-152-generic linux-modules-extra-5.4.0-152-generic 2023-06-22T16:10:42.842 INFO:teuthology.orchestra.run.smithi149.stdout:Suggested packages: 2023-06-22T16:10:42.842 INFO:teuthology.orchestra.run.smithi149.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-06-22T16:10:42.842 INFO:teuthology.orchestra.run.smithi149.stdout:Recommended packages: 2023-06-22T16:10:42.842 INFO:teuthology.orchestra.run.smithi149.stdout: thermald 2023-06-22T16:10:42.893 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2023-06-22T16:10:42.894 INFO:teuthology.orchestra.run.smithi196.stdout: linux-generic linux-headers-5.4.0-152 linux-headers-5.4.0-152-generic 2023-06-22T16:10:42.894 INFO:teuthology.orchestra.run.smithi196.stdout: linux-headers-generic linux-image-5.4.0-152-generic 2023-06-22T16:10:42.894 INFO:teuthology.orchestra.run.smithi196.stdout: linux-modules-5.4.0-152-generic linux-modules-extra-5.4.0-152-generic 2023-06-22T16:10:42.894 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2023-06-22T16:10:42.895 INFO:teuthology.orchestra.run.smithi196.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-06-22T16:10:42.895 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2023-06-22T16:10:42.895 INFO:teuthology.orchestra.run.smithi196.stdout: thermald 2023-06-22T16:10:42.899 INFO:teuthology.orchestra.run.smithi149.stdout:The following NEW packages will be installed: 2023-06-22T16:10:42.899 INFO:teuthology.orchestra.run.smithi149.stdout: linux-headers-5.4.0-152 linux-headers-5.4.0-152-generic 2023-06-22T16:10:42.899 INFO:teuthology.orchestra.run.smithi149.stdout: linux-image-5.4.0-152-generic linux-modules-5.4.0-152-generic 2023-06-22T16:10:42.899 INFO:teuthology.orchestra.run.smithi149.stdout: linux-modules-extra-5.4.0-152-generic 2023-06-22T16:10:42.900 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages will be upgraded: 2023-06-22T16:10:42.901 INFO:teuthology.orchestra.run.smithi149.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-22T16:10:42.947 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2023-06-22T16:10:42.947 INFO:teuthology.orchestra.run.smithi196.stdout: linux-headers-5.4.0-152 linux-headers-5.4.0-152-generic 2023-06-22T16:10:42.947 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-152-generic linux-modules-5.4.0-152-generic 2023-06-22T16:10:42.948 INFO:teuthology.orchestra.run.smithi196.stdout: linux-modules-extra-5.4.0-152-generic 2023-06-22T16:10:42.948 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages will be upgraded: 2023-06-22T16:10:42.949 INFO:teuthology.orchestra.run.smithi196.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-22T16:10:43.001 INFO:teuthology.orchestra.run.smithi196.stdout:3 upgraded, 5 newly installed, 0 to remove and 223 not upgraded. 2023-06-22T16:10:43.001 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 77.1 MB of archives. 2023-06-22T16:10:43.002 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 380 MB of additional disk space will be used. 2023-06-22T16:10:43.002 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-152-generic amd64 5.4.0-152.169 [15.0 MB] 2023-06-22T16:10:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:3 upgraded, 5 newly installed, 0 to remove and 223 not upgraded. 2023-06-22T16:10:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:Need to get 77.1 MB of archives. 2023-06-22T16:10:43.083 INFO:teuthology.orchestra.run.smithi149.stdout:After this operation, 380 MB of additional disk space will be used. 2023-06-22T16:10:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-152-generic amd64 5.4.0-152.169 [15.0 MB] 2023-06-22T16:10:43.299 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-152-generic amd64 5.4.0-152.169 [10.5 MB] 2023-06-22T16:10:43.390 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-152-generic amd64 5.4.0-152.169 [39.2 MB] 2023-06-22T16:10:43.841 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.152.149 [1,900 B] 2023-06-22T16:10:43.842 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.152.149 [2,596 B] 2023-06-22T16:10:43.842 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-152 all 5.4.0-152.169 [11.0 MB] 2023-06-22T16:10:43.933 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-152-generic amd64 5.4.0-152.169 [1,362 kB] 2023-06-22T16:10:43.943 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.152.149 [2,464 B] 2023-06-22T16:10:44.245 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-152-generic amd64 5.4.0-152.169 [10.5 MB] 2023-06-22T16:10:44.561 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-152-generic amd64 5.4.0-152.169 [39.2 MB] 2023-06-22T16:10:44.601 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 77.1 MB in 1s (78.0 MB/s) 2023-06-22T16:10:44.806 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-modules-5.4.0-152-generic. 2023-06-22T16:10:45.831 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.152.149 [1,900 B] 2023-06-22T16:10:45.831 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.152.149 [2,596 B] 2023-06-22T16:10:45.832 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-152 all 5.4.0-152.169 [11.0 MB] 2023-06-22T16:10:46.245 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-152-generic amd64 5.4.0-152.169 [1,362 kB] 2023-06-22T16:10:46.304 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.152.149 [2,464 B] 2023-06-22T16:10:46.553 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-06-22T16:10:46.558 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../0-linux-modules-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-22T16:10:46.686 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-modules-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:10:46.998 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 77.1 MB in 3s (22.7 MB/s) 2023-06-22T16:10:47.197 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-modules-5.4.0-152-generic. 2023-06-22T16:10:48.603 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-image-5.4.0-152-generic. 2023-06-22T16:10:48.619 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../1-linux-image-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-22T16:10:48.719 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:10:49.023 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-06-22T16:10:49.028 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../0-linux-modules-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-22T16:10:49.219 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-modules-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:10:49.822 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-152-generic. 2023-06-22T16:10:49.838 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-22T16:10:49.881 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-modules-extra-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:10:51.153 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-image-5.4.0-152-generic. 2023-06-22T16:10:51.166 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../1-linux-image-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-22T16:10:51.270 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:10:52.381 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-152-generic. 2023-06-22T16:10:52.396 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-22T16:10:52.439 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-modules-extra-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:10:54.901 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../3-linux-generic_5.4.0.152.149_amd64.deb ... 2023-06-22T16:10:55.026 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-22T16:10:55.360 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.152.149_amd64.deb ... 2023-06-22T16:10:55.505 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-22T16:10:55.841 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-headers-5.4.0-152. 2023-06-22T16:10:55.857 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../5-linux-headers-5.4.0-152_5.4.0-152.169_all.deb ... 2023-06-22T16:10:55.899 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-5.4.0-152 (5.4.0-152.169) ... 2023-06-22T16:10:57.259 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../3-linux-generic_5.4.0.152.149_amd64.deb ... 2023-06-22T16:10:57.385 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-22T16:10:57.727 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.152.149_amd64.deb ... 2023-06-22T16:10:57.855 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-image-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-22T16:10:58.208 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-headers-5.4.0-152. 2023-06-22T16:10:58.222 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../5-linux-headers-5.4.0-152_5.4.0-152.169_all.deb ... 2023-06-22T16:10:58.266 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-headers-5.4.0-152 (5.4.0-152.169) ... 2023-06-22T16:11:01.353 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-headers-5.4.0-152-generic. 2023-06-22T16:11:01.375 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../6-linux-headers-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-22T16:11:01.436 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:11:03.681 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-headers-5.4.0-152-generic. 2023-06-22T16:11:03.703 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../6-linux-headers-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-22T16:11:03.748 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-headers-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:11:04.071 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.152.149_amd64.deb ... 2023-06-22T16:11:04.217 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-22T16:11:04.551 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-5.4.0-152 (5.4.0-152.169) ... 2023-06-22T16:11:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:11:04.823 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-modules-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:11:06.050 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:11:06.387 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.152.149_amd64.deb ... 2023-06-22T16:11:06.508 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-headers-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-22T16:11:06.855 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-headers-5.4.0-152 (5.4.0-152.169) ... 2023-06-22T16:11:06.979 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-headers-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:11:07.089 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-modules-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:11:07.188 INFO:teuthology.orchestra.run.smithi196.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-152-generic 2023-06-22T16:11:07.188 INFO:teuthology.orchestra.run.smithi196.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-152-generic 2023-06-22T16:11:07.343 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-generic (5.4.0.152.149) ... 2023-06-22T16:11:07.503 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-modules-extra-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:11:08.391 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:11:08.687 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-generic (5.4.0.152.149) ... 2023-06-22T16:11:08.813 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-generic (5.4.0.152.149) ... 2023-06-22T16:11:08.940 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:11:09.024 INFO:teuthology.orchestra.run.smithi196.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-22T16:11:09.025 INFO:teuthology.orchestra.run.smithi196.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-152-generic 2023-06-22T16:11:10.305 INFO:teuthology.orchestra.run.smithi149.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-152-generic 2023-06-22T16:11:10.305 INFO:teuthology.orchestra.run.smithi149.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-152-generic 2023-06-22T16:11:10.434 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-headers-generic (5.4.0.152.149) ... 2023-06-22T16:11:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-modules-extra-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:11:11.787 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-image-generic (5.4.0.152.149) ... 2023-06-22T16:11:11.946 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-generic (5.4.0.152.149) ... 2023-06-22T16:11:12.073 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-22T16:11:12.142 INFO:teuthology.orchestra.run.smithi149.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-22T16:11:12.142 INFO:teuthology.orchestra.run.smithi149.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-152-generic 2023-06-22T16:11:31.218 INFO:teuthology.orchestra.run.smithi196.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-22T16:11:31.218 INFO:teuthology.orchestra.run.smithi196.stdout:Sourcing file `/etc/default/grub' 2023-06-22T16:11:31.226 INFO:teuthology.orchestra.run.smithi196.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-22T16:11:31.244 INFO:teuthology.orchestra.run.smithi196.stdout:Generating grub configuration file ... 2023-06-22T16:11:31.576 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.4.0-152-generic 2023-06-22T16:11:31.601 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.4.0-152-generic 2023-06-22T16:11:31.978 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-22T16:11:31.989 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-22T16:11:33.877 INFO:teuthology.orchestra.run.smithi149.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-22T16:11:33.877 INFO:teuthology.orchestra.run.smithi149.stdout:Sourcing file `/etc/default/grub' 2023-06-22T16:11:33.889 INFO:teuthology.orchestra.run.smithi149.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-22T16:11:33.901 INFO:teuthology.orchestra.run.smithi149.stdout:Generating grub configuration file ... 2023-06-22T16:11:34.196 INFO:teuthology.orchestra.run.smithi149.stdout:Found linux image: /boot/vmlinuz-5.4.0-152-generic 2023-06-22T16:11:34.220 INFO:teuthology.orchestra.run.smithi149.stdout:Found initrd image: /boot/initrd.img-5.4.0-152-generic 2023-06-22T16:11:34.622 INFO:teuthology.orchestra.run.smithi149.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-22T16:11:34.633 INFO:teuthology.orchestra.run.smithi149.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-22T16:11:34.738 INFO:teuthology.orchestra.run.smithi196.stdout:done 2023-06-22T16:11:35.156 DEBUG:teuthology.orchestra.run.smithi196:> dpkg -s linux-image-generic 2023-06-22T16:11:35.214 INFO:teuthology.orchestra.run.smithi196.stdout:Package: linux-image-generic 2023-06-22T16:11:35.214 INFO:teuthology.orchestra.run.smithi196.stdout:Status: install ok installed 2023-06-22T16:11:35.214 INFO:teuthology.orchestra.run.smithi196.stdout:Priority: optional 2023-06-22T16:11:35.214 INFO:teuthology.orchestra.run.smithi196.stdout:Section: kernel 2023-06-22T16:11:35.215 INFO:teuthology.orchestra.run.smithi196.stdout:Installed-Size: 19 2023-06-22T16:11:35.215 INFO:teuthology.orchestra.run.smithi196.stdout:Maintainer: Ubuntu Kernel Team 2023-06-22T16:11:35.215 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: amd64 2023-06-22T16:11:35.215 INFO:teuthology.orchestra.run.smithi196.stdout:Source: linux-meta 2023-06-22T16:11:35.215 INFO:teuthology.orchestra.run.smithi196.stdout:Version: 5.4.0.152.149 2023-06-22T16:11:35.215 INFO:teuthology.orchestra.run.smithi196.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-06-22T16:11:35.215 INFO:teuthology.orchestra.run.smithi196.stdout:Depends: linux-image-5.4.0-152-generic, linux-modules-extra-5.4.0-152-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-22T16:11:35.216 INFO:teuthology.orchestra.run.smithi196.stdout:Recommends: thermald 2023-06-22T16:11:35.216 INFO:teuthology.orchestra.run.smithi196.stdout:Description: Generic Linux kernel image 2023-06-22T16:11:35.216 INFO:teuthology.orchestra.run.smithi196.stdout: This package will always depend on the latest generic kernel image 2023-06-22T16:11:35.216 INFO:teuthology.orchestra.run.smithi196.stdout: available. 2023-06-22T16:11:35.221 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-152-generic 2023-06-22T16:11:35.221 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-22T16:11:35.221 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-22T16:11:35.221 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-06-22T16:11:35.221 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi196.front.sepia.ceph.com, path=None, version=distro) 2023-06-22T16:11:35.222 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get clean 2023-06-22T16:11:35.306 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2023-06-22T16:11:35.434 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-22T16:11:35.434 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-22T16:11:35.441 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-22T16:11:35.458 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-22T16:11:37.153 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2023-06-22T16:11:37.179 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-22T16:11:37.245 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2023-06-22T16:11:37.339 INFO:teuthology.orchestra.run.smithi149.stdout:done 2023-06-22T16:11:37.439 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2023-06-22T16:11:37.439 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2023-06-22T16:11:37.646 INFO:teuthology.orchestra.run.smithi196.stdout:linux-image-generic is already the newest version (5.4.0.152.149). 2023-06-22T16:11:37.646 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 0 newly installed, 0 to remove and 223 not upgraded. 2023-06-22T16:11:37.648 DEBUG:teuthology.orchestra.run.smithi196:> dpkg -s linux-image-generic 2023-06-22T16:11:37.669 INFO:teuthology.orchestra.run.smithi196.stdout:Package: linux-image-generic 2023-06-22T16:11:37.669 INFO:teuthology.orchestra.run.smithi196.stdout:Status: install ok installed 2023-06-22T16:11:37.669 INFO:teuthology.orchestra.run.smithi196.stdout:Priority: optional 2023-06-22T16:11:37.669 INFO:teuthology.orchestra.run.smithi196.stdout:Section: kernel 2023-06-22T16:11:37.670 INFO:teuthology.orchestra.run.smithi196.stdout:Installed-Size: 19 2023-06-22T16:11:37.670 INFO:teuthology.orchestra.run.smithi196.stdout:Maintainer: Ubuntu Kernel Team 2023-06-22T16:11:37.670 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: amd64 2023-06-22T16:11:37.670 INFO:teuthology.orchestra.run.smithi196.stdout:Source: linux-meta 2023-06-22T16:11:37.670 INFO:teuthology.orchestra.run.smithi196.stdout:Version: 5.4.0.152.149 2023-06-22T16:11:37.670 INFO:teuthology.orchestra.run.smithi196.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-06-22T16:11:37.670 INFO:teuthology.orchestra.run.smithi196.stdout:Depends: linux-image-5.4.0-152-generic, linux-modules-extra-5.4.0-152-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-22T16:11:37.671 INFO:teuthology.orchestra.run.smithi196.stdout:Recommends: thermald 2023-06-22T16:11:37.671 INFO:teuthology.orchestra.run.smithi196.stdout:Description: Generic Linux kernel image 2023-06-22T16:11:37.671 INFO:teuthology.orchestra.run.smithi196.stdout: This package will always depend on the latest generic kernel image 2023-06-22T16:11:37.671 INFO:teuthology.orchestra.run.smithi196.stdout: available. 2023-06-22T16:11:37.671 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2023-06-22T16:11:37.675 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.QRnddaOQlD 2023-06-22T16:11:37.676 DEBUG:teuthology.orchestra.run.smithi196:> sudo cp /boot/grub/grub.cfg /tmp/tmp.QRnddaOQlD 2023-06-22T16:11:37.730 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.QRnddaOQlD 2023-06-22T16:11:37.761 DEBUG:teuthology.orchestra.run.smithi149:> dpkg -s linux-image-generic 2023-06-22T16:11:37.766 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.QRnddaOQlD is 9KB 2023-06-22T16:11:37.778 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.QRnddaOQlD 2023-06-22T16:11:37.784 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-22T16:11:37.798 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:11:37.798 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-22T16:11:37.798 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-22T16:11:37.817 INFO:teuthology.orchestra.run.smithi149.stdout:Package: linux-image-generic 2023-06-22T16:11:37.817 INFO:teuthology.orchestra.run.smithi149.stdout:Status: install ok installed 2023-06-22T16:11:37.817 INFO:teuthology.orchestra.run.smithi149.stdout:Priority: optional 2023-06-22T16:11:37.817 INFO:teuthology.orchestra.run.smithi149.stdout:Section: kernel 2023-06-22T16:11:37.817 INFO:teuthology.orchestra.run.smithi149.stdout:Installed-Size: 19 2023-06-22T16:11:37.817 INFO:teuthology.orchestra.run.smithi149.stdout:Maintainer: Ubuntu Kernel Team 2023-06-22T16:11:37.818 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: amd64 2023-06-22T16:11:37.818 INFO:teuthology.orchestra.run.smithi149.stdout:Source: linux-meta 2023-06-22T16:11:37.818 INFO:teuthology.orchestra.run.smithi149.stdout:Version: 5.4.0.152.149 2023-06-22T16:11:37.818 INFO:teuthology.orchestra.run.smithi149.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-06-22T16:11:37.818 INFO:teuthology.orchestra.run.smithi149.stdout:Depends: linux-image-5.4.0-152-generic, linux-modules-extra-5.4.0-152-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-22T16:11:37.818 INFO:teuthology.orchestra.run.smithi149.stdout:Recommends: thermald 2023-06-22T16:11:37.818 INFO:teuthology.orchestra.run.smithi149.stdout:Description: Generic Linux kernel image 2023-06-22T16:11:37.819 INFO:teuthology.orchestra.run.smithi149.stdout: This package will always depend on the latest generic kernel image 2023-06-22T16:11:37.819 INFO:teuthology.orchestra.run.smithi149.stdout: available. 2023-06-22T16:11:37.819 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-152-generic 2023-06-22T16:11:37.819 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-22T16:11:37.820 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-22T16:11:37.820 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-06-22T16:11:37.820 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=None, version=distro) 2023-06-22T16:11:37.820 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get clean 2023-06-22T16:11:37.828 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-152-generic 2023-06-22T16:11:37.829 DEBUG:teuthology.orchestra.run.smithi196:> sudo update-grub 2023-06-22T16:11:37.904 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get update 2023-06-22T16:11:38.163 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-22T16:11:38.163 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-22T16:11:38.234 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-22T16:11:38.320 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-22T16:11:39.142 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub' 2023-06-22T16:11:39.153 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-22T16:11:39.167 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2023-06-22T16:11:39.430 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.4.0-152-generic 2023-06-22T16:11:39.442 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.4.0-152-generic 2023-06-22T16:11:39.794 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-22T16:11:39.806 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-22T16:11:39.885 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-22T16:11:39.908 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-22T16:11:39.973 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-22T16:11:40.147 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2023-06-22T16:11:40.148 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2023-06-22T16:11:40.352 INFO:teuthology.orchestra.run.smithi149.stdout:linux-image-generic is already the newest version (5.4.0.152.149). 2023-06-22T16:11:40.353 INFO:teuthology.orchestra.run.smithi149.stdout:0 upgraded, 0 newly installed, 0 to remove and 223 not upgraded. 2023-06-22T16:11:40.354 DEBUG:teuthology.orchestra.run.smithi149:> dpkg -s linux-image-generic 2023-06-22T16:11:40.376 INFO:teuthology.orchestra.run.smithi149.stdout:Package: linux-image-generic 2023-06-22T16:11:40.376 INFO:teuthology.orchestra.run.smithi149.stdout:Status: install ok installed 2023-06-22T16:11:40.376 INFO:teuthology.orchestra.run.smithi149.stdout:Priority: optional 2023-06-22T16:11:40.376 INFO:teuthology.orchestra.run.smithi149.stdout:Section: kernel 2023-06-22T16:11:40.376 INFO:teuthology.orchestra.run.smithi149.stdout:Installed-Size: 19 2023-06-22T16:11:40.377 INFO:teuthology.orchestra.run.smithi149.stdout:Maintainer: Ubuntu Kernel Team 2023-06-22T16:11:40.377 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: amd64 2023-06-22T16:11:40.377 INFO:teuthology.orchestra.run.smithi149.stdout:Source: linux-meta 2023-06-22T16:11:40.377 INFO:teuthology.orchestra.run.smithi149.stdout:Version: 5.4.0.152.149 2023-06-22T16:11:40.377 INFO:teuthology.orchestra.run.smithi149.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-06-22T16:11:40.378 INFO:teuthology.orchestra.run.smithi149.stdout:Depends: linux-image-5.4.0-152-generic, linux-modules-extra-5.4.0-152-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-22T16:11:40.378 INFO:teuthology.orchestra.run.smithi149.stdout:Recommends: thermald 2023-06-22T16:11:40.378 INFO:teuthology.orchestra.run.smithi149.stdout:Description: Generic Linux kernel image 2023-06-22T16:11:40.378 INFO:teuthology.orchestra.run.smithi149.stdout: This package will always depend on the latest generic kernel image 2023-06-22T16:11:40.378 INFO:teuthology.orchestra.run.smithi149.stdout: available. 2023-06-22T16:11:40.378 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2023-06-22T16:11:40.422 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.CgnleGvYq6 2023-06-22T16:11:40.422 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub/grub.cfg /tmp/tmp.CgnleGvYq6 2023-06-22T16:11:40.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.CgnleGvYq6 2023-06-22T16:11:40.468 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.CgnleGvYq6 is 9KB 2023-06-22T16:11:40.480 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.CgnleGvYq6 2023-06-22T16:11:40.486 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-22T16:11:40.543 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:11:40.544 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-22T16:11:40.544 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-22T16:11:40.581 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-152-generic 2023-06-22T16:11:40.582 DEBUG:teuthology.orchestra.run.smithi149:> sudo update-grub 2023-06-22T16:11:41.445 INFO:teuthology.orchestra.run.smithi196.stderr:done 2023-06-22T16:11:41.447 DEBUG:teuthology.orchestra.run.smithi196:> sudo shutdown -r now 2023-06-22T16:11:41.893 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub' 2023-06-22T16:11:41.897 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-22T16:11:41.911 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2023-06-22T16:11:42.174 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.4.0-152-generic 2023-06-22T16:11:42.185 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.4.0-152-generic 2023-06-22T16:11:42.567 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-22T16:11:42.579 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-22T16:11:44.280 INFO:teuthology.orchestra.run.smithi149.stderr:done 2023-06-22T16:11:44.281 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2023-06-22T16:12:11.478 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-06-22T16:12:11.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-06-22T16:12:11.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T16:12:14.287 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-06-22T16:12:14.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-06-22T16:12:14.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T16:12:29.936 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-06-22T16:12:32.752 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-22T16:12:59.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-06-22T16:12:59.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T16:13:04.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-06-22T16:13:04.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T16:13:21.008 DEBUG:teuthology.orchestra.run.smithi196:> true 2023-06-22T16:13:22.008 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-06-22T16:13:22.008 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-152-generic"... 2023-06-22T16:13:22.009 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2023-06-22T16:13:22.015 INFO:teuthology.orchestra.run.smithi196.stdout:5.4.0-152-generic 2023-06-22T16:13:22.015 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-152-generic vs 5.4.0-152-generic 2023-06-22T16:13:22.015 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-22T16:13:22.015 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-22T16:13:23.016 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-06-22T16:13:23.017 DEBUG:teuthology.orchestra.run.smithi196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-22T16:13:23.179 INFO:teuthology.orchestra.run.smithi196.stdout:ttyS1 2023-06-22T16:13:23.212 DEBUG:teuthology.parallel:result is None 2023-06-22T16:13:26.256 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-22T16:13:56.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-06-22T16:13:56.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T16:14:01.479 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-06-22T16:14:02.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-06-22T16:14:02.108 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-152-generic"... 2023-06-22T16:14:02.108 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2023-06-22T16:14:02.114 INFO:teuthology.orchestra.run.smithi149.stdout:5.4.0-152-generic 2023-06-22T16:14:02.114 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-152-generic vs 5.4.0-152-generic 2023-06-22T16:14:02.115 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-22T16:14:02.115 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-22T16:14:03.116 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-06-22T16:14:03.116 DEBUG:teuthology.orchestra.run.smithi149:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-22T16:14:03.202 INFO:teuthology.orchestra.run.smithi149.stdout:ttyS1 2023-06-22T16:14:03.222 DEBUG:teuthology.parallel:result is None 2023-06-22T16:14:03.223 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-22T16:14:03.230 INFO:teuthology.task.internal:Creating test directory... 2023-06-22T16:14:03.230 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-22T16:14:03.232 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-22T16:14:03.239 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-22T16:14:03.246 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-22T16:14:03.257 INFO:teuthology.task.internal:Creating archive directory... 2023-06-22T16:14:03.257 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-22T16:14:03.259 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-22T16:14:03.281 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-22T16:14:03.294 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-22T16:14:03.295 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-22T16:14:03.321 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-22T16:14:03.336 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-22T16:14:03.345 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-22T16:14:03.347 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-22T16:14:03.358 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-22T16:14:03.360 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-22T16:14:03.368 INFO:teuthology.task.internal:Configuring sudo... 2023-06-22T16:14:03.368 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-22T16:14:03.370 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-22T16:14:03.384 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-22T16:14:03.394 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-22T16:14:03.394 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-22T16:14:03.396 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-22T16:14:03.401 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-22T16:14:03.446 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-22T16:14:03.453 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:14:03.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-22T16:14:03.473 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-22T16:14:03.480 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-22T16:14:03.487 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:14:03.487 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-22T16:14:03.509 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2023-06-22T16:14:03.511 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2023-06-22T16:14:03.561 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-22T16:14:03.569 INFO:teuthology.task.internal:Starting timer... 2023-06-22T16:14:03.569 INFO:teuthology.run_tasks:Running task pcp... 2023-06-22T16:14:03.579 INFO:teuthology.run_tasks:Running task selinux... 2023-06-22T16:14:03.597 DEBUG:teuthology.task.selinux:Excluding smithi149: OS 'ubuntu' does not support SELinux 2023-06-22T16:14:03.597 DEBUG:teuthology.task.selinux:Excluding smithi196: OS 'ubuntu' does not support SELinux 2023-06-22T16:14:03.598 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-22T16:14:03.598 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-06-22T16:14:03.598 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-22T16:14:03.598 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-22T16:14:03.615 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-06-22T16:14:03.622 INFO:teuthology.repo_utils:Fetching main from origin 2023-06-22T16:14:08.757 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-22T16:14:08.778 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-22T16:14:08.780 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi149.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-22T16:19:55.777 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi149.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2023-06-22T16:19:55.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-06-22T16:19:55.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T16:19:55.827 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-06-22T16:19:55.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-06-22T16:19:55.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T16:19:55.995 DEBUG:teuthology.orchestra.run.smithi196:> true 2023-06-22T16:19:56.114 INFO:teuthology.run_tasks:Running task clock... 2023-06-22T16:19:56.131 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-22T16:19:56.132 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-22T16:19:56.133 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-22T16:19:56.136 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-22T16:19:56.136 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-22T16:19:56.170 INFO:teuthology.orchestra.run.smithi149.stdout:22 Jun 16:19:56 ntpd[22285]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-06-22T16:19:56.171 INFO:teuthology.orchestra.run.smithi149.stdout:22 Jun 16:19:56 ntpd[22285]: Command line: ntpd -gq 2023-06-22T16:19:56.171 INFO:teuthology.orchestra.run.smithi149.stdout:22 Jun 16:19:56 ntpd[22285]: proto: precision = 0.145 usec (-23) 2023-06-22T16:19:56.172 INFO:teuthology.orchestra.run.smithi196.stdout:22 Jun 16:19:56 ntpd[22257]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-06-22T16:19:56.172 INFO:teuthology.orchestra.run.smithi196.stdout:22 Jun 16:19:56 ntpd[22257]: Command line: ntpd -gq 2023-06-22T16:19:56.172 INFO:teuthology.orchestra.run.smithi196.stdout:22 Jun 16:19:56 ntpd[22257]: proto: precision = 0.063 usec (-24) 2023-06-22T16:19:56.173 INFO:teuthology.orchestra.run.smithi149.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-22T16:19:56.173 INFO:teuthology.orchestra.run.smithi196.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-22T16:19:56.173 INFO:teuthology.orchestra.run.smithi149.stdout:22 Jun 16:19:56 ntpd[22285]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-22T16:19:56.174 INFO:teuthology.orchestra.run.smithi196.stdout:22 Jun 16:19:56 ntpd[22257]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-22T16:19:56.174 INFO:teuthology.orchestra.run.smithi149.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-22T16:19:56.174 INFO:teuthology.orchestra.run.smithi196.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-22T16:19:56.176 INFO:teuthology.orchestra.run.smithi149.stdout:22 Jun 16:19:56 ntpd[22285]: restrict ::: KOD does nothing without LIMITED. 2023-06-22T16:19:56.176 INFO:teuthology.orchestra.run.smithi149.stdout:22 Jun 16:19:56 ntpd[22285]: Listen and drop on 0 v6wildcard [::]:123 2023-06-22T16:19:56.176 INFO:teuthology.orchestra.run.smithi149.stdout:22 Jun 16:19:56 ntpd[22285]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-22T16:19:56.176 INFO:teuthology.orchestra.run.smithi149.stdout:22 Jun 16:19:56 ntpd[22285]: Listen normally on 2 lo 127.0.0.1:123 2023-06-22T16:19:56.177 INFO:teuthology.orchestra.run.smithi149.stdout:22 Jun 16:19:56 ntpd[22285]: Listen normally on 3 enp3s0f1 172.21.15.149:123 2023-06-22T16:19:56.177 INFO:teuthology.orchestra.run.smithi149.stdout:22 Jun 16:19:56 ntpd[22285]: Listen normally on 4 lo [::1]:123 2023-06-22T16:19:56.177 INFO:teuthology.orchestra.run.smithi149.stdout:22 Jun 16:19:56 ntpd[22285]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7d57%5]:123 2023-06-22T16:19:56.177 INFO:teuthology.orchestra.run.smithi149.stdout:22 Jun 16:19:56 ntpd[22285]: Listening on routing socket on fd #22 for interface updates 2023-06-22T16:19:56.177 INFO:teuthology.orchestra.run.smithi196.stdout:22 Jun 16:19:56 ntpd[22257]: restrict ::: KOD does nothing without LIMITED. 2023-06-22T16:19:56.177 INFO:teuthology.orchestra.run.smithi196.stdout:22 Jun 16:19:56 ntpd[22257]: Listen and drop on 0 v6wildcard [::]:123 2023-06-22T16:19:56.178 INFO:teuthology.orchestra.run.smithi196.stdout:22 Jun 16:19:56 ntpd[22257]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-22T16:19:56.178 INFO:teuthology.orchestra.run.smithi196.stdout:22 Jun 16:19:56 ntpd[22257]: Listen normally on 2 lo 127.0.0.1:123 2023-06-22T16:19:56.178 INFO:teuthology.orchestra.run.smithi196.stdout:22 Jun 16:19:56 ntpd[22257]: Listen normally on 3 enp3s0f1 172.21.15.196:123 2023-06-22T16:19:56.178 INFO:teuthology.orchestra.run.smithi196.stdout:22 Jun 16:19:56 ntpd[22257]: Listen normally on 4 lo [::1]:123 2023-06-22T16:19:56.178 INFO:teuthology.orchestra.run.smithi196.stdout:22 Jun 16:19:56 ntpd[22257]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f47%5]:123 2023-06-22T16:19:56.178 INFO:teuthology.orchestra.run.smithi196.stdout:22 Jun 16:19:56 ntpd[22257]: Listening on routing socket on fd #22 for interface updates 2023-06-22T16:19:57.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:57 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:57.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:57 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:57.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:57 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:57.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:57 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:57.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:57 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:57.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:57 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:57.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:57 ntpd[22285]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:19:57.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:57 ntpd[22285]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:19:57.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:57 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:57.174 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:57 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:57.174 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:57 ntpd[22285]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:19:57.174 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:57 ntpd[22285]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:19:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:58.172 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:58.173 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:58.173 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:58.173 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:58.173 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:58.173 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:58.173 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:58.173 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:19:58.174 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:19:58.174 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:58.174 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:58.174 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:19:58.174 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:19:58 ntpd[22257]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:19:59.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:59.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:59.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:59.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:59.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:59.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:59.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:59.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:59.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:19:59.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:19:59.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:19:59.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:19:59.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:19:59.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:19:59 ntpd[22285]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:20:00.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:00 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:00.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:00 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:00.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:00 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:00.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:00 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:00.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:00 ntpd[22285]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:20:00.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:00 ntpd[22285]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:20:00.174 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:00.174 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:00.174 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:00.174 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:00.175 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:00.176 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:00.176 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:00.176 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:00.176 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:20:00.177 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:20:00.177 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:00.177 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:00.178 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:20:00.178 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:20:00.178 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:00.179 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:00.179 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:20:00.179 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:00 ntpd[22257]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:20:01.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:01 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:01.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:01 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:01.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:01 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:01.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:01 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:01.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:01 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:01.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:01 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:01.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:01 ntpd[22285]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:20:01.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:01 ntpd[22285]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:20:01.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:01 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:01.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:01 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:01.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:01 ntpd[22285]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:20:01.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:01 ntpd[22285]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:20:02.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:02 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:02.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:02 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:02.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:02 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:02.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:02 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:02.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:02 ntpd[22285]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:20:02.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:02 ntpd[22285]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:20:02.175 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:02.175 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:02.175 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:02.175 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:02.176 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:02.176 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:02.176 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:02.177 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:02.177 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:20:02.177 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:20:02.177 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:02.178 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:02.178 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:20:02.178 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:20:02.178 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:02.179 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:02.180 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:20:02.180 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:02 ntpd[22257]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:20:03.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:03 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:03.171 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:03 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:03.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:03 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:03.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:03 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:03.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:03 ntpd[22285]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:03.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:03 ntpd[22285]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:03.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:03 ntpd[22285]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:20:03.172 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:03 ntpd[22285]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:20:03.173 INFO:teuthology.orchestra.run.smithi149.stdout:22 Jun 16:20:03 ntpd[22285]: ntpd: time slew +0.000400 s 2023-06-22T16:20:03.173 INFO:teuthology.orchestra.run.smithi149.stdout:ntpd: time slew +0.000400s 2023-06-22T16:20:03.173 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:03 ntpd[22285]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-22T16:20:03.174 INFO:teuthology.orchestra.run.smithi149.stderr:22 Jun 16:20:03 ntpd[22285]: can't open /var/log/ntpstats/loopstats.20230622: Permission denied 2023-06-22T16:20:03.252 INFO:teuthology.orchestra.run.smithi149.stdout: remote refid st t when poll reach delay offset jitter 2023-06-22T16:20:03.253 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================== 2023-06-22T16:20:03.253 INFO:teuthology.orchestra.run.smithi149.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-22T16:20:03.253 INFO:teuthology.orchestra.run.smithi149.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-22T16:20:03.253 INFO:teuthology.orchestra.run.smithi149.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-22T16:20:03.253 INFO:teuthology.orchestra.run.smithi149.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-22T16:20:04.172 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:04 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:04.173 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:04 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:04.173 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:04 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:04.173 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:04 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:04.173 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:04 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:04.174 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:04 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:04.174 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:04 ntpd[22257]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-22T16:20:04.174 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:04 ntpd[22257]: can't open /var/log/ntpstats/rawstats.20230622: Permission denied 2023-06-22T16:20:04.174 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:04 ntpd[22257]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-22T16:20:04.175 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:04 ntpd[22257]: can't open /var/log/ntpstats/peerstats.20230622: Permission denied 2023-06-22T16:20:04.175 INFO:teuthology.orchestra.run.smithi196.stdout:22 Jun 16:20:04 ntpd[22257]: ntpd: time slew -0.000636 s 2023-06-22T16:20:04.176 INFO:teuthology.orchestra.run.smithi196.stdout:ntpd: time slew -0.000636s 2023-06-22T16:20:04.176 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:04 ntpd[22257]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-22T16:20:04.177 INFO:teuthology.orchestra.run.smithi196.stderr:22 Jun 16:20:04 ntpd[22257]: can't open /var/log/ntpstats/loopstats.20230622: Permission denied 2023-06-22T16:20:04.243 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2023-06-22T16:20:04.244 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2023-06-22T16:20:04.244 INFO:teuthology.orchestra.run.smithi196.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-22T16:20:04.244 INFO:teuthology.orchestra.run.smithi196.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-22T16:20:04.244 INFO:teuthology.orchestra.run.smithi196.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-22T16:20:04.244 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-22T16:20:04.245 INFO:teuthology.run_tasks:Running task install... 2023-06-22T16:20:04.257 DEBUG:teuthology.task.install:project ceph 2023-06-22T16:20:04.258 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}} 2023-06-22T16:20:04.258 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'} 2023-06-22T16:20:04.258 INFO:teuthology.task.install:Using flavor: default 2023-06-22T16:20:04.269 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-22T16:20:04.270 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-22T16:20:04.271 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-key list | grep Ceph 2023-06-22T16:20:04.271 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-key list | grep Ceph 2023-06-22T16:20:04.374 INFO:teuthology.orchestra.run.smithi149.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-06-22T16:20:04.385 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-06-22T16:20:04.433 INFO:teuthology.orchestra.run.smithi149.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-22T16:20:04.434 INFO:teuthology.orchestra.run.smithi149.stdout:uid [ unknown] Ceph.com (release key) 2023-06-22T16:20:04.435 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-22T16:20:04.436 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-06-22T16:20:04.436 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-22T16:20:04.446 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-22T16:20:04.446 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph.com (release key) 2023-06-22T16:20:04.447 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-22T16:20:04.447 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-06-22T16:20:04.447 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-22T16:20:04.586 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default/ 2023-06-22T16:20:04.586 INFO:teuthology.task.install.deb:Package version is 17.2.6-719-g42ddc46e-1focal 2023-06-22T16:20:04.713 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default/ 2023-06-22T16:20:04.714 INFO:teuthology.task.install.deb:Package version is 17.2.6-719-g42ddc46e-1focal 2023-06-22T16:20:04.767 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:20:04.768 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-22T16:20:04.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get update 2023-06-22T16:20:04.882 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:20:04.882 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-22T16:20:04.899 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2023-06-22T16:20:04.944 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-22T16:20:05.058 INFO:teuthology.orchestra.run.smithi149.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal InRelease 2023-06-22T16:20:05.062 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-22T16:20:05.105 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-06-22T16:20:05.144 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-22T16:20:05.155 INFO:teuthology.orchestra.run.smithi149.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal Release.gpg 2023-06-22T16:20:05.192 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main i386 Packages [3,385 B] 2023-06-22T16:20:05.217 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-22T16:20:05.218 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-22T16:20:05.229 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal InRelease 2023-06-22T16:20:05.231 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-22T16:20:05.254 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-06-22T16:20:05.267 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-06-22T16:20:05.287 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-22T16:20:05.302 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal Release.gpg 2023-06-22T16:20:05.339 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-06-22T16:20:05.372 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-22T16:20:05.399 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main i386 Packages [3,385 B] 2023-06-22T16:20:05.590 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 28.4 kB in 1s (44.0 kB/s) 2023-06-22T16:20:05.878 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 28.4 kB in 1s (37.1 kB/s) 2023-06-22T16:20:06.592 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-22T16:20:06.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-719-g42ddc46e-1focal cephadm=17.2.6-719-g42ddc46e-1focal ceph-mds=17.2.6-719-g42ddc46e-1focal ceph-mgr=17.2.6-719-g42ddc46e-1focal ceph-common=17.2.6-719-g42ddc46e-1focal ceph-fuse=17.2.6-719-g42ddc46e-1focal ceph-test=17.2.6-719-g42ddc46e-1focal ceph-volume=17.2.6-719-g42ddc46e-1focal radosgw=17.2.6-719-g42ddc46e-1focal python3-rados=17.2.6-719-g42ddc46e-1focal python3-rgw=17.2.6-719-g42ddc46e-1focal python3-cephfs=17.2.6-719-g42ddc46e-1focal python3-rbd=17.2.6-719-g42ddc46e-1focal libcephfs2=17.2.6-719-g42ddc46e-1focal libcephfs-dev=17.2.6-719-g42ddc46e-1focal librados2=17.2.6-719-g42ddc46e-1focal librbd1=17.2.6-719-g42ddc46e-1focal rbd-fuse=17.2.6-719-g42ddc46e-1focal python3-cephfs=17.2.6-719-g42ddc46e-1focal cephfs-shell=17.2.6-719-g42ddc46e-1focal cephfs-top=17.2.6-719-g42ddc46e-1focal cephfs-mirror=17.2.6-719-g42ddc46e-1focal 2023-06-22T16:20:06.685 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-22T16:20:06.859 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2023-06-22T16:20:06.859 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2023-06-22T16:20:06.869 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2023-06-22T16:20:06.894 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-719-g42ddc46e-1focal cephadm=17.2.6-719-g42ddc46e-1focal ceph-mds=17.2.6-719-g42ddc46e-1focal ceph-mgr=17.2.6-719-g42ddc46e-1focal ceph-common=17.2.6-719-g42ddc46e-1focal ceph-fuse=17.2.6-719-g42ddc46e-1focal ceph-test=17.2.6-719-g42ddc46e-1focal ceph-volume=17.2.6-719-g42ddc46e-1focal radosgw=17.2.6-719-g42ddc46e-1focal python3-rados=17.2.6-719-g42ddc46e-1focal python3-rgw=17.2.6-719-g42ddc46e-1focal python3-cephfs=17.2.6-719-g42ddc46e-1focal python3-rbd=17.2.6-719-g42ddc46e-1focal libcephfs2=17.2.6-719-g42ddc46e-1focal libcephfs-dev=17.2.6-719-g42ddc46e-1focal librados2=17.2.6-719-g42ddc46e-1focal librbd1=17.2.6-719-g42ddc46e-1focal rbd-fuse=17.2.6-719-g42ddc46e-1focal python3-cephfs=17.2.6-719-g42ddc46e-1focal cephfs-shell=17.2.6-719-g42ddc46e-1focal cephfs-top=17.2.6-719-g42ddc46e-1focal cephfs-mirror=17.2.6-719-g42ddc46e-1focal 2023-06-22T16:20:06.965 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2023-06-22T16:20:07.023 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages were automatically installed and are no longer required: 2023-06-22T16:20:07.024 INFO:teuthology.orchestra.run.smithi149.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-22T16:20:07.024 INFO:teuthology.orchestra.run.smithi149.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-22T16:20:07.024 INFO:teuthology.orchestra.run.smithi149.stdout:The following additional packages will be installed: 2023-06-22T16:20:07.024 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-22T16:20:07.025 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-06-22T16:20:07.025 INFO:teuthology.orchestra.run.smithi149.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-06-22T16:20:07.025 INFO:teuthology.orchestra.run.smithi149.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-06-22T16:20:07.025 INFO:teuthology.orchestra.run.smithi149.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-06-22T16:20:07.026 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-06-22T16:20:07.026 INFO:teuthology.orchestra.run.smithi149.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-06-22T16:20:07.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-06-22T16:20:07.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-06-22T16:20:07.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-06-22T16:20:07.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-06-22T16:20:07.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-22T16:20:07.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-22T16:20:07.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-22T16:20:07.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-22T16:20:07.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-22T16:20:07.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-06-22T16:20:07.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-06-22T16:20:07.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-22T16:20:07.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-22T16:20:07.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-22T16:20:07.028 INFO:teuthology.orchestra.run.smithi149.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-22T16:20:07.031 INFO:teuthology.orchestra.run.smithi149.stdout:Suggested packages: 2023-06-22T16:20:07.032 INFO:teuthology.orchestra.run.smithi149.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-06-22T16:20:07.032 INFO:teuthology.orchestra.run.smithi149.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-06-22T16:20:07.032 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-06-22T16:20:07.032 INFO:teuthology.orchestra.run.smithi149.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-06-22T16:20:07.033 INFO:teuthology.orchestra.run.smithi149.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-06-22T16:20:07.033 INFO:teuthology.orchestra.run.smithi149.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-06-22T16:20:07.034 INFO:teuthology.orchestra.run.smithi149.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-06-22T16:20:07.034 INFO:teuthology.orchestra.run.smithi149.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-06-22T16:20:07.034 INFO:teuthology.orchestra.run.smithi149.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-06-22T16:20:07.035 INFO:teuthology.orchestra.run.smithi149.stdout:Recommended packages: 2023-06-22T16:20:07.035 INFO:teuthology.orchestra.run.smithi149.stdout: btrfs-tools 2023-06-22T16:20:07.150 INFO:teuthology.orchestra.run.smithi149.stdout:The following NEW packages will be installed: 2023-06-22T16:20:07.151 INFO:teuthology.orchestra.run.smithi149.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-22T16:20:07.151 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-22T16:20:07.151 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-22T16:20:07.151 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-06-22T16:20:07.151 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-06-22T16:20:07.151 INFO:teuthology.orchestra.run.smithi149.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-06-22T16:20:07.152 INFO:teuthology.orchestra.run.smithi149.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-06-22T16:20:07.153 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-06-22T16:20:07.153 INFO:teuthology.orchestra.run.smithi149.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-06-22T16:20:07.153 INFO:teuthology.orchestra.run.smithi149.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-06-22T16:20:07.153 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-06-22T16:20:07.154 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-06-22T16:20:07.154 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-06-22T16:20:07.154 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-22T16:20:07.154 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-22T16:20:07.154 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-22T16:20:07.154 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-22T16:20:07.154 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-22T16:20:07.154 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-06-22T16:20:07.155 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-22T16:20:07.155 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-22T16:20:07.155 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-22T16:20:07.155 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-22T16:20:07.155 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-22T16:20:07.155 INFO:teuthology.orchestra.run.smithi149.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-06-22T16:20:07.155 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages will be upgraded: 2023-06-22T16:20:07.156 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 librbd1 2023-06-22T16:20:07.159 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2023-06-22T16:20:07.159 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2023-06-22T16:20:07.217 INFO:teuthology.orchestra.run.smithi149.stdout:2 upgraded, 114 newly installed, 0 to remove and 205 not upgraded. 2023-06-22T16:20:07.217 INFO:teuthology.orchestra.run.smithi149.stdout:Need to get 209 MB of archives. 2023-06-22T16:20:07.218 INFO:teuthology.orchestra.run.smithi149.stdout:After this operation, 981 MB of additional disk space will be used. 2023-06-22T16:20:07.218 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-06-22T16:20:07.237 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-06-22T16:20:07.244 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-06-22T16:20:07.269 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-06-22T16:20:07.299 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-06-22T16:20:07.301 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-06-22T16:20:07.302 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-719-g42ddc46e-1focal [3,504 kB] 2023-06-22T16:20:07.310 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-06-22T16:20:07.312 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-06-22T16:20:07.328 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2023-06-22T16:20:07.329 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-22T16:20:07.329 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-22T16:20:07.329 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2023-06-22T16:20:07.329 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-22T16:20:07.330 INFO:teuthology.orchestra.run.smithi149.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-06-22T16:20:07.330 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-06-22T16:20:07.330 INFO:teuthology.orchestra.run.smithi196.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-06-22T16:20:07.331 INFO:teuthology.orchestra.run.smithi196.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-06-22T16:20:07.331 INFO:teuthology.orchestra.run.smithi196.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-06-22T16:20:07.331 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-06-22T16:20:07.331 INFO:teuthology.orchestra.run.smithi196.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-06-22T16:20:07.331 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-06-22T16:20:07.332 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-06-22T16:20:07.332 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-06-22T16:20:07.333 INFO:teuthology.orchestra.run.smithi196.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-06-22T16:20:07.333 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-22T16:20:07.333 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-22T16:20:07.333 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-22T16:20:07.334 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-22T16:20:07.334 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-22T16:20:07.334 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-06-22T16:20:07.334 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-06-22T16:20:07.335 INFO:teuthology.orchestra.run.smithi196.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-22T16:20:07.335 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-22T16:20:07.335 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-22T16:20:07.336 INFO:teuthology.orchestra.run.smithi196.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-22T16:20:07.337 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2023-06-22T16:20:07.337 INFO:teuthology.orchestra.run.smithi196.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-06-22T16:20:07.337 INFO:teuthology.orchestra.run.smithi196.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-06-22T16:20:07.337 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-06-22T16:20:07.338 INFO:teuthology.orchestra.run.smithi196.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-06-22T16:20:07.338 INFO:teuthology.orchestra.run.smithi196.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-06-22T16:20:07.338 INFO:teuthology.orchestra.run.smithi196.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-06-22T16:20:07.339 INFO:teuthology.orchestra.run.smithi196.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-06-22T16:20:07.339 INFO:teuthology.orchestra.run.smithi196.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-06-22T16:20:07.339 INFO:teuthology.orchestra.run.smithi196.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-06-22T16:20:07.339 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2023-06-22T16:20:07.340 INFO:teuthology.orchestra.run.smithi196.stdout: btrfs-tools 2023-06-22T16:20:07.340 INFO:teuthology.orchestra.run.smithi149.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-06-22T16:20:07.340 INFO:teuthology.orchestra.run.smithi149.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-06-22T16:20:07.397 INFO:teuthology.orchestra.run.smithi149.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-06-22T16:20:07.454 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2023-06-22T16:20:07.455 INFO:teuthology.orchestra.run.smithi196.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-22T16:20:07.455 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-22T16:20:07.455 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-22T16:20:07.455 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-06-22T16:20:07.456 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-06-22T16:20:07.456 INFO:teuthology.orchestra.run.smithi196.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-06-22T16:20:07.456 INFO:teuthology.orchestra.run.smithi196.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-06-22T16:20:07.458 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-06-22T16:20:07.458 INFO:teuthology.orchestra.run.smithi196.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-06-22T16:20:07.459 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-06-22T16:20:07.459 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-06-22T16:20:07.459 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-06-22T16:20:07.460 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-06-22T16:20:07.460 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-22T16:20:07.460 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-22T16:20:07.460 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-22T16:20:07.461 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-22T16:20:07.461 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-22T16:20:07.461 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-06-22T16:20:07.462 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-22T16:20:07.462 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-22T16:20:07.462 INFO:teuthology.orchestra.run.smithi196.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-22T16:20:07.462 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-22T16:20:07.463 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-22T16:20:07.463 INFO:teuthology.orchestra.run.smithi196.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-06-22T16:20:07.463 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages will be upgraded: 2023-06-22T16:20:07.464 INFO:teuthology.orchestra.run.smithi196.stdout: librados2 librbd1 2023-06-22T16:20:07.488 INFO:teuthology.orchestra.run.smithi149.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-06-22T16:20:07.506 INFO:teuthology.orchestra.run.smithi149.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-719-g42ddc46e-1focal [3,559 kB] 2023-06-22T16:20:07.527 INFO:teuthology.orchestra.run.smithi149.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-06-22T16:20:07.532 INFO:teuthology.orchestra.run.smithi149.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-06-22T16:20:07.534 INFO:teuthology.orchestra.run.smithi149.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-06-22T16:20:07.539 INFO:teuthology.orchestra.run.smithi149.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-06-22T16:20:07.540 INFO:teuthology.orchestra.run.smithi149.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-06-22T16:20:07.541 INFO:teuthology.orchestra.run.smithi149.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-06-22T16:20:07.544 INFO:teuthology.orchestra.run.smithi149.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-06-22T16:20:07.544 INFO:teuthology.orchestra.run.smithi149.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-06-22T16:20:07.545 INFO:teuthology.orchestra.run.smithi149.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-06-22T16:20:07.580 INFO:teuthology.orchestra.run.smithi149.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-06-22T16:20:07.615 INFO:teuthology.orchestra.run.smithi149.stdout:Get:26 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-719-g42ddc46e-1focal [757 kB] 2023-06-22T16:20:07.615 INFO:teuthology.orchestra.run.smithi149.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-06-22T16:20:07.639 INFO:teuthology.orchestra.run.smithi149.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-719-g42ddc46e-1focal [414 kB] 2023-06-22T16:20:07.644 INFO:teuthology.orchestra.run.smithi149.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-22T16:20:07.648 INFO:teuthology.orchestra.run.smithi149.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-06-22T16:20:07.649 INFO:teuthology.orchestra.run.smithi196.stdout:2 upgraded, 114 newly installed, 0 to remove and 205 not upgraded. 2023-06-22T16:20:07.650 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 209 MB of archives. 2023-06-22T16:20:07.650 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 981 MB of additional disk space will be used. 2023-06-22T16:20:07.650 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-06-22T16:20:07.651 INFO:teuthology.orchestra.run.smithi149.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-06-22T16:20:07.653 INFO:teuthology.orchestra.run.smithi149.stdout:Get:32 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-719-g42ddc46e-1focal [22.5 kB] 2023-06-22T16:20:07.653 INFO:teuthology.orchestra.run.smithi149.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-719-g42ddc46e-1focal [200 kB] 2023-06-22T16:20:07.660 INFO:teuthology.orchestra.run.smithi149.stdout:Get:34 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-719-g42ddc46e-1focal [47.1 kB] 2023-06-22T16:20:07.662 INFO:teuthology.orchestra.run.smithi149.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-719-g42ddc46e-1focal [384 kB] 2023-06-22T16:20:07.666 INFO:teuthology.orchestra.run.smithi149.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-06-22T16:20:07.670 INFO:teuthology.orchestra.run.smithi149.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-06-22T16:20:07.674 INFO:teuthology.orchestra.run.smithi149.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-719-g42ddc46e-1focal [5,565 kB] 2023-06-22T16:20:07.679 INFO:teuthology.orchestra.run.smithi149.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-06-22T16:20:07.686 INFO:teuthology.orchestra.run.smithi149.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-06-22T16:20:07.686 INFO:teuthology.orchestra.run.smithi149.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-06-22T16:20:07.707 INFO:teuthology.orchestra.run.smithi149.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-06-22T16:20:07.733 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-06-22T16:20:07.742 INFO:teuthology.orchestra.run.smithi149.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-06-22T16:20:07.767 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-06-22T16:20:07.783 INFO:teuthology.orchestra.run.smithi149.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-06-22T16:20:07.795 INFO:teuthology.orchestra.run.smithi149.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-06-22T16:20:07.797 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-719-g42ddc46e-1focal [3,504 kB] 2023-06-22T16:20:07.819 INFO:teuthology.orchestra.run.smithi149.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-06-22T16:20:07.842 INFO:teuthology.orchestra.run.smithi149.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-06-22T16:20:07.846 INFO:teuthology.orchestra.run.smithi149.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-22T16:20:07.847 INFO:teuthology.orchestra.run.smithi149.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-06-22T16:20:07.852 INFO:teuthology.orchestra.run.smithi149.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-06-22T16:20:07.856 INFO:teuthology.orchestra.run.smithi149.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-06-22T16:20:07.860 INFO:teuthology.orchestra.run.smithi149.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-06-22T16:20:07.860 INFO:teuthology.orchestra.run.smithi149.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-719-g42ddc46e-1focal [116 kB] 2023-06-22T16:20:07.861 INFO:teuthology.orchestra.run.smithi149.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-06-22T16:20:07.863 INFO:teuthology.orchestra.run.smithi149.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-719-g42ddc46e-1focal [479 kB] 2023-06-22T16:20:07.879 INFO:teuthology.orchestra.run.smithi149.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-719-g42ddc46e-1focal [27.3 MB] 2023-06-22T16:20:07.891 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-06-22T16:20:07.895 INFO:teuthology.orchestra.run.smithi149.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-06-22T16:20:08.029 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-06-22T16:20:08.038 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-06-22T16:20:08.084 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-06-22T16:20:08.095 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-06-22T16:20:08.106 INFO:teuthology.orchestra.run.smithi149.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-06-22T16:20:08.127 INFO:teuthology.orchestra.run.smithi149.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-06-22T16:20:08.128 INFO:teuthology.orchestra.run.smithi149.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-06-22T16:20:08.141 INFO:teuthology.orchestra.run.smithi149.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-06-22T16:20:08.141 INFO:teuthology.orchestra.run.smithi149.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-06-22T16:20:08.142 INFO:teuthology.orchestra.run.smithi149.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-06-22T16:20:08.143 INFO:teuthology.orchestra.run.smithi149.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-06-22T16:20:08.143 INFO:teuthology.orchestra.run.smithi149.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-06-22T16:20:08.143 INFO:teuthology.orchestra.run.smithi149.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-06-22T16:20:08.175 INFO:teuthology.orchestra.run.smithi149.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-06-22T16:20:08.180 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-06-22T16:20:08.182 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-06-22T16:20:08.205 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-06-22T16:20:08.210 INFO:teuthology.orchestra.run.smithi149.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-06-22T16:20:08.246 INFO:teuthology.orchestra.run.smithi149.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-06-22T16:20:08.263 INFO:teuthology.orchestra.run.smithi149.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-06-22T16:20:08.312 INFO:teuthology.orchestra.run.smithi149.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-06-22T16:20:08.321 INFO:teuthology.orchestra.run.smithi149.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-06-22T16:20:08.328 INFO:teuthology.orchestra.run.smithi149.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-06-22T16:20:08.330 INFO:teuthology.orchestra.run.smithi149.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-06-22T16:20:08.340 INFO:teuthology.orchestra.run.smithi149.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-06-22T16:20:08.346 INFO:teuthology.orchestra.run.smithi149.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-06-22T16:20:08.347 INFO:teuthology.orchestra.run.smithi149.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-06-22T16:20:08.372 INFO:teuthology.orchestra.run.smithi149.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-06-22T16:20:08.411 INFO:teuthology.orchestra.run.smithi149.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-06-22T16:20:08.494 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-06-22T16:20:08.595 INFO:teuthology.orchestra.run.smithi149.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-06-22T16:20:08.596 INFO:teuthology.orchestra.run.smithi149.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-06-22T16:20:08.596 INFO:teuthology.orchestra.run.smithi149.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-06-22T16:20:08.596 INFO:teuthology.orchestra.run.smithi149.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-06-22T16:20:08.597 INFO:teuthology.orchestra.run.smithi149.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-06-22T16:20:08.598 INFO:teuthology.orchestra.run.smithi149.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-06-22T16:20:08.613 INFO:teuthology.orchestra.run.smithi149.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-06-22T16:20:08.613 INFO:teuthology.orchestra.run.smithi149.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-22T16:20:08.614 INFO:teuthology.orchestra.run.smithi149.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-06-22T16:20:08.614 INFO:teuthology.orchestra.run.smithi149.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-06-22T16:20:08.649 INFO:teuthology.orchestra.run.smithi149.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-06-22T16:20:08.709 INFO:teuthology.orchestra.run.smithi149.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-06-22T16:20:08.714 INFO:teuthology.orchestra.run.smithi149.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-06-22T16:20:08.746 INFO:teuthology.orchestra.run.smithi149.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-06-22T16:20:08.749 INFO:teuthology.orchestra.run.smithi149.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-06-22T16:20:08.925 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-06-22T16:20:08.956 INFO:teuthology.orchestra.run.smithi149.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-719-g42ddc46e-1focal [6,447 kB] 2023-06-22T16:20:09.054 INFO:teuthology.orchestra.run.smithi149.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-719-g42ddc46e-1focal [221 kB] 2023-06-22T16:20:09.060 INFO:teuthology.orchestra.run.smithi149.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-719-g42ddc46e-1focal [152 kB] 2023-06-22T16:20:09.067 INFO:teuthology.orchestra.run.smithi149.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-719-g42ddc46e-1focal [1,588 kB] 2023-06-22T16:20:09.107 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-06-22T16:20:09.121 INFO:teuthology.orchestra.run.smithi149.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-719-g42ddc46e-1focal [7,843 kB] 2023-06-22T16:20:09.139 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-06-22T16:20:09.145 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-06-22T16:20:09.170 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-06-22T16:20:09.174 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-06-22T16:20:09.177 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-06-22T16:20:09.190 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-06-22T16:20:09.192 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-06-22T16:20:09.193 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-06-22T16:20:09.358 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-06-22T16:20:09.393 INFO:teuthology.orchestra.run.smithi149.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-719-g42ddc46e-1focal [28.7 MB] 2023-06-22T16:20:09.522 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-06-22T16:20:09.663 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-22T16:20:09.682 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-06-22T16:20:09.693 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-06-22T16:20:09.769 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-06-22T16:20:09.793 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-06-22T16:20:09.832 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-06-22T16:20:09.861 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-06-22T16:20:09.865 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-06-22T16:20:09.961 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-06-22T16:20:10.124 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-06-22T16:20:10.309 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-06-22T16:20:10.358 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-06-22T16:20:10.490 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-06-22T16:20:10.504 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-719-g42ddc46e-1focal [3,559 kB] 2023-06-22T16:20:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-719-g42ddc46e-1focal [3,920 B] 2023-06-22T16:20:10.535 INFO:teuthology.orchestra.run.smithi149.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-719-g42ddc46e-1focal [867 kB] 2023-06-22T16:20:10.549 INFO:teuthology.orchestra.run.smithi149.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-719-g42ddc46e-1focal [2,399 kB] 2023-06-22T16:20:10.566 INFO:teuthology.orchestra.run.smithi149.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-719-g42ddc46e-1focal [78.9 kB] 2023-06-22T16:20:10.567 INFO:teuthology.orchestra.run.smithi149.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-719-g42ddc46e-1focal [117 kB] 2023-06-22T16:20:10.568 INFO:teuthology.orchestra.run.smithi149.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-719-g42ddc46e-1focal [1,759 kB] 2023-06-22T16:20:10.590 INFO:teuthology.orchestra.run.smithi149.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-719-g42ddc46e-1focal [7,886 kB] 2023-06-22T16:20:10.594 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-06-22T16:20:10.624 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-22T16:20:10.627 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-06-22T16:20:10.652 INFO:teuthology.orchestra.run.smithi196.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-06-22T16:20:10.673 INFO:teuthology.orchestra.run.smithi196.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-06-22T16:20:10.689 INFO:teuthology.orchestra.run.smithi196.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-06-22T16:20:10.691 INFO:teuthology.orchestra.run.smithi196.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-06-22T16:20:10.859 INFO:teuthology.orchestra.run.smithi196.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-06-22T16:20:10.863 INFO:teuthology.orchestra.run.smithi149.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-719-g42ddc46e-1focal [4,036 B] 2023-06-22T16:20:10.863 INFO:teuthology.orchestra.run.smithi149.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-719-g42ddc46e-1focal [56.2 MB] 2023-06-22T16:20:11.840 INFO:teuthology.orchestra.run.smithi196.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-06-22T16:20:11.862 INFO:teuthology.orchestra.run.smithi196.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-06-22T16:20:11.864 INFO:teuthology.orchestra.run.smithi196.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-06-22T16:20:11.940 INFO:teuthology.orchestra.run.smithi196.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-06-22T16:20:11.940 INFO:teuthology.orchestra.run.smithi196.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-06-22T16:20:11.941 INFO:teuthology.orchestra.run.smithi196.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-06-22T16:20:11.941 INFO:teuthology.orchestra.run.smithi196.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-06-22T16:20:11.941 INFO:teuthology.orchestra.run.smithi196.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-06-22T16:20:11.942 INFO:teuthology.orchestra.run.smithi196.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-06-22T16:20:11.942 INFO:teuthology.orchestra.run.smithi196.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-06-22T16:20:12.107 INFO:teuthology.orchestra.run.smithi196.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-06-22T16:20:12.273 INFO:teuthology.orchestra.run.smithi196.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-06-22T16:20:12.355 INFO:teuthology.orchestra.run.smithi196.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-06-22T16:20:12.588 INFO:teuthology.orchestra.run.smithi196.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-06-22T16:20:12.632 INFO:teuthology.orchestra.run.smithi196.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-06-22T16:20:12.662 INFO:teuthology.orchestra.run.smithi196.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-06-22T16:20:12.672 INFO:teuthology.orchestra.run.smithi196.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-06-22T16:20:12.720 INFO:teuthology.orchestra.run.smithi196.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-06-22T16:20:12.748 INFO:teuthology.orchestra.run.smithi196.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-06-22T16:20:12.751 INFO:teuthology.orchestra.run.smithi196.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-06-22T16:20:12.872 INFO:teuthology.orchestra.run.smithi196.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-06-22T16:20:12.873 INFO:teuthology.orchestra.run.smithi196.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-719-g42ddc46e-1focal [757 kB] 2023-06-22T16:20:13.045 INFO:teuthology.orchestra.run.smithi196.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-06-22T16:20:13.113 INFO:teuthology.orchestra.run.smithi149.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-719-g42ddc46e-1focal [226 kB] 2023-06-22T16:20:13.117 INFO:teuthology.orchestra.run.smithi196.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-719-g42ddc46e-1focal [414 kB] 2023-06-22T16:20:13.117 INFO:teuthology.orchestra.run.smithi149.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-719-g42ddc46e-1focal [238 kB] 2023-06-22T16:20:13.122 INFO:teuthology.orchestra.run.smithi149.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-719-g42ddc46e-1focal [22.0 kB] 2023-06-22T16:20:13.122 INFO:teuthology.orchestra.run.smithi149.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-719-g42ddc46e-1focal [12.8 kB] 2023-06-22T16:20:13.122 INFO:teuthology.orchestra.run.smithi149.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-719-g42ddc46e-1focal [21.9 kB] 2023-06-22T16:20:13.123 INFO:teuthology.orchestra.run.smithi149.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-719-g42ddc46e-1focal [17.0 MB] 2023-06-22T16:20:13.335 INFO:teuthology.orchestra.run.smithi196.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-719-g42ddc46e-1focal [22.5 kB] 2023-06-22T16:20:13.339 INFO:teuthology.orchestra.run.smithi196.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-719-g42ddc46e-1focal [200 kB] 2023-06-22T16:20:13.508 INFO:teuthology.orchestra.run.smithi196.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-719-g42ddc46e-1focal [47.1 kB] 2023-06-22T16:20:13.524 INFO:teuthology.orchestra.run.smithi196.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-719-g42ddc46e-1focal [384 kB] 2023-06-22T16:20:13.677 INFO:teuthology.orchestra.run.smithi196.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-719-g42ddc46e-1focal [5,565 kB] 2023-06-22T16:20:13.687 INFO:teuthology.orchestra.run.smithi149.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-719-g42ddc46e-1focal [79.4 kB] 2023-06-22T16:20:13.873 INFO:teuthology.orchestra.run.smithi196.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-06-22T16:20:13.875 INFO:teuthology.orchestra.run.smithi196.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-06-22T16:20:13.876 INFO:teuthology.orchestra.run.smithi196.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-06-22T16:20:13.877 INFO:teuthology.orchestra.run.smithi196.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-06-22T16:20:13.878 INFO:teuthology.orchestra.run.smithi196.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-06-22T16:20:13.880 INFO:teuthology.orchestra.run.smithi196.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-06-22T16:20:13.896 INFO:teuthology.orchestra.run.smithi196.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-06-22T16:20:13.897 INFO:teuthology.orchestra.run.smithi196.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-22T16:20:13.897 INFO:teuthology.orchestra.run.smithi196.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-06-22T16:20:13.954 INFO:teuthology.orchestra.run.smithi196.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-06-22T16:20:14.119 INFO:teuthology.orchestra.run.smithi196.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-06-22T16:20:14.321 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 209 MB in 7s (32.1 MB/s) 2023-06-22T16:20:14.404 INFO:teuthology.orchestra.run.smithi196.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-06-22T16:20:14.425 INFO:teuthology.orchestra.run.smithi196.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-06-22T16:20:14.465 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-22T16:20:14.522 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141758 files and directories currently installed.) 2023-06-22T16:20:14.526 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-06-22T16:20:14.563 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-06-22T16:20:14.576 INFO:teuthology.orchestra.run.smithi196.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-06-22T16:20:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-06-22T16:20:14.875 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-22T16:20:14.891 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-06-22T16:20:14.933 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-22T16:20:15.261 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cmd2. 2023-06-22T16:20:15.276 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-06-22T16:20:15.319 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-06-22T16:20:15.398 INFO:teuthology.orchestra.run.smithi196.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-719-g42ddc46e-1focal [116 kB] 2023-06-22T16:20:15.404 INFO:teuthology.orchestra.run.smithi196.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-719-g42ddc46e-1focal [479 kB] 2023-06-22T16:20:15.509 INFO:teuthology.orchestra.run.smithi196.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-719-g42ddc46e-1focal [27.3 MB] 2023-06-22T16:20:15.597 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-06-22T16:20:15.616 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-06-22T16:20:15.680 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-22T16:20:16.067 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../004-librbd1_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:16.193 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librbd1 (17.2.6-719-g42ddc46e-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-22T16:20:16.905 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../005-librados2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:17.027 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librados2 (17.2.6-719-g42ddc46e-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-22T16:20:17.681 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libcephfs2. 2023-06-22T16:20:17.700 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:17.731 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libcephfs2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:18.059 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rados. 2023-06-22T16:20:18.075 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../007-python3-rados_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:18.150 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rados (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:18.495 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-22T16:20:18.513 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:20:18.554 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-ceph-argparse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:18.773 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cephfs. 2023-06-22T16:20:18.793 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:18.823 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cephfs (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:19.168 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-22T16:20:19.186 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:20:19.226 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:19.522 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-prettytable. 2023-06-22T16:20:19.541 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-06-22T16:20:19.606 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-06-22T16:20:19.850 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rbd. 2023-06-22T16:20:19.867 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:19.900 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rbd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:20.253 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-06-22T16:20:20.273 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-06-22T16:20:20.337 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-22T16:20:20.698 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-06-22T16:20:20.715 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-06-22T16:20:20.756 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-06-22T16:20:21.066 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-22T16:20:21.085 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-06-22T16:20:21.126 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-22T16:20:21.462 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-22T16:20:21.479 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-06-22T16:20:21.520 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-22T16:20:21.798 INFO:teuthology.orchestra.run.smithi196.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-719-g42ddc46e-1focal [6,447 kB] 2023-06-22T16:20:21.890 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-22T16:20:21.907 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-06-22T16:20:21.947 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-22T16:20:22.221 INFO:teuthology.orchestra.run.smithi196.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-719-g42ddc46e-1focal [221 kB] 2023-06-22T16:20:22.228 INFO:teuthology.orchestra.run.smithi196.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-719-g42ddc46e-1focal [152 kB] 2023-06-22T16:20:22.237 INFO:teuthology.orchestra.run.smithi196.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-719-g42ddc46e-1focal [1,588 kB] 2023-06-22T16:20:22.345 INFO:teuthology.orchestra.run.smithi196.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-719-g42ddc46e-1focal [7,843 kB] 2023-06-22T16:20:22.360 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-22T16:20:22.378 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-22T16:20:22.428 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-22T16:20:22.801 INFO:teuthology.orchestra.run.smithi196.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-719-g42ddc46e-1focal [28.7 MB] 2023-06-22T16:20:22.904 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-22T16:20:22.924 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-22T16:20:22.962 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-22T16:20:23.357 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-22T16:20:23.375 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-22T16:20:23.415 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-22T16:20:23.752 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-06-22T16:20:23.770 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-06-22T16:20:23.810 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-22T16:20:24.146 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librgw2. 2023-06-22T16:20:24.162 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../022-librgw2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:24.231 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librgw2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:24.301 INFO:teuthology.orchestra.run.smithi196.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-719-g42ddc46e-1focal [3,920 B] 2023-06-22T16:20:24.327 INFO:teuthology.orchestra.run.smithi196.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-719-g42ddc46e-1focal [867 kB] 2023-06-22T16:20:24.339 INFO:teuthology.orchestra.run.smithi196.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-719-g42ddc46e-1focal [2,399 kB] 2023-06-22T16:20:24.369 INFO:teuthology.orchestra.run.smithi196.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-719-g42ddc46e-1focal [78.9 kB] 2023-06-22T16:20:24.374 INFO:teuthology.orchestra.run.smithi196.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-719-g42ddc46e-1focal [117 kB] 2023-06-22T16:20:24.375 INFO:teuthology.orchestra.run.smithi196.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-719-g42ddc46e-1focal [1,759 kB] 2023-06-22T16:20:24.444 INFO:teuthology.orchestra.run.smithi196.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-719-g42ddc46e-1focal [7,886 kB] 2023-06-22T16:20:24.755 INFO:teuthology.orchestra.run.smithi196.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-719-g42ddc46e-1focal [4,036 B] 2023-06-22T16:20:24.756 INFO:teuthology.orchestra.run.smithi196.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-719-g42ddc46e-1focal [56.2 MB] 2023-06-22T16:20:25.015 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rgw. 2023-06-22T16:20:25.034 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:25.073 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:25.402 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liboath0. 2023-06-22T16:20:25.419 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-06-22T16:20:25.460 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-06-22T16:20:25.776 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libradosstriper1. 2023-06-22T16:20:25.794 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:25.836 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libradosstriper1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:26.251 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-common. 2023-06-22T16:20:26.270 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../026-ceph-common_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:26.309 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:28.774 INFO:teuthology.orchestra.run.smithi196.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-719-g42ddc46e-1focal [226 kB] 2023-06-22T16:20:28.779 INFO:teuthology.orchestra.run.smithi196.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-719-g42ddc46e-1focal [238 kB] 2023-06-22T16:20:28.782 INFO:teuthology.orchestra.run.smithi196.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-719-g42ddc46e-1focal [22.0 kB] 2023-06-22T16:20:28.783 INFO:teuthology.orchestra.run.smithi196.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-719-g42ddc46e-1focal [12.8 kB] 2023-06-22T16:20:28.783 INFO:teuthology.orchestra.run.smithi196.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-719-g42ddc46e-1focal [21.9 kB] 2023-06-22T16:20:28.784 INFO:teuthology.orchestra.run.smithi196.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-719-g42ddc46e-1focal [17.0 MB] 2023-06-22T16:20:29.020 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-base. 2023-06-22T16:20:29.038 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../027-ceph-base_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:29.088 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-base (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:29.369 INFO:teuthology.orchestra.run.smithi196.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-719-g42ddc46e-1focal [79.4 kB] 2023-06-22T16:20:29.989 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 209 MB in 22s (9,554 kB/s) 2023-06-22T16:20:30.114 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-22T16:20:30.172 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141758 files and directories currently installed.) 2023-06-22T16:20:30.176 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-06-22T16:20:30.192 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cryptography. 2023-06-22T16:20:30.208 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-06-22T16:20:30.241 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-06-22T16:20:30.250 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-22T16:20:30.549 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-22T16:20:30.565 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-06-22T16:20:30.607 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-22T16:20:30.645 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-openssl. 2023-06-22T16:20:30.662 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-06-22T16:20:30.703 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-06-22T16:20:30.960 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cmd2. 2023-06-22T16:20:30.979 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-06-22T16:20:31.006 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-22T16:20:31.018 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-06-22T16:20:31.023 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:20:31.064 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-modules-core (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:31.362 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-06-22T16:20:31.380 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-06-22T16:20:31.444 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-22T16:20:31.461 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-06-22T16:20:31.463 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-22T16:20:31.524 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-22T16:20:31.810 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../004-librbd1_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:31.830 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-22T16:20:31.847 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-06-22T16:20:31.888 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-06-22T16:20:31.933 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librbd1 (17.2.6-719-g42ddc46e-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-22T16:20:32.225 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-natsort. 2023-06-22T16:20:32.245 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-06-22T16:20:32.300 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-06-22T16:20:32.612 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jwt. 2023-06-22T16:20:32.628 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-06-22T16:20:32.670 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-22T16:20:32.670 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../005-librados2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:32.793 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librados2 (17.2.6-719-g42ddc46e-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-22T16:20:32.965 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-logutils. 2023-06-22T16:20:32.980 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-06-22T16:20:33.031 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-06-22T16:20:33.342 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-22T16:20:33.359 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-06-22T16:20:33.400 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-06-22T16:20:33.488 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs2. 2023-06-22T16:20:33.504 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:33.547 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:33.705 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-mako. 2023-06-22T16:20:33.721 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-06-22T16:20:33.779 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-22T16:20:33.907 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rados. 2023-06-22T16:20:33.924 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../007-python3-rados_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:33.966 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rados (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:34.099 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-22T16:20:34.115 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-22T16:20:34.158 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-22T16:20:34.310 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-22T16:20:34.326 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:20:34.368 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-argparse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:34.496 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-22T16:20:34.516 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-06-22T16:20:34.554 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-06-22T16:20:34.647 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cephfs. 2023-06-22T16:20:34.664 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:34.706 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cephfs (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:34.857 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-webob. 2023-06-22T16:20:34.875 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-06-22T16:20:34.915 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-06-22T16:20:35.041 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-22T16:20:35.059 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:20:35.100 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:35.277 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-soupsieve. 2023-06-22T16:20:35.293 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-06-22T16:20:35.335 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-22T16:20:35.446 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-prettytable. 2023-06-22T16:20:35.466 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-06-22T16:20:35.505 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-06-22T16:20:35.630 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-bs4. 2023-06-22T16:20:35.649 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-06-22T16:20:35.687 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-06-22T16:20:35.741 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rbd. 2023-06-22T16:20:35.758 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:35.799 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rbd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:36.049 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-waitress. 2023-06-22T16:20:36.067 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-06-22T16:20:36.102 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-22T16:20:36.177 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-06-22T16:20:36.195 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-06-22T16:20:36.235 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-22T16:20:36.436 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-tempita. 2023-06-22T16:20:36.452 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-06-22T16:20:36.486 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-06-22T16:20:36.605 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-06-22T16:20:36.621 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-06-22T16:20:36.663 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-06-22T16:20:36.797 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-paste. 2023-06-22T16:20:36.817 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-06-22T16:20:36.855 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-06-22T16:20:37.008 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-22T16:20:37.024 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-06-22T16:20:37.066 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-22T16:20:37.151 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-22T16:20:37.170 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-06-22T16:20:37.200 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-06-22T16:20:37.461 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-22T16:20:37.477 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-06-22T16:20:37.519 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-22T16:20:37.528 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-22T16:20:37.547 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-06-22T16:20:37.586 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-06-22T16:20:37.847 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-22T16:20:37.864 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-06-22T16:20:37.889 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-webtest. 2023-06-22T16:20:37.905 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-22T16:20:37.907 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-06-22T16:20:37.947 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-06-22T16:20:38.309 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pecan. 2023-06-22T16:20:38.326 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-06-22T16:20:38.367 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-06-22T16:20:38.730 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-22T16:20:38.747 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-06-22T16:20:38.788 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-22T16:20:39.159 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-22T16:20:39.178 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:39.216 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:39.351 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-22T16:20:39.370 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-22T16:20:39.419 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-22T16:20:39.655 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr. 2023-06-22T16:20:39.676 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:39.870 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-22T16:20:39.886 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-22T16:20:39.920 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-22T16:20:40.145 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:40.298 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-22T16:20:40.314 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-22T16:20:40.356 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-22T16:20:40.740 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mon. 2023-06-22T16:20:40.743 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-06-22T16:20:40.756 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:40.762 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-06-22T16:20:40.798 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mon (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:40.801 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-22T16:20:41.145 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librgw2. 2023-06-22T16:20:41.164 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../022-librgw2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:41.195 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librgw2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:41.923 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rgw. 2023-06-22T16:20:41.942 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:41.952 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-osd. 2023-06-22T16:20:41.970 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:41.981 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:42.010 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-osd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:42.350 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liboath0. 2023-06-22T16:20:42.366 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-06-22T16:20:42.408 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-06-22T16:20:42.709 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libradosstriper1. 2023-06-22T16:20:42.724 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:42.766 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libradosstriper1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:43.224 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-common. 2023-06-22T16:20:43.243 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../026-ceph-common_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:43.282 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:44.705 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph. 2023-06-22T16:20:44.721 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../055-ceph_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:44.754 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:45.091 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-fuse. 2023-06-22T16:20:45.107 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:45.148 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:45.602 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mds. 2023-06-22T16:20:45.622 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:45.660 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mds (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:45.852 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-base. 2023-06-22T16:20:45.868 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../027-ceph-base_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:45.920 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-base (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:46.188 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephadm. 2023-06-22T16:20:46.207 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../058-cephadm_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:46.246 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:46.549 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jinja2. 2023-06-22T16:20:46.569 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-06-22T16:20:46.599 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-06-22T16:20:46.890 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cryptography. 2023-06-22T16:20:46.907 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-06-22T16:20:46.927 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-22T16:20:46.946 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:20:46.948 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-22T16:20:46.986 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:47.326 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-openssl. 2023-06-22T16:20:47.330 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-22T16:20:47.346 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-06-22T16:20:47.347 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-06-22T16:20:47.376 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-06-22T16:20:47.388 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-22T16:20:47.620 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-22T16:20:47.638 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:20:47.641 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjs-underscore. 2023-06-22T16:20:47.657 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-06-22T16:20:47.679 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-modules-core (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:47.699 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-22T16:20:47.993 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-06-22T16:20:48.011 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-06-22T16:20:48.052 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-22T16:20:48.059 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-22T16:20:48.078 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-06-22T16:20:48.126 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-22T16:20:48.371 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-routes. 2023-06-22T16:20:48.387 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-06-22T16:20:48.412 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-22T16:20:48.429 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-06-22T16:20:48.431 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-06-22T16:20:48.470 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-06-22T16:20:48.774 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-22T16:20:48.793 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:20:48.814 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-natsort. 2023-06-22T16:20:48.832 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-dashboard (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:48.834 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-06-22T16:20:48.873 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-06-22T16:20:49.193 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jwt. 2023-06-22T16:20:49.208 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-06-22T16:20:49.251 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-22T16:20:49.319 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-decorator. 2023-06-22T16:20:49.336 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-06-22T16:20:49.377 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-06-22T16:20:49.579 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-logutils. 2023-06-22T16:20:49.598 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-06-22T16:20:49.637 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-06-22T16:20:49.705 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-06-22T16:20:49.725 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-06-22T16:20:49.763 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-22T16:20:49.923 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-22T16:20:49.942 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-06-22T16:20:49.981 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-06-22T16:20:50.074 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-scipy. 2023-06-22T16:20:50.093 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-06-22T16:20:50.132 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-06-22T16:20:50.309 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-mako. 2023-06-22T16:20:50.327 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-06-22T16:20:50.369 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-22T16:20:50.719 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-22T16:20:50.738 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-22T16:20:50.780 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-22T16:20:51.083 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-22T16:20:51.102 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-06-22T16:20:51.141 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-06-22T16:20:51.383 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-06-22T16:20:51.402 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-06-22T16:20:51.441 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-22T16:20:51.463 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webob. 2023-06-22T16:20:51.480 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-06-22T16:20:51.521 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-06-22T16:20:51.840 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-soupsieve. 2023-06-22T16:20:51.856 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-06-22T16:20:51.898 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-22T16:20:52.012 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-joblib. 2023-06-22T16:20:52.028 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-06-22T16:20:52.061 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-06-22T16:20:52.236 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-bs4. 2023-06-22T16:20:52.252 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-06-22T16:20:52.293 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-06-22T16:20:52.482 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-sklearn. 2023-06-22T16:20:52.499 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-06-22T16:20:52.540 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-22T16:20:52.646 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-waitress. 2023-06-22T16:20:52.662 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-06-22T16:20:52.707 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-22T16:20:53.074 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempita. 2023-06-22T16:20:53.091 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-06-22T16:20:53.132 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-06-22T16:20:53.215 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-22T16:20:53.234 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:20:53.264 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:53.435 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-paste. 2023-06-22T16:20:53.452 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-06-22T16:20:53.494 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-06-22T16:20:53.822 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-22T16:20:53.840 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-06-22T16:20:53.880 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-06-22T16:20:54.183 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-22T16:20:54.200 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-06-22T16:20:54.266 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-06-22T16:20:54.376 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cachetools. 2023-06-22T16:20:54.394 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-06-22T16:20:54.434 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-06-22T16:20:54.644 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webtest. 2023-06-22T16:20:54.661 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-06-22T16:20:54.711 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-06-22T16:20:54.746 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-22T16:20:54.765 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-06-22T16:20:54.804 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-06-22T16:20:55.056 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pecan. 2023-06-22T16:20:55.072 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-06-22T16:20:55.114 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-06-22T16:20:55.132 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-22T16:20:55.150 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-06-22T16:20:55.190 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-22T16:20:55.460 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-22T16:20:55.477 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-06-22T16:20:55.518 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-22T16:20:55.568 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rsa. 2023-06-22T16:20:55.589 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-06-22T16:20:55.626 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rsa (4.0-3) ... 2023-06-22T16:20:55.897 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-22T16:20:55.915 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:55.938 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-google-auth. 2023-06-22T16:20:55.955 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:55.955 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-06-22T16:20:55.996 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-06-22T16:20:56.300 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr. 2023-06-22T16:20:56.316 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:56.333 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-blinker. 2023-06-22T16:20:56.351 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-06-22T16:20:56.383 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:56.391 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-22T16:20:56.694 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-oauthlib. 2023-06-22T16:20:56.711 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-06-22T16:20:56.752 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-22T16:20:56.869 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mon. 2023-06-22T16:20:56.887 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:56.927 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mon (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:57.097 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-22T16:20:57.117 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-06-22T16:20:57.155 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-22T16:20:57.570 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-websocket. 2023-06-22T16:20:57.589 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-06-22T16:20:57.627 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-06-22T16:20:57.939 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-22T16:20:57.955 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-06-22T16:20:57.997 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-06-22T16:20:58.090 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-osd. 2023-06-22T16:20:58.105 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:20:58.147 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-osd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:58.520 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-22T16:20:58.539 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:20:58.578 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:20:58.898 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-22T16:20:58.915 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-06-22T16:20:58.955 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-06-22T16:20:59.359 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-22T16:20:59.377 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-22T16:20:59.417 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-22T16:20:59.695 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package jq. 2023-06-22T16:20:59.714 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-22T16:20:59.753 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-06-22T16:21:00.014 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package socat. 2023-06-22T16:21:00.034 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-06-22T16:21:00.072 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking socat (1.7.3.3-2) ... 2023-06-22T16:21:00.367 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package xmlstarlet. 2023-06-22T16:21:00.386 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-06-22T16:21:00.425 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-06-22T16:21:00.805 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-test. 2023-06-22T16:21:00.821 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../089-ceph-test_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:01.000 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph. 2023-06-22T16:21:01.017 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../055-ceph_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:01.058 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:01.088 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-test (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:01.386 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-fuse. 2023-06-22T16:21:01.404 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:01.469 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:01.881 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mds. 2023-06-22T16:21:01.899 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:01.931 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mds (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:02.442 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephadm. 2023-06-22T16:21:02.458 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../058-cephadm_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:02.500 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:02.828 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jinja2. 2023-06-22T16:21:02.844 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-06-22T16:21:02.903 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-06-22T16:21:03.223 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-22T16:21:03.240 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:21:03.281 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:03.651 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-22T16:21:03.668 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-06-22T16:21:03.709 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-22T16:21:03.962 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjs-underscore. 2023-06-22T16:21:03.980 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-06-22T16:21:04.020 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-22T16:21:04.256 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-06-22T16:21:04.272 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-06-22T16:21:04.322 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-22T16:21:04.600 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-routes. 2023-06-22T16:21:04.616 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-06-22T16:21:04.658 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-06-22T16:21:05.086 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-22T16:21:05.104 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:21:05.144 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-dashboard (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:05.606 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-decorator. 2023-06-22T16:21:05.626 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-06-22T16:21:05.656 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-06-22T16:21:05.959 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-06-22T16:21:05.978 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-06-22T16:21:06.017 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-22T16:21:06.033 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-volume. 2023-06-22T16:21:06.051 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:21:06.091 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-volume (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:06.345 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-scipy. 2023-06-22T16:21:06.361 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-06-22T16:21:06.403 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-06-22T16:21:06.413 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-22T16:21:06.431 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:06.471 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephfs-mirror (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:06.816 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-colorama. 2023-06-22T16:21:06.832 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-06-22T16:21:06.873 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-06-22T16:21:07.118 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephfs-shell. 2023-06-22T16:21:07.138 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:21:07.176 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephfs-shell (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:07.462 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephfs-top. 2023-06-22T16:21:07.480 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:21:07.520 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephfs-top (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:07.712 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-06-22T16:21:07.729 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-06-22T16:21:07.770 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-22T16:21:07.773 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package fonts-mathjax. 2023-06-22T16:21:07.791 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-22T16:21:07.831 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-22T16:21:08.298 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-joblib. 2023-06-22T16:21:08.318 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-06-22T16:21:08.326 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-22T16:21:08.346 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:08.356 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-06-22T16:21:08.384 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libcephfs-dev (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:08.743 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn. 2023-06-22T16:21:08.761 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-06-22T16:21:08.801 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-22T16:21:08.804 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package nvme-cli. 2023-06-22T16:21:08.821 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-06-22T16:21:08.880 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-06-22T16:21:09.209 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjs-mathjax. 2023-06-22T16:21:09.230 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-22T16:21:09.267 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-22T16:21:09.493 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-22T16:21:09.509 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:21:09.551 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:10.762 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cachetools. 2023-06-22T16:21:10.778 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-06-22T16:21:10.820 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-06-22T16:21:10.944 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python-natsort-doc. 2023-06-22T16:21:10.964 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-06-22T16:21:11.001 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-06-22T16:21:11.123 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-22T16:21:11.140 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-06-22T16:21:11.181 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-06-22T16:21:11.371 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-atomicwrites. 2023-06-22T16:21:11.391 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-06-22T16:21:11.429 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-06-22T16:21:11.526 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-22T16:21:11.542 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-06-22T16:21:11.584 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-22T16:21:11.691 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-attr. 2023-06-22T16:21:11.708 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-06-22T16:21:11.740 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-06-22T16:21:11.904 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rsa. 2023-06-22T16:21:11.923 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-06-22T16:21:11.962 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rsa (4.0-3) ... 2023-06-22T16:21:12.077 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-webencodings. 2023-06-22T16:21:12.098 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-06-22T16:21:12.135 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-22T16:21:12.299 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-google-auth. 2023-06-22T16:21:12.316 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-06-22T16:21:12.357 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-06-22T16:21:12.413 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-html5lib. 2023-06-22T16:21:12.434 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-06-22T16:21:12.471 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-06-22T16:21:12.676 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-blinker. 2023-06-22T16:21:12.693 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-06-22T16:21:12.734 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-22T16:21:12.817 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-06-22T16:21:12.838 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-06-22T16:21:12.875 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-22T16:21:13.062 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-oauthlib. 2023-06-22T16:21:13.083 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-06-22T16:21:13.121 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-22T16:21:13.362 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-packaging. 2023-06-22T16:21:13.380 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-06-22T16:21:13.420 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-packaging (20.3-1) ... 2023-06-22T16:21:13.472 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-22T16:21:13.491 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-06-22T16:21:13.540 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-22T16:21:13.723 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pastescript. 2023-06-22T16:21:13.740 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-06-22T16:21:13.781 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-22T16:21:13.937 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-websocket. 2023-06-22T16:21:13.956 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-06-22T16:21:13.995 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-06-22T16:21:14.127 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pluggy. 2023-06-22T16:21:14.144 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-06-22T16:21:14.184 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-06-22T16:21:14.299 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-22T16:21:14.316 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-06-22T16:21:14.349 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-06-22T16:21:14.496 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-psutil. 2023-06-22T16:21:14.513 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-06-22T16:21:14.554 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-06-22T16:21:14.899 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-py. 2023-06-22T16:21:14.905 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-22T16:21:14.916 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-06-22T16:21:14.923 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:21:14.957 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-06-22T16:21:14.971 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:15.285 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-22T16:21:15.290 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-22T16:21:15.306 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-06-22T16:21:15.308 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-06-22T16:21:15.343 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-22T16:21:15.349 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-06-22T16:21:15.654 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pytest. 2023-06-22T16:21:15.672 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-06-22T16:21:15.712 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-06-22T16:21:15.727 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-22T16:21:15.744 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-22T16:21:15.785 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-22T16:21:16.032 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-simplejson. 2023-06-22T16:21:16.051 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-06-22T16:21:16.054 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package jq. 2023-06-22T16:21:16.072 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-22T16:21:16.090 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-22T16:21:16.112 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-06-22T16:21:16.390 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package socat. 2023-06-22T16:21:16.394 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-22T16:21:16.406 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-06-22T16:21:16.411 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-06-22T16:21:16.448 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking socat (1.7.3.3-2) ... 2023-06-22T16:21:16.452 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-22T16:21:16.744 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package xmlstarlet. 2023-06-22T16:21:16.761 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-06-22T16:21:16.802 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-06-22T16:21:17.164 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-test. 2023-06-22T16:21:17.181 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../089-ceph-test_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:17.222 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-test (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:17.231 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package radosgw. 2023-06-22T16:21:17.248 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../114-radosgw_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:17.289 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking radosgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:19.034 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package rbd-fuse. 2023-06-22T16:21:19.051 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:19.092 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking rbd-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:19.411 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-attr (19.3.0-2) ... 2023-06-22T16:21:19.714 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-06-22T16:21:19.840 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-22T16:21:19.991 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-06-22T16:21:20.194 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:20.813 INFO:teuthology.orchestra.run.smithi149.stdout:Adding system user cephadm....done 2023-06-22T16:21:20.967 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-22T16:21:21.109 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-22T16:21:21.470 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-22T16:21:21.763 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-22T16:21:21.889 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-06-22T16:21:22.015 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-06-22T16:21:22.176 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-volume. 2023-06-22T16:21:22.193 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:21:22.234 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-volume (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:22.359 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-06-22T16:21:22.573 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-22T16:21:22.589 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:22.647 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephfs-mirror (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:22.769 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-22T16:21:22.975 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-colorama. 2023-06-22T16:21:22.991 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-06-22T16:21:23.033 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-06-22T16:21:23.062 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-06-22T16:21:23.294 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephfs-shell. 2023-06-22T16:21:23.313 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:21:23.340 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-06-22T16:21:23.369 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephfs-shell (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:23.605 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephfs-top. 2023-06-22T16:21:23.623 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-22T16:21:23.643 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-22T16:21:23.663 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephfs-top (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:23.899 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package fonts-mathjax. 2023-06-22T16:21:23.916 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-22T16:21:23.919 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-22T16:21:23.948 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-22T16:21:24.203 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-ceph-argparse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:24.452 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-22T16:21:24.471 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:24.504 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-22T16:21:24.518 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs-dev (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:24.638 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-06-22T16:21:24.923 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-06-22T16:21:24.947 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package nvme-cli. 2023-06-22T16:21:24.964 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-06-22T16:21:25.022 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-06-22T16:21:25.207 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-22T16:21:25.326 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjs-mathjax. 2023-06-22T16:21:25.346 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-22T16:21:25.384 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-22T16:21:25.484 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-22T16:21:25.610 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-06-22T16:21:25.978 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-06-22T16:21:26.262 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-06-22T16:21:26.564 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-22T16:21:26.907 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-06-22T16:21:27.000 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-natsort-doc. 2023-06-22T16:21:27.018 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-06-22T16:21:27.091 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-06-22T16:21:27.192 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-06-22T16:21:27.410 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-atomicwrites. 2023-06-22T16:21:27.428 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-06-22T16:21:27.468 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-06-22T16:21:27.526 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-06-22T16:21:27.796 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-attr. 2023-06-22T16:21:27.810 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-packaging (20.3-1) ... 2023-06-22T16:21:27.815 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-06-22T16:21:27.854 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-06-22T16:21:28.086 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-06-22T16:21:28.182 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webencodings. 2023-06-22T16:21:28.199 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-06-22T16:21:28.212 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-22T16:21:28.249 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-22T16:21:28.334 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-22T16:21:28.560 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-html5lib. 2023-06-22T16:21:28.579 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-06-22T16:21:28.618 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-06-22T16:21:28.635 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-06-22T16:21:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-06-22T16:21:28.981 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-06-22T16:21:29.022 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-22T16:21:29.028 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-06-22T16:21:29.314 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-22T16:21:29.484 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-packaging. 2023-06-22T16:21:29.501 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-06-22T16:21:29.542 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-packaging (20.3-1) ... 2023-06-22T16:21:29.673 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-22T16:21:29.853 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastescript. 2023-06-22T16:21:29.870 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-06-22T16:21:29.944 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-22T16:21:30.042 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up socat (1.7.3.3-2) ... 2023-06-22T16:21:30.168 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:30.264 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pluggy. 2023-06-22T16:21:30.282 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-06-22T16:21:30.422 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-06-22T16:21:30.521 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-22T16:21:30.656 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-06-22T16:21:30.742 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-psutil. 2023-06-22T16:21:30.763 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-06-22T16:21:30.800 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-06-22T16:21:31.024 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-22T16:21:31.150 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-06-22T16:21:31.153 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-py. 2023-06-22T16:21:31.170 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-06-22T16:21:31.211 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-06-22T16:21:31.276 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-06-22T16:21:31.565 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-22T16:21:31.584 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-06-22T16:21:31.619 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-22T16:21:31.622 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-22T16:21:31.934 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pytest. 2023-06-22T16:21:31.950 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-06-22T16:21:31.984 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-06-22T16:21:32.237 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-22T16:21:32.345 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplejson. 2023-06-22T16:21:32.362 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-06-22T16:21:32.363 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-22T16:21:32.403 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-22T16:21:32.489 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-06-22T16:21:32.664 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-22T16:21:32.684 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-06-22T16:21:32.739 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-22T16:21:32.857 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-06-22T16:21:33.133 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-06-22T16:21:33.434 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-22T16:21:33.468 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package radosgw. 2023-06-22T16:21:33.485 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../114-radosgw_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:33.526 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking radosgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:33.552 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-22T16:21:33.819 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-06-22T16:21:34.112 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-22T16:21:34.413 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-06-22T16:21:34.839 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-06-22T16:21:35.108 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-06-22T16:21:35.255 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package rbd-fuse. 2023-06-22T16:21:35.259 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-22T16:21:35.273 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-22T16:21:35.313 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking rbd-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:35.585 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-06-22T16:21:35.662 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-attr (19.3.0-2) ... 2023-06-22T16:21:35.928 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-22T16:21:35.960 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-06-22T16:21:36.046 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-22T16:21:36.086 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-22T16:21:36.172 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-06-22T16:21:36.203 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-06-22T16:21:36.438 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:36.549 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-22T16:21:36.834 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librados2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:36.961 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-06-22T16:21:37.101 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user cephadm....done 2023-06-22T16:21:37.262 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-22T16:21:37.388 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-22T16:21:37.740 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-22T16:21:38.033 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-22T16:21:38.159 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-06-22T16:21:38.285 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-06-22T16:21:38.459 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libsqlite3-mod-ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:38.610 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-22T16:21:38.628 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-06-22T16:21:38.739 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-06-22T16:21:39.039 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-22T16:21:39.116 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-06-22T16:21:39.349 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-06-22T16:21:39.434 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-06-22T16:21:39.641 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-06-22T16:21:39.727 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-22T16:21:39.853 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-06-22T16:21:39.936 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-22T16:21:40.196 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libcephfs2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:40.214 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-22T16:21:40.322 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-22T16:21:40.518 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-argparse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:40.651 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libradosstriper1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:40.811 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-22T16:21:41.141 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-22T16:21:41.145 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-22T16:21:41.292 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-06-22T16:21:41.585 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-06-22T16:21:41.892 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-22T16:21:42.170 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-22T16:21:42.217 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librbd1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:42.296 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-06-22T16:21:42.327 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-22T16:21:42.453 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-06-22T16:21:42.579 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-06-22T16:21:42.672 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-06-22T16:21:42.705 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rsa (4.0-3) ... 2023-06-22T16:21:42.965 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-06-22T16:21:43.014 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-22T16:21:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-06-22T16:21:43.250 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-22T16:21:43.511 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-modules-core (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:43.659 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-06-22T16:21:43.678 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:43.903 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-22T16:21:43.903 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-22T16:21:43.952 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-06-22T16:21:44.295 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-06-22T16:21:44.330 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libcephfs-dev (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:44.481 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-22T16:21:44.588 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-packaging (20.3-1) ... 2023-06-22T16:21:44.782 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-22T16:21:44.880 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-06-22T16:21:45.007 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-22T16:21:45.084 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-06-22T16:21:45.133 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-22T16:21:45.437 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-06-22T16:21:45.445 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rados (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:45.570 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librgw2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:45.697 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephfs-top (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:45.822 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rbd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:45.839 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-06-22T16:21:45.973 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up rbd-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:46.091 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-routes (2.4.1-2) ... 2023-06-22T16:21:46.157 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-22T16:21:46.386 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-06-22T16:21:46.517 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-22T16:21:46.679 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:46.805 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cephfs (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:46.870 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up socat (1.7.3.3-2) ... 2023-06-22T16:21:46.931 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephfs-shell (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:46.995 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:47.057 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-06-22T16:21:47.304 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-22T16:21:47.449 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-06-22T16:21:47.817 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-22T16:21:47.943 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-06-22T16:21:47.961 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:48.069 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-06-22T16:21:48.337 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-22T16:21:48.539 INFO:teuthology.orchestra.run.smithi149.stdout:Adding group ceph....done 2023-06-22T16:21:48.638 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-22T16:21:48.764 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-22T16:21:48.899 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-06-22T16:21:48.949 INFO:teuthology.orchestra.run.smithi149.stdout:Adding system user ceph....done 2023-06-22T16:21:49.125 INFO:teuthology.orchestra.run.smithi149.stdout:Setting system user ceph properties....done 2023-06-22T16:21:49.147 INFO:teuthology.orchestra.run.smithi149.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-22T16:21:49.242 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-06-22T16:21:49.292 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-22T16:21:49.535 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-06-22T16:21:49.604 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-22T16:21:49.836 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-22T16:21:49.953 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-22T16:21:50.054 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephfs-mirror (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:50.197 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-test (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:50.229 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-06-22T16:21:50.348 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up radosgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:50.547 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-22T16:21:50.627 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-22T16:21:50.627 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-22T16:21:50.873 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-06-22T16:21:51.266 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-base (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:51.271 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-06-22T16:21:51.559 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-06-22T16:21:51.623 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-22T16:21:51.685 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-22T16:21:52.011 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-06-22T16:21:52.068 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mds (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:52.277 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-22T16:21:52.277 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-22T16:21:52.354 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-22T16:21:52.514 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-22T16:21:52.639 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-06-22T16:21:52.729 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:52.961 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-22T16:21:52.961 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-22T16:21:52.975 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-22T16:21:53.276 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librados2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:53.403 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-06-22T16:21:53.405 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-osd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:53.914 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-22T16:21:53.914 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-22T16:21:54.365 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-k8sevents (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:54.483 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:54.625 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mon (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:54.876 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-22T16:21:54.877 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-22T16:21:54.885 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libsqlite3-mod-ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:55.011 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-22T16:21:55.120 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-06-22T16:21:55.318 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:55.486 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:55.525 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-06-22T16:21:55.612 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-dashboard (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:55.755 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-volume (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:55.826 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-06-22T16:21:55.882 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-22T16:21:56.025 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-22T16:21:56.127 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-22T16:21:56.245 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-06-22T16:21:56.309 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-22T16:21:56.588 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:56.747 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-22T16:21:57.074 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libradosstriper1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:57.194 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-22T16:21:57.512 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-22T16:21:58.567 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librbd1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:21:58.693 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-22T16:21:58.836 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-06-22T16:21:58.986 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-06-22T16:21:59.112 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rsa (4.0-3) ... 2023-06-22T16:21:59.274 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-06-22T16:21:59.422 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-22T16:21:59.573 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-06-22T16:21:59.830 INFO:teuthology.orchestra.run.smithi149.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-22T16:21:59.833 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-06-22T16:21:59.905 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-06-22T16:21:59.968 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-modules-core (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:00.086 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:00.101 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2023-06-22T16:22:00.102 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2023-06-22T16:22:00.284 INFO:teuthology.orchestra.run.smithi149.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-06-22T16:22:00.285 INFO:teuthology.orchestra.run.smithi149.stdout:flex is already the newest version (2.6.4-6.2). 2023-06-22T16:22:00.285 INFO:teuthology.orchestra.run.smithi149.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-06-22T16:22:00.285 INFO:teuthology.orchestra.run.smithi149.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-22T16:22:00.285 INFO:teuthology.orchestra.run.smithi149.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-22T16:22:00.285 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages were automatically installed and are no longer required: 2023-06-22T16:22:00.286 INFO:teuthology.orchestra.run.smithi149.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-22T16:22:00.286 INFO:teuthology.orchestra.run.smithi149.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-22T16:22:00.286 INFO:teuthology.orchestra.run.smithi149.stdout:The following additional packages will be installed: 2023-06-22T16:22:00.286 INFO:teuthology.orchestra.run.smithi149.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-06-22T16:22:00.286 INFO:teuthology.orchestra.run.smithi149.stdout: libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-06-22T16:22:00.287 INFO:teuthology.orchestra.run.smithi149.stdout: modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-06-22T16:22:00.287 INFO:teuthology.orchestra.run.smithi149.stdout: usb-modeswitch-data wpasupplicant 2023-06-22T16:22:00.288 INFO:teuthology.orchestra.run.smithi149.stdout:Suggested packages: 2023-06-22T16:22:00.288 INFO:teuthology.orchestra.run.smithi149.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-06-22T16:22:00.288 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-06-22T16:22:00.300 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-22T16:22:00.300 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-22T16:22:00.330 INFO:teuthology.orchestra.run.smithi149.stdout:The following NEW packages will be installed: 2023-06-22T16:22:00.331 INFO:teuthology.orchestra.run.smithi149.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-06-22T16:22:00.332 INFO:teuthology.orchestra.run.smithi149.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-06-22T16:22:00.332 INFO:teuthology.orchestra.run.smithi149.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-06-22T16:22:00.332 INFO:teuthology.orchestra.run.smithi149.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-22T16:22:00.333 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages will be upgraded: 2023-06-22T16:22:00.333 INFO:teuthology.orchestra.run.smithi149.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-06-22T16:22:00.387 INFO:teuthology.orchestra.run.smithi149.stdout:4 upgraded, 23 newly installed, 0 to remove and 201 not upgraded. 2023-06-22T16:22:00.387 INFO:teuthology.orchestra.run.smithi149.stdout:Need to get 10.2 MB of archives. 2023-06-22T16:22:00.387 INFO:teuthology.orchestra.run.smithi149.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-06-22T16:22:00.387 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-06-22T16:22:00.517 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-06-22T16:22:00.518 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-06-22T16:22:00.519 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-06-22T16:22:00.538 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-06-22T16:22:00.539 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-06-22T16:22:00.540 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-06-22T16:22:00.541 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-06-22T16:22:00.541 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-06-22T16:22:00.542 INFO:teuthology.orchestra.run.smithi149.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-06-22T16:22:00.543 INFO:teuthology.orchestra.run.smithi149.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-06-22T16:22:00.579 INFO:teuthology.orchestra.run.smithi149.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-06-22T16:22:00.598 INFO:teuthology.orchestra.run.smithi149.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-06-22T16:22:00.658 INFO:teuthology.orchestra.run.smithi149.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-06-22T16:22:00.659 INFO:teuthology.orchestra.run.smithi149.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-06-22T16:22:00.685 INFO:teuthology.orchestra.run.smithi149.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-06-22T16:22:00.704 INFO:teuthology.orchestra.run.smithi149.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-06-22T16:22:00.705 INFO:teuthology.orchestra.run.smithi149.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-06-22T16:22:00.725 INFO:teuthology.orchestra.run.smithi149.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-06-22T16:22:00.725 INFO:teuthology.orchestra.run.smithi149.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-06-22T16:22:00.729 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs-dev (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:00.733 INFO:teuthology.orchestra.run.smithi149.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-06-22T16:22:00.743 INFO:teuthology.orchestra.run.smithi149.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-06-22T16:22:00.793 INFO:teuthology.orchestra.run.smithi149.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-06-22T16:22:00.855 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-22T16:22:00.895 INFO:teuthology.orchestra.run.smithi149.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-06-22T16:22:00.896 INFO:teuthology.orchestra.run.smithi149.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-06-22T16:22:00.897 INFO:teuthology.orchestra.run.smithi149.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-06-22T16:22:00.899 INFO:teuthology.orchestra.run.smithi149.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-06-22T16:22:01.198 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-22T16:22:01.221 INFO:teuthology.orchestra.run.smithi149.stdout:Preconfiguring packages ... 2023-06-22T16:22:01.354 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 10.2 MB in 1s (18.2 MB/s) 2023-06-22T16:22:01.499 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-06-22T16:22:01.656 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-22T16:22:01.661 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-22T16:22:01.826 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-22T16:22:01.869 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rados (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:01.995 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librgw2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:02.121 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephfs-top (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:02.247 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rbd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:02.398 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up rbd-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:02.526 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-routes (2.4.1-2) ... 2023-06-22T16:22:02.827 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-06-22T16:22:03.128 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:03.254 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cephfs (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:03.271 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-06-22T16:22:03.380 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephfs-shell (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:03.506 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-06-22T16:22:04.451 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:04.723 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-22T16:22:04.728 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-22T16:22:04.861 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-22T16:22:04.995 INFO:teuthology.orchestra.run.smithi196.stdout:Adding group ceph....done 2023-06-22T16:22:05.267 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-22T16:22:05.422 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user ceph....done 2023-06-22T16:22:05.442 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-22T16:22:05.598 INFO:teuthology.orchestra.run.smithi196.stdout:Setting system user ceph properties....done 2023-06-22T16:22:05.620 INFO:teuthology.orchestra.run.smithi196.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-22T16:22:05.767 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-06-22T16:22:05.771 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-22T16:22:06.068 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-22T16:22:06.295 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-22T16:22:06.300 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-22T16:22:06.441 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-06-22T16:22:06.552 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephfs-mirror (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:06.678 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-test (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:06.779 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up radosgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:07.012 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-22T16:22:07.032 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-22T16:22:07.032 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-22T16:22:07.033 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-06-22T16:22:07.070 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-06-22T16:22:07.423 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package dump. 2023-06-22T16:22:07.442 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-06-22T16:22:07.473 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking dump (0.4b46-6) ... 2023-06-22T16:22:07.673 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-base (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:07.743 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package indent. 2023-06-22T16:22:07.762 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-06-22T16:22:07.801 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking indent (2.2.12-1) ... 2023-06-22T16:22:08.044 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-22T16:22:08.179 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-22T16:22:08.199 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-06-22T16:22:08.448 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-06-22T16:22:08.491 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mds (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:08.723 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-22T16:22:08.724 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-22T16:22:08.809 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-22T16:22:08.827 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-06-22T16:22:08.892 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-22T16:22:09.154 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-22T16:22:09.168 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:09.171 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-06-22T16:22:09.212 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-22T16:22:09.402 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-22T16:22:09.402 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-22T16:22:09.557 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-22T16:22:09.573 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-22T16:22:09.648 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-22T16:22:09.844 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-osd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:09.909 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-22T16:22:09.927 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-22T16:22:09.959 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-22T16:22:10.262 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-22T16:22:10.282 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-22T16:22:10.344 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-22T16:22:10.345 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-22T16:22:10.345 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-22T16:22:10.706 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-22T16:22:10.724 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-06-22T16:22:10.764 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-22T16:22:10.788 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-k8sevents (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:10.897 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:11.040 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mon (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:11.117 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-22T16:22:11.135 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-22T16:22:11.175 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-22T16:22:11.266 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-22T16:22:11.266 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-22T16:22:11.562 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-22T16:22:11.580 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../12-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-22T16:22:11.620 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-22T16:22:11.964 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-22T16:22:11.975 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:11.981 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../13-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-22T16:22:12.022 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-22T16:22:12.176 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:12.276 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-22T16:22:12.293 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../14-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-22T16:22:12.302 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-dashboard (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:12.333 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-22T16:22:12.445 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-volume (17.2.6-719-g42ddc46e-1focal) ... 2023-06-22T16:22:12.572 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-22T16:22:12.715 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-22T16:22:12.854 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-22T16:22:12.871 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../15-libteamdctl0_1.30-1_amd64.deb ... 2023-06-22T16:22:12.912 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-06-22T16:22:12.983 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-22T16:22:13.315 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package modemmanager. 2023-06-22T16:22:13.333 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../16-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-22T16:22:13.383 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-22T16:22:14.347 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package wpasupplicant. 2023-06-22T16:22:14.364 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../17-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-06-22T16:22:14.405 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-22T16:22:14.944 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package network-manager. 2023-06-22T16:22:14.963 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../18-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-22T16:22:15.026 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-06-22T16:22:15.751 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ppp. 2023-06-22T16:22:15.768 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../19-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-06-22T16:22:15.930 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-06-22T16:22:16.051 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-22T16:22:16.397 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package pptp-linux. 2023-06-22T16:22:16.415 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../20-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-06-22T16:22:16.455 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-06-22T16:22:16.555 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-22T16:22:16.558 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-06-22T16:22:16.627 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2023-06-22T16:22:16.792 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-22T16:22:16.811 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../21-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-06-22T16:22:16.822 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2023-06-22T16:22:16.823 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2023-06-22T16:22:16.858 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-06-22T16:22:17.003 INFO:teuthology.orchestra.run.smithi196.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-06-22T16:22:17.003 INFO:teuthology.orchestra.run.smithi196.stdout:flex is already the newest version (2.6.4-6.2). 2023-06-22T16:22:17.003 INFO:teuthology.orchestra.run.smithi196.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-06-22T16:22:17.003 INFO:teuthology.orchestra.run.smithi196.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-22T16:22:17.004 INFO:teuthology.orchestra.run.smithi196.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-22T16:22:17.004 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2023-06-22T16:22:17.005 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-22T16:22:17.005 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-22T16:22:17.005 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2023-06-22T16:22:17.005 INFO:teuthology.orchestra.run.smithi196.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-06-22T16:22:17.005 INFO:teuthology.orchestra.run.smithi196.stdout: libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-06-22T16:22:17.006 INFO:teuthology.orchestra.run.smithi196.stdout: modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-06-22T16:22:17.006 INFO:teuthology.orchestra.run.smithi196.stdout: usb-modeswitch-data wpasupplicant 2023-06-22T16:22:17.006 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2023-06-22T16:22:17.007 INFO:teuthology.orchestra.run.smithi196.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-06-22T16:22:17.007 INFO:teuthology.orchestra.run.smithi196.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-06-22T16:22:17.050 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2023-06-22T16:22:17.051 INFO:teuthology.orchestra.run.smithi196.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-06-22T16:22:17.051 INFO:teuthology.orchestra.run.smithi196.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-06-22T16:22:17.051 INFO:teuthology.orchestra.run.smithi196.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-06-22T16:22:17.052 INFO:teuthology.orchestra.run.smithi196.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-22T16:22:17.053 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages will be upgraded: 2023-06-22T16:22:17.054 INFO:teuthology.orchestra.run.smithi196.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-06-22T16:22:17.111 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-22T16:22:17.129 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../22-usb-modeswitch-data_20191128-3_all.deb ... 2023-06-22T16:22:17.178 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-06-22T16:22:17.255 INFO:teuthology.orchestra.run.smithi196.stdout:4 upgraded, 23 newly installed, 0 to remove and 201 not upgraded. 2023-06-22T16:22:17.255 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 10.2 MB of archives. 2023-06-22T16:22:17.255 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-06-22T16:22:17.255 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-06-22T16:22:17.556 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-22T16:22:17.573 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../23-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-06-22T16:22:17.624 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-22T16:22:17.874 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-06-22T16:22:17.876 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-06-22T16:22:17.877 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-06-22T16:22:17.940 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-22T16:22:17.976 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-06-22T16:22:17.977 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-06-22T16:22:17.985 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-06-22T16:22:17.990 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-06-22T16:22:17.990 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-06-22T16:22:17.994 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-06-22T16:22:17.997 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-06-22T16:22:18.167 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-06-22T16:22:18.220 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-06-22T16:22:18.250 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-06-22T16:22:18.346 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-06-22T16:22:18.505 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-22T16:22:18.540 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-06-22T16:22:18.546 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-06-22T16:22:18.665 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-06-22T16:22:18.755 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-06-22T16:22:18.755 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-06-22T16:22:18.854 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-06-22T16:22:18.854 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-06-22T16:22:18.885 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-06-22T16:22:18.896 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-22T16:22:18.896 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-22T16:22:18.919 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-06-22T16:22:19.220 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-06-22T16:22:19.360 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-06-22T16:22:19.461 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-06-22T16:22:19.587 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-22T16:22:19.708 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-06-22T16:22:19.713 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-06-22T16:22:19.715 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-06-22T16:22:19.721 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-06-22T16:22:19.727 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-06-22T16:22:19.839 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-22T16:22:19.990 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-22T16:22:20.065 INFO:teuthology.orchestra.run.smithi196.stdout:Preconfiguring packages ... 2023-06-22T16:22:20.116 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-22T16:22:20.210 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 10.2 MB in 3s (3,801 kB/s) 2023-06-22T16:22:20.490 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-22T16:22:20.495 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-22T16:22:20.673 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-22T16:22:21.096 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-06-22T16:22:21.338 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up dump (0.4b46-6) ... 2023-06-22T16:22:21.450 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-22T16:22:21.507 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-22T16:22:21.633 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-22T16:22:21.759 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up indent (2.2.12-1) ... 2023-06-22T16:22:21.800 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-06-22T16:22:21.885 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-22T16:22:22.070 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-22T16:22:22.221 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-22T16:22:22.347 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-06-22T16:22:22.498 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-06-22T16:22:23.220 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:23.220 INFO:teuthology.orchestra.run.smithi149.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-22T16:22:23.221 INFO:teuthology.orchestra.run.smithi149.stdout:which means they are currently configured by ifupdown: 2023-06-22T16:22:23.221 INFO:teuthology.orchestra.run.smithi149.stdout:- enp3s0f1 2023-06-22T16:22:23.221 INFO:teuthology.orchestra.run.smithi149.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-22T16:22:23.221 INFO:teuthology.orchestra.run.smithi149.stdout:remove their configuration from /etc/network/interfaces. 2023-06-22T16:22:23.221 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:23.264 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-22T16:22:23.269 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-22T16:22:23.376 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-22T16:22:23.391 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-22T16:22:23.702 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-22T16:22:23.800 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-22T16:22:23.972 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-22T16:22:24.233 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-22T16:22:24.349 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-06-22T16:22:24.751 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-22T16:22:24.859 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-22T16:22:24.864 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-22T16:22:24.903 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-06-22T16:22:25.005 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-06-22T16:22:25.063 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-22T16:22:25.197 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-22T16:22:25.306 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-22T16:22:25.509 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-22T16:22:25.531 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-06-22T16:22:25.576 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-06-22T16:22:25.580 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-22T16:22:25.580 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-22T16:22:25.904 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package dump. 2023-06-22T16:22:25.924 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-06-22T16:22:25.962 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking dump (0.4b46-6) ... 2023-06-22T16:22:26.092 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-06-22T16:22:26.201 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-22T16:22:26.274 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package indent. 2023-06-22T16:22:26.290 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-06-22T16:22:26.327 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-22T16:22:26.332 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking indent (2.2.12-1) ... 2023-06-22T16:22:26.479 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-22T16:22:26.643 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-22T16:22:26.661 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-06-22T16:22:26.701 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-06-22T16:22:26.788 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-22T16:22:27.065 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-22T16:22:27.081 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-06-22T16:22:27.121 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-22T16:22:27.475 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-22T16:22:27.497 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-06-22T16:22:27.733 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-22T16:22:28.179 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-22T16:22:28.197 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-22T16:22:28.237 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-22T16:22:28.539 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-22T16:22:28.557 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-22T16:22:28.598 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-22T16:22:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-22T16:22:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-22T16:22:28.984 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-22T16:22:29.378 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-22T16:22:29.396 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-06-22T16:22:29.436 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-22T16:22:29.756 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-22T16:22:29.780 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-22T16:22:29.831 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-22T16:22:30.234 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-22T16:22:30.251 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../12-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-22T16:22:30.292 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-22T16:22:30.632 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-06-22T16:22:30.636 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-22T16:22:30.655 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../13-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-22T16:22:30.694 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-22T16:22:30.733 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-22T16:22:30.939 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-22T16:22:30.955 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../14-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-22T16:22:30.997 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-22T16:22:31.500 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-22T16:22:31.520 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../15-libteamdctl0_1.30-1_amd64.deb ... 2023-06-22T16:22:31.559 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-06-22T16:22:31.594 INFO:teuthology.orchestra.run.smithi149.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-22T16:22:31.597 DEBUG:teuthology.parallel:result is None 2023-06-22T16:22:31.962 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package modemmanager. 2023-06-22T16:22:31.980 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../16-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-22T16:22:32.030 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-22T16:22:32.659 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package wpasupplicant. 2023-06-22T16:22:32.677 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../17-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-06-22T16:22:32.717 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-22T16:22:33.533 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package network-manager. 2023-06-22T16:22:33.549 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../18-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-22T16:22:33.616 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-06-22T16:22:34.365 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ppp. 2023-06-22T16:22:34.381 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../19-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-06-22T16:22:34.649 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-22T16:22:35.003 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package pptp-linux. 2023-06-22T16:22:35.021 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../20-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-06-22T16:22:35.061 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-06-22T16:22:35.431 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-22T16:22:35.449 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../21-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-06-22T16:22:35.531 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-06-22T16:22:35.784 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-22T16:22:35.801 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../22-usb-modeswitch-data_20191128-3_all.deb ... 2023-06-22T16:22:35.842 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-06-22T16:22:36.245 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-22T16:22:36.262 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../23-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-06-22T16:22:36.314 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-22T16:22:36.616 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-22T16:22:36.950 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-06-22T16:22:37.060 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-06-22T16:22:37.161 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-22T16:22:37.525 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-22T16:22:37.526 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-22T16:22:38.005 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-06-22T16:22:38.131 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-06-22T16:22:38.240 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-22T16:22:38.510 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-06-22T16:22:38.910 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-22T16:22:39.062 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-22T16:22:39.188 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-22T16:22:40.156 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-06-22T16:22:40.418 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up dump (0.4b46-6) ... 2023-06-22T16:22:40.514 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-22T16:22:40.579 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-22T16:22:40.705 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-22T16:22:40.847 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up indent (2.2.12-1) ... 2023-06-22T16:22:40.965 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-22T16:22:41.167 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-22T16:22:41.293 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-22T16:22:41.419 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-06-22T16:22:41.587 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-06-22T16:22:42.325 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:42.325 INFO:teuthology.orchestra.run.smithi196.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-22T16:22:42.326 INFO:teuthology.orchestra.run.smithi196.stdout:which means they are currently configured by ifupdown: 2023-06-22T16:22:42.326 INFO:teuthology.orchestra.run.smithi196.stdout:- enp3s0f1 2023-06-22T16:22:42.326 INFO:teuthology.orchestra.run.smithi196.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-22T16:22:42.326 INFO:teuthology.orchestra.run.smithi196.stdout:remove their configuration from /etc/network/interfaces. 2023-06-22T16:22:42.326 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:42.488 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-22T16:22:42.787 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-22T16:22:43.307 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-22T16:22:43.815 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-22T16:22:43.991 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-06-22T16:22:44.317 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-22T16:22:44.925 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-22T16:22:45.052 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-22T16:22:45.325 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-22T16:22:45.325 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-22T16:22:45.847 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-06-22T16:22:45.947 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-22T16:22:46.073 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-22T16:22:46.267 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-22T16:22:46.552 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-22T16:22:50.512 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-06-22T16:22:50.604 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-22T16:22:51.469 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-22T16:22:51.472 DEBUG:teuthology.parallel:result is None 2023-06-22T16:22:51.472 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-22T16:22:51.703 DEBUG:teuthology.orchestra.run.smithi149:> dpkg-query -W -f '${Version}' ceph 2023-06-22T16:22:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:17.2.6-719-g42ddc46e-1focal 2023-06-22T16:22:51.729 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-719-g42ddc46e-1focal 2023-06-22T16:22:51.729 INFO:teuthology.task.install:The correct ceph version 17.2.6-719-g42ddc46e-1focal is installed. 2023-06-22T16:22:51.729 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-22T16:22:52.028 DEBUG:teuthology.orchestra.run.smithi196:> dpkg-query -W -f '${Version}' ceph 2023-06-22T16:22:52.053 INFO:teuthology.orchestra.run.smithi196.stdout:17.2.6-719-g42ddc46e-1focal 2023-06-22T16:22:52.054 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-719-g42ddc46e-1focal 2023-06-22T16:22:52.054 INFO:teuthology.task.install:The correct ceph version 17.2.6-719-g42ddc46e-1focal is installed. 2023-06-22T16:22:52.054 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-22T16:22:52.055 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:22:52.055 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-22T16:22:52.072 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:22:52.073 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-22T16:22:52.089 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-22T16:22:52.090 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:22:52.090 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2023-06-22T16:22:52.130 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-22T16:22:52.143 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:22:52.143 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2023-06-22T16:22:52.163 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-22T16:22:52.174 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-22T16:22:52.175 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:22:52.175 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-22T16:22:52.191 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-22T16:22:52.201 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:22:52.202 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-22T16:22:52.232 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-22T16:22:52.243 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-22T16:22:52.244 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:22:52.244 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2023-06-22T16:22:52.260 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-22T16:22:52.274 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:22:52.274 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2023-06-22T16:22:52.290 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-22T16:22:52.348 INFO:teuthology.run_tasks:Running task ceph... 2023-06-22T16:22:52.423 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-22T16:22:52.424 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2023-06-22T16:22:52.426 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2023-06-22T16:22:52.441 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-22T16:22:52.442 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-22T16:22:52.485 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-22T16:22:52.503 INFO:tasks.ceph:Creating extra log directories... 2023-06-22T16:22:52.504 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-22T16:22:52.507 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-22T16:22:52.524 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-22T16:22:52.525 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-22T16:22:52.525 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-22T16:22:52.526 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:22:52.526 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-22T16:22:52.565 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-22T16:22:52.604 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:22:52.604 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-22T16:22:52.610 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-22T16:22:52.696 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-22T16:22:52.697 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-22T16:22:52.697 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787', 'branch': 'wip-yuri4-testing-2023-06-21-0846-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7311787', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2023-06-21-0846-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2023-06-21-0846-quincy', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9037, 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri4-testing-2023-06-21-0846-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c', 'targets': {'smithi149.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=', 'smithi196.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '076bbebc42a14f7d568aaa78eabb0038327bcb23', 'timestamp': '2023-06-22_15:25:25', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-22T16:22:52.698 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-22T16:22:52.700 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-22T16:22:52.707 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2023-06-22T16:22:52.749 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2023-06-22T16:22:52.766 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:22:52.766 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2023-06-22T16:22:52.773 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-22T16:22:52.773 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2023-06-22T16:22:52.779 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-22T16:22:52.779 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T16:22:52.780 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-06-22T16:22:52.780 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T16:22:52.780 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-06-22 16:18:24.551205175 +0000 2023-06-22T16:22:52.780 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-06-22 16:18:24.547205266 +0000 2023-06-22T16:22:52.780 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-06-22 16:18:24.547205266 +0000 2023-06-22T16:22:52.780 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-06-22T16:22:52.781 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-22T16:22:52.794 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-06-22T16:22:52.795 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-06-22T16:22:52.795 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000356912 s, 1.4 MB/s 2023-06-22T16:22:52.796 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-22T16:22:52.847 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2023-06-22T16:22:52.854 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-22T16:22:52.854 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T16:22:52.854 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-06-22T16:22:52.854 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T16:22:52.854 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-06-22 16:18:25.055193549 +0000 2023-06-22T16:22:52.855 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-06-22 16:18:25.051193641 +0000 2023-06-22T16:22:52.855 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-06-22 16:18:25.051193641 +0000 2023-06-22T16:22:52.855 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-06-22T16:22:52.855 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-22T16:22:52.867 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-06-22T16:22:52.867 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-06-22T16:22:52.868 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000377259 s, 1.4 MB/s 2023-06-22T16:22:52.868 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-22T16:22:52.919 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2023-06-22T16:22:52.926 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-22T16:22:52.927 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T16:22:52.927 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 374 Links: 1 2023-06-22T16:22:52.927 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T16:22:52.928 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-06-22 16:18:25.859175003 +0000 2023-06-22T16:22:52.928 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-06-22 16:18:25.539182385 +0000 2023-06-22T16:22:52.928 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-06-22 16:18:25.539182385 +0000 2023-06-22T16:22:52.929 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-06-22T16:22:52.929 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-22T16:22:52.943 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-06-22T16:22:52.943 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-06-22T16:22:52.943 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000396485 s, 1.3 MB/s 2023-06-22T16:22:52.944 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-22T16:22:52.996 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2023-06-22T16:22:53.003 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-22T16:22:53.004 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T16:22:53.004 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 380 Links: 1 2023-06-22T16:22:53.004 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T16:22:53.004 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-06-22 16:18:26.387162824 +0000 2023-06-22T16:22:53.004 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-06-22 16:18:26.095169559 +0000 2023-06-22T16:22:53.004 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-06-22 16:18:26.095169559 +0000 2023-06-22T16:22:53.005 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-06-22T16:22:53.005 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-22T16:22:53.018 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-06-22T16:22:53.018 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-06-22T16:22:53.018 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000363804 s, 1.4 MB/s 2023-06-22T16:22:53.019 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-22T16:22:53.027 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-22T16:22:53.028 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:22:53.028 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2023-06-22T16:22:53.036 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-22T16:22:53.036 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2023-06-22T16:22:53.045 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-22T16:22:53.045 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T16:22:53.045 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 360 Links: 1 2023-06-22T16:22:53.045 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T16:22:53.045 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2023-06-22 16:18:24.830423173 +0000 2023-06-22T16:22:53.046 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2023-06-22 16:18:24.530430091 +0000 2023-06-22T16:22:53.046 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2023-06-22 16:18:24.530430091 +0000 2023-06-22T16:22:53.046 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2023-06-22T16:22:53.046 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-22T16:22:53.103 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2023-06-22T16:22:53.104 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2023-06-22T16:22:53.104 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000440034 s, 1.2 MB/s 2023-06-22T16:22:53.105 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-22T16:22:53.114 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2023-06-22T16:22:53.164 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-22T16:22:53.164 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T16:22:53.165 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-06-22T16:22:53.165 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T16:22:53.165 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2023-06-22 16:18:25.330411641 +0000 2023-06-22T16:22:53.165 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2023-06-22 16:18:25.050418099 +0000 2023-06-22T16:22:53.165 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2023-06-22 16:18:25.050418099 +0000 2023-06-22T16:22:53.166 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2023-06-22T16:22:53.166 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-22T16:22:53.179 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2023-06-22T16:22:53.180 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2023-06-22T16:22:53.180 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000376858 s, 1.4 MB/s 2023-06-22T16:22:53.181 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-22T16:22:53.233 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2023-06-22T16:22:53.240 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-22T16:22:53.241 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T16:22:53.241 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 374 Links: 1 2023-06-22T16:22:53.241 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T16:22:53.241 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2023-06-22 16:18:25.838399927 +0000 2023-06-22T16:22:53.241 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2023-06-22 16:18:25.546406661 +0000 2023-06-22T16:22:53.241 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2023-06-22 16:18:25.546406661 +0000 2023-06-22T16:22:53.241 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2023-06-22T16:22:53.242 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-22T16:22:53.255 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2023-06-22T16:22:53.256 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2023-06-22T16:22:53.256 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000400112 s, 1.3 MB/s 2023-06-22T16:22:53.257 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-22T16:22:53.309 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2023-06-22T16:22:53.317 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-22T16:22:53.317 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T16:22:53.318 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 378 Links: 1 2023-06-22T16:22:53.318 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T16:22:53.318 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2023-06-22 16:18:26.386387290 +0000 2023-06-22T16:22:53.318 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2023-06-22 16:18:26.082394300 +0000 2023-06-22T16:22:53.318 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2023-06-22 16:18:26.082394300 +0000 2023-06-22T16:22:53.318 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2023-06-22T16:22:53.318 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-22T16:22:53.373 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2023-06-22T16:22:53.373 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2023-06-22T16:22:53.373 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000384838 s, 1.3 MB/s 2023-06-22T16:22:53.374 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-22T16:22:53.382 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-22T16:22:53.383 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-22T16:22:53.383 INFO:tasks.ceph:Generating config... 2023-06-22T16:22:53.384 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-22T16:22:53.385 INFO:tasks.ceph:[client] debug client = 20 2023-06-22T16:22:53.385 INFO:tasks.ceph:[client] debug ms = 1 2023-06-22T16:22:53.385 INFO:tasks.ceph:[client] pid file = 2023-06-22T16:22:53.385 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-22T16:22:53.385 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-22T16:22:53.386 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-22T16:22:53.386 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-22T16:22:53.386 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-22T16:22:53.386 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-22T16:22:53.387 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-22T16:22:53.387 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-22T16:22:53.387 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-22T16:22:53.387 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-22T16:22:53.388 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-22T16:22:53.388 INFO:tasks.ceph:[mgr] debug client = 20 2023-06-22T16:22:53.388 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-06-22T16:22:53.388 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-22T16:22:53.389 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-22T16:22:53.389 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-22T16:22:53.389 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-22T16:22:53.389 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-22T16:22:53.390 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-22T16:22:53.390 INFO:tasks.ceph:[osd] bdev async discard = True 2023-06-22T16:22:53.390 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-06-22T16:22:53.390 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-06-22T16:22:53.390 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-22T16:22:53.391 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-22T16:22:53.391 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-06-22T16:22:53.391 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-06-22T16:22:53.391 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-22T16:22:53.392 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-22T16:22:53.392 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-06-22T16:22:53.393 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-22T16:22:53.393 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-22T16:22:53.394 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-22T16:22:53.394 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-22T16:22:53.394 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-22T16:22:53.395 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-22T16:22:53.395 INFO:tasks.ceph:Setting up mon.a... 2023-06-22T16:22:53.396 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-22T16:22:53.432 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.keyring 2023-06-22T16:22:53.434 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-22T16:22:53.467 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-22T16:22:53.527 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.149'), ('mon.b', '172.21.15.196'), ('mon.c', '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]')] 2023-06-22T16:22:53.528 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.149,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-22T16:22:53.529 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:22:53.529 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-22T16:22:53.536 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.149 --add b 172.21.15.196 --addv c '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:22:53.575 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:22:53.575 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: generated fsid 0dba7f42-2446-45e3-aae5-b3ca874cf325 2023-06-22T16:22:53.576 INFO:teuthology.orchestra.run.smithi149.stdout:setting min_mon_release = octopus 2023-06-22T16:22:53.576 INFO:teuthology.orchestra.run.smithi149.stdout:epoch 0 2023-06-22T16:22:53.576 INFO:teuthology.orchestra.run.smithi149.stdout:fsid 0dba7f42-2446-45e3-aae5-b3ca874cf325 2023-06-22T16:22:53.576 INFO:teuthology.orchestra.run.smithi149.stdout:last_changed 2023-06-22T16:22:53.571243+0000 2023-06-22T16:22:53.576 INFO:teuthology.orchestra.run.smithi149.stdout:created 2023-06-22T16:22:53.571243+0000 2023-06-22T16:22:53.576 INFO:teuthology.orchestra.run.smithi149.stdout:min_mon_release 15 (octopus) 2023-06-22T16:22:53.576 INFO:teuthology.orchestra.run.smithi149.stdout:election_strategy: 1 2023-06-22T16:22:53.577 INFO:teuthology.orchestra.run.smithi149.stdout:0: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.a 2023-06-22T16:22:53.577 INFO:teuthology.orchestra.run.smithi149.stdout:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2023-06-22T16:22:53.577 INFO:teuthology.orchestra.run.smithi149.stdout:2: [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] mon.c 2023-06-22T16:22:53.577 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-22T16:22:53.578 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-22T16:22:53.582 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0dba7f42-2446-45e3-aae5-b3ca874cf325... 2023-06-22T16:22:53.583 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-22T16:22:53.586 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-22T16:22:53.617 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2023-06-22T16:22:53.617 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2023-06-22T16:22:53.617 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-22T16:22:53.617 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2023-06-22T16:22:53.618 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.618 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2023-06-22T16:22:53.618 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.618 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2023-06-22T16:22:53.618 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.618 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2023-06-22T16:22:53.618 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2023-06-22T16:22:53.618 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.619 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2023-06-22T16:22:53.619 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2023-06-22T16:22:53.619 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.619 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-22T16:22:53.619 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2023-06-22T16:22:53.619 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.619 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2023-06-22T16:22:53.620 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-22T16:22:53.620 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.620 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2023-06-22T16:22:53.620 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.620 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2023-06-22T16:22:53.620 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2023-06-22T16:22:53.620 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2023-06-22T16:22:53.620 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2023-06-22T16:22:53.621 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2023-06-22T16:22:53.621 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2023-06-22T16:22:53.621 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2023-06-22T16:22:53.621 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-22T16:22:53.621 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-22T16:22:53.621 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2023-06-22T16:22:53.621 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.622 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-22T16:22:53.622 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.622 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2023-06-22T16:22:53.622 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.622 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2023-06-22T16:22:53.622 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.622 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2023-06-22T16:22:53.622 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2023-06-22T16:22:53.623 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2023-06-22T16:22:53.623 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.149,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2023-06-22T16:22:53.623 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = 0dba7f42-2446-45e3-aae5-b3ca874cf325 2023-06-22T16:22:53.623 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.623 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2023-06-22T16:22:53.623 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2023-06-22T16:22:53.623 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.623 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2023-06-22T16:22:53.624 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2023-06-22T16:22:53.624 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2023-06-22T16:22:53.624 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.624 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2023-06-22T16:22:53.624 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2023-06-22T16:22:53.624 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.624 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2023-06-22T16:22:53.624 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2023-06-22T16:22:53.625 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2023-06-22T16:22:53.625 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.625 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2023-06-22T16:22:53.625 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2023-06-22T16:22:53.625 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.625 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2023-06-22T16:22:53.625 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.625 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2023-06-22T16:22:53.626 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.626 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2023-06-22T16:22:53.626 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.626 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2023-06-22T16:22:53.626 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2023-06-22T16:22:53.626 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.626 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2023-06-22T16:22:53.627 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2023-06-22T16:22:53.627 INFO:teuthology.orchestra.run.smithi149.stdout: bdev async discard = True 2023-06-22T16:22:53.627 INFO:teuthology.orchestra.run.smithi149.stdout: bdev enable discard = True 2023-06-22T16:22:53.627 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore allocator = bitmap 2023-06-22T16:22:53.627 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2023-06-22T16:22:53.627 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2023-06-22T16:22:53.627 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 1/20 2023-06-22T16:22:53.627 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 1/20 2023-06-22T16:22:53.628 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-22T16:22:53.628 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2023-06-22T16:22:53.628 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 4/10 2023-06-22T16:22:53.628 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2023-06-22T16:22:53.628 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2023-06-22T16:22:53.628 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2023-06-22T16:22:53.628 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2023-06-22T16:22:53.628 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2023-06-22T16:22:53.629 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-06-22T16:22:53.629 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.629 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2023-06-22T16:22:53.629 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-22T16:22:53.629 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2023-06-22T16:22:53.629 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-06-22T16:22:53.629 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-06-22T16:22:53.629 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-06-22T16:22:53.630 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-06-22T16:22:53.630 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2023-06-22T16:22:53.630 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2023-06-22T16:22:53.630 INFO:teuthology.orchestra.run.smithi149.stdout: debug finisher = 20 2023-06-22T16:22:53.630 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.630 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2023-06-22T16:22:53.630 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-22T16:22:53.630 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-06-22T16:22:53.631 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2023-06-22T16:22:53.631 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-06-22T16:22:53.631 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2023-06-22T16:22:53.631 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2023-06-22T16:22:53.631 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-06-22T16:22:53.631 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2023-06-22T16:22:53.631 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2023-06-22T16:22:53.631 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-06-22T16:22:53.632 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.632 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-22T16:22:53.632 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2023-06-22T16:22:53.632 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2023-06-22T16:22:53.632 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.632 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2023-06-22T16:22:53.632 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-22T16:22:53.632 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-22T16:22:53.633 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.633 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2023-06-22T16:22:53.633 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2023-06-22T16:22:53.633 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.633 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2023-06-22T16:22:53.633 INFO:teuthology.orchestra.run.smithi149.stdout: mon op complaint time = 120 2023-06-22T16:22:53.633 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:22:53.633 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2023-06-22T16:22:53.634 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2023-06-22T16:22:53.634 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2023-06-22T16:22:53.634 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2023-06-22T16:22:53.634 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-22T16:22:53.634 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-22T16:22:53.634 INFO:teuthology.orchestra.run.smithi149.stdout: client mount timeout = 600 2023-06-22T16:22:53.634 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2023-06-22T16:22:53.635 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-22T16:22:53.635 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = "" 2023-06-22T16:22:53.635 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-06-22T16:22:53.635 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-06-22T16:22:53.635 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2023-06-22T16:22:53.635 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2023-06-22T16:22:53.635 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2023-06-22T16:22:53.635 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2023-06-22T16:22:53.636 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2023-06-22T16:22:53.636 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2023-06-22T16:22:53.636 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2023-06-22T16:22:53.636 INFO:teuthology.orchestra.run.smithi149.stdout:[mds] 2023-06-22T16:22:53.636 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds = 20 2023-06-22T16:22:53.636 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-22T16:22:53.636 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug frag = True 2023-06-22T16:22:53.636 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug scatterstat = True 2023-06-22T16:22:53.637 INFO:teuthology.orchestra.run.smithi149.stdout: mds op complaint time = 180 2023-06-22T16:22:53.637 INFO:teuthology.orchestra.run.smithi149.stdout: mds verify scatter = True 2023-06-22T16:22:53.637 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-06-22T16:22:53.637 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-06-22T16:22:53.637 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-06-22T16:22:53.638 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2023-06-22T16:22:53.639 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2023-06-22T16:22:53.639 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-22T16:22:53.639 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2023-06-22T16:22:53.639 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.639 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2023-06-22T16:22:53.639 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.639 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2023-06-22T16:22:53.640 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.640 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2023-06-22T16:22:53.640 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2023-06-22T16:22:53.640 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.640 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2023-06-22T16:22:53.640 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2023-06-22T16:22:53.640 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.641 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-22T16:22:53.641 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2023-06-22T16:22:53.641 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.641 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2023-06-22T16:22:53.641 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-22T16:22:53.641 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.641 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2023-06-22T16:22:53.641 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2023-06-22T16:22:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2023-06-22T16:22:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2023-06-22T16:22:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2023-06-22T16:22:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2023-06-22T16:22:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2023-06-22T16:22:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2023-06-22T16:22:53.642 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-22T16:22:53.643 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-22T16:22:53.643 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2023-06-22T16:22:53.643 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.643 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-22T16:22:53.643 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.643 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2023-06-22T16:22:53.643 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.643 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2023-06-22T16:22:53.644 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.644 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2023-06-22T16:22:53.644 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2023-06-22T16:22:53.644 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2023-06-22T16:22:53.644 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = "172.21.15.149,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2023-06-22T16:22:53.644 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = 0dba7f42-2446-45e3-aae5-b3ca874cf325 2023-06-22T16:22:53.644 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.645 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2023-06-22T16:22:53.645 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2023-06-22T16:22:53.645 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.645 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2023-06-22T16:22:53.645 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2023-06-22T16:22:53.645 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock profile = high_recovery_ops 2023-06-22T16:22:53.645 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.645 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2023-06-22T16:22:53.646 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2023-06-22T16:22:53.646 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.646 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2023-06-22T16:22:53.646 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2023-06-22T16:22:53.646 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2023-06-22T16:22:53.646 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.646 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2023-06-22T16:22:53.646 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2023-06-22T16:22:53.647 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.647 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2023-06-22T16:22:53.647 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.647 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2023-06-22T16:22:53.647 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.647 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2023-06-22T16:22:53.647 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.647 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2023-06-22T16:22:53.648 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2023-06-22T16:22:53.648 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.648 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2023-06-22T16:22:53.648 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2023-06-22T16:22:53.648 INFO:teuthology.orchestra.run.smithi196.stdout: bdev async discard = True 2023-06-22T16:22:53.648 INFO:teuthology.orchestra.run.smithi196.stdout: bdev enable discard = True 2023-06-22T16:22:53.648 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore allocator = bitmap 2023-06-22T16:22:53.649 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2023-06-22T16:22:53.649 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2023-06-22T16:22:53.649 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 1/20 2023-06-22T16:22:53.649 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 1/20 2023-06-22T16:22:53.649 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2023-06-22T16:22:53.649 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2023-06-22T16:22:53.649 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 4/10 2023-06-22T16:22:53.649 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2023-06-22T16:22:53.650 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2023-06-22T16:22:53.650 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2023-06-22T16:22:53.650 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2023-06-22T16:22:53.650 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2023-06-22T16:22:53.650 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2023-06-22T16:22:53.650 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.650 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2023-06-22T16:22:53.650 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2023-06-22T16:22:53.651 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2023-06-22T16:22:53.651 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2023-06-22T16:22:53.651 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2023-06-22T16:22:53.651 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2023-06-22T16:22:53.651 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2023-06-22T16:22:53.651 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2023-06-22T16:22:53.651 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2023-06-22T16:22:53.651 INFO:teuthology.orchestra.run.smithi196.stdout: debug finisher = 20 2023-06-22T16:22:53.652 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.652 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2023-06-22T16:22:53.652 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2023-06-22T16:22:53.652 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2023-06-22T16:22:53.652 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2023-06-22T16:22:53.652 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2023-06-22T16:22:53.652 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2023-06-22T16:22:53.652 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2023-06-22T16:22:53.653 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2023-06-22T16:22:53.653 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2023-06-22T16:22:53.653 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2023-06-22T16:22:53.653 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2023-06-22T16:22:53.653 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.653 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-22T16:22:53.653 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2023-06-22T16:22:53.653 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2023-06-22T16:22:53.654 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.654 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2023-06-22T16:22:53.654 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-22T16:22:53.654 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-22T16:22:53.654 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.654 INFO:teuthology.orchestra.run.smithi196.stdout: # 1m isn't quite enough 2023-06-22T16:22:53.654 INFO:teuthology.orchestra.run.smithi196.stdout: mon_down_mkfs_grace = 2m 2023-06-22T16:22:53.654 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.655 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_filestore_osds = false 2023-06-22T16:22:53.655 INFO:teuthology.orchestra.run.smithi196.stdout: mon op complaint time = 120 2023-06-22T16:22:53.655 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-06-22T16:22:53.655 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2023-06-22T16:22:53.655 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2023-06-22T16:22:53.655 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2023-06-22T16:22:53.655 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2023-06-22T16:22:53.655 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-22T16:22:53.656 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-22T16:22:53.656 INFO:teuthology.orchestra.run.smithi196.stdout: client mount timeout = 600 2023-06-22T16:22:53.656 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2023-06-22T16:22:53.656 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2023-06-22T16:22:53.656 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = "" 2023-06-22T16:22:53.656 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2023-06-22T16:22:53.656 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2023-06-22T16:22:53.657 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2023-06-22T16:22:53.657 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.b] 2023-06-22T16:22:53.657 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.c] 2023-06-22T16:22:53.657 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2023-06-22T16:22:53.657 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2023-06-22T16:22:53.657 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2023-06-22T16:22:53.657 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2023-06-22T16:22:53.657 INFO:teuthology.orchestra.run.smithi196.stdout:[mds] 2023-06-22T16:22:53.658 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds = 20 2023-06-22T16:22:53.658 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2023-06-22T16:22:53.658 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug frag = True 2023-06-22T16:22:53.658 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug scatterstat = True 2023-06-22T16:22:53.658 INFO:teuthology.orchestra.run.smithi196.stdout: mds op complaint time = 180 2023-06-22T16:22:53.658 INFO:teuthology.orchestra.run.smithi196.stdout: mds verify scatter = True 2023-06-22T16:22:53.659 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2023-06-22T16:22:53.659 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2023-06-22T16:22:53.659 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2023-06-22T16:22:53.659 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-22T16:22:53.660 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-22T16:22:53.726 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-22T16:22:53.726 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:22:53.727 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-22T16:22:53.733 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:22:53.734 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-22T16:22:53.741 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2023-06-22T16:22:53.741 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:22:53.742 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-22T16:22:53.742 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-22T16:22:53.813 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:22:53.813 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:22:53.819 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2023-06-22T16:22:53.820 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:22:53.820 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-22T16:22:53.820 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-22T16:22:53.849 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:22:53.850 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:22:53.857 INFO:tasks.ceph:Setting up mon nodes... 2023-06-22T16:22:53.857 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-22T16:22:53.857 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-22T16:22:53.900 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-22T16:22:53.902 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-22T16:22:53.946 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-22T16:22:53.948 INFO:tasks.ceph:Setting up mds nodes... 2023-06-22T16:22:53.949 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-22T16:22:53.993 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-22T16:22:53.995 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-22T16:22:54.053 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-22T16:22:54.097 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-22T16:22:54.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-22T16:22:54.115 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-22T16:22:54.164 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-22T16:22:54.167 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-22T16:22:54.180 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-22T16:22:54.220 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-22T16:22:54.222 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-22T16:22:54.281 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-22T16:22:54.282 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-22T16:22:54.317 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-22T16:22:54.331 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-22T16:22:54.411 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-22T16:22:54.424 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-22T16:22:54.462 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-22T16:22:54.475 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-22T16:22:54.507 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-22T16:22:54.520 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-22T16:22:54.521 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-22T16:22:54.521 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-22T16:22:54.539 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-22T16:22:54.540 INFO:tasks.ceph:role: osd.0 2023-06-22T16:22:54.540 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-22T16:22:54.541 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-22T16:22:55.110 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T16:22:55.111 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T16:22:55.111 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T16:22:55.111 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2023-06-22T16:22:55.112 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T16:22:55.112 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-06-22T16:22:55.112 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T16:22:55.112 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T16:22:55.113 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T16:22:55.113 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T16:22:55.114 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-06-22T16:22:55.115 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-22T16:22:55.196 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-22T16:22:55.207 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2023-06-22T16:22:55.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T16:22:55.209 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-22T16:22:55.268 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-22T16:22:55.268 INFO:tasks.ceph:role: osd.1 2023-06-22T16:22:55.269 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-22T16:22:55.269 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-22T16:22:55.782 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T16:22:55.783 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T16:22:55.783 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T16:22:55.783 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2023-06-22T16:22:55.783 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T16:22:55.783 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-06-22T16:22:55.783 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T16:22:55.784 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T16:22:55.784 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T16:22:55.784 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T16:22:55.785 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-06-22T16:22:55.786 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-22T16:22:55.824 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-22T16:22:55.836 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2023-06-22T16:22:55.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T16:22:55.837 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-22T16:22:55.846 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-22T16:22:55.847 INFO:tasks.ceph:role: osd.2 2023-06-22T16:22:55.847 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-22T16:22:55.847 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-22T16:22:56.358 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T16:22:56.358 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T16:22:56.358 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T16:22:56.359 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2023-06-22T16:22:56.359 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T16:22:56.359 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-06-22T16:22:56.359 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T16:22:56.359 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T16:22:56.359 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T16:22:56.359 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T16:22:56.360 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-06-22T16:22:56.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-22T16:22:56.414 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-22T16:22:56.425 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2023-06-22T16:22:56.426 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T16:22:56.426 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-22T16:22:56.441 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-22T16:22:56.442 INFO:tasks.ceph:role: osd.3 2023-06-22T16:22:56.442 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-22T16:22:56.442 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-22T16:22:57.001 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T16:22:57.001 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T16:22:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T16:22:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2023-06-22T16:22:57.002 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T16:22:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-06-22T16:22:57.002 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T16:22:57.002 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T16:22:57.002 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T16:22:57.003 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T16:22:57.003 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-06-22T16:22:57.004 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-22T16:22:57.074 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-22T16:22:57.085 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2023-06-22T16:22:57.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T16:22:57.087 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:22:57.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:22:57.137+0000 7f4cc3f973c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-22T16:22:57.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:22:57.137+0000 7f4cc3f973c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-22T16:22:57.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:22:57.137+0000 7f4cc3f973c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-22T16:22:57.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:22:57.137+0000 7f4cc3f973c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-22T16:22:57.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:22:57.137+0000 7f4cc3f973c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-22T16:22:57.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:22:57.145+0000 7f4cc3f973c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-22T16:22:57.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:22:57.949+0000 7f4cc3f973c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:22:58.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:22:58.737+0000 7f4cc3f973c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:22:59.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:22:59.521+0000 7f4cc3f973c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:00.388 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-22T16:23:00.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:23:00.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:00.433+0000 7fd2fc3ba3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-22T16:23:00.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:00.433+0000 7fd2fc3ba3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-22T16:23:00.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:00.433+0000 7fd2fc3ba3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-22T16:23:00.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:00.433+0000 7fd2fc3ba3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-22T16:23:00.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:00.433+0000 7fd2fc3ba3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-22T16:23:00.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:00.433+0000 7fd2fc3ba3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-22T16:23:00.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:00.989+0000 7fd2fc3ba3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:01.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:01.773+0000 7fd2fc3ba3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:02.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:02.557+0000 7fd2fc3ba3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:03.424 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-22T16:23:03.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:23:03.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:03.465+0000 7f8a6c93a3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-22T16:23:03.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:03.469+0000 7f8a6c93a3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-22T16:23:03.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:03.469+0000 7f8a6c93a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-22T16:23:03.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:03.469+0000 7f8a6c93a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-22T16:23:03.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:03.469+0000 7f8a6c93a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-22T16:23:03.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:03.469+0000 7f8a6c93a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-22T16:23:04.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:04.029+0000 7f8a6c93a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:04.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:04.829+0000 7f8a6c93a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:05.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:05.601+0000 7f8a6c93a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:06.467 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-22T16:23:06.527 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:23:06.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:06.557+0000 7f9675abb3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-22T16:23:06.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:06.557+0000 7f9675abb3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-22T16:23:06.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:06.557+0000 7f9675abb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-22T16:23:06.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:06.557+0000 7f9675abb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-22T16:23:06.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:06.557+0000 7f9675abb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-22T16:23:06.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:06.557+0000 7f9675abb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-22T16:23:07.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:07.109+0000 7f9675abb3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:07.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:07.889+0000 7f9675abb3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:08.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:08.673+0000 7f9675abb3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:09.527 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-22T16:23:09.544 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-22T16:23:09.560 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-22T16:23:09.561 INFO:tasks.ceph:role: osd.4 2023-06-22T16:23:09.561 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2023-06-22T16:23:09.561 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-22T16:23:10.090 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T16:23:10.090 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T16:23:10.090 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T16:23:10.091 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 2023-06-22T16:23:10.091 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T16:23:10.091 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2023-06-22T16:23:10.091 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T16:23:10.091 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T16:23:10.091 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T16:23:10.091 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T16:23:10.093 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2023-06-22T16:23:10.093 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-22T16:23:10.191 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-22T16:23:10.203 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2023-06-22T16:23:10.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T16:23:10.205 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-22T16:23:10.264 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-22T16:23:10.264 INFO:tasks.ceph:role: osd.5 2023-06-22T16:23:10.264 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2023-06-22T16:23:10.265 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-22T16:23:10.763 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T16:23:10.763 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T16:23:10.763 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T16:23:10.763 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 2023-06-22T16:23:10.764 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T16:23:10.764 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2023-06-22T16:23:10.764 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T16:23:10.764 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T16:23:10.764 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T16:23:10.764 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T16:23:10.765 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2023-06-22T16:23:10.765 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-22T16:23:10.803 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-22T16:23:10.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T16:23:10.814 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2023-06-22T16:23:10.815 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-22T16:23:10.825 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-22T16:23:10.825 INFO:tasks.ceph:role: osd.6 2023-06-22T16:23:10.825 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2023-06-22T16:23:10.825 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-22T16:23:11.306 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T16:23:11.306 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T16:23:11.306 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T16:23:11.307 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 2023-06-22T16:23:11.307 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T16:23:11.307 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2023-06-22T16:23:11.308 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T16:23:11.308 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T16:23:11.308 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T16:23:11.308 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T16:23:11.309 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2023-06-22T16:23:11.309 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-22T16:23:11.362 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-22T16:23:11.375 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2023-06-22T16:23:11.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T16:23:11.376 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-22T16:23:11.386 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-22T16:23:11.386 INFO:tasks.ceph:role: osd.7 2023-06-22T16:23:11.386 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com 2023-06-22T16:23:11.387 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-22T16:23:11.888 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T16:23:11.889 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T16:23:11.889 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T16:23:11.889 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 2023-06-22T16:23:11.889 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T16:23:11.889 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2023-06-22T16:23:11.889 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T16:23:11.889 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T16:23:11.890 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T16:23:11.890 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T16:23:11.891 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2023-06-22T16:23:11.891 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-22T16:23:11.952 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-22T16:23:11.964 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2023-06-22T16:23:11.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T16:23:11.966 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:23:12.082 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:12.075+0000 7ff0050953c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-22T16:23:12.084 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:12.075+0000 7ff0050953c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-22T16:23:12.084 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:12.075+0000 7ff0050953c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-22T16:23:12.085 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:12.075+0000 7ff0050953c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-22T16:23:12.085 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:12.075+0000 7ff0050953c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-22T16:23:12.091 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:12.083+0000 7ff0050953c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-22T16:23:12.897 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:12.891+0000 7ff0050953c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:13.677 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:13.671+0000 7ff0050953c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:14.456 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:14.447+0000 7ff0050953c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:15.310 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-22T16:23:15.326 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:23:15.361 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:15.351+0000 7fc6346b03c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-22T16:23:15.361 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:15.355+0000 7fc6346b03c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-22T16:23:15.361 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:15.355+0000 7fc6346b03c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-22T16:23:15.361 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:15.355+0000 7fc6346b03c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-22T16:23:15.362 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:15.355+0000 7fc6346b03c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-22T16:23:15.362 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:15.355+0000 7fc6346b03c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-22T16:23:15.923 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:15.915+0000 7fc6346b03c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:16.706 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:16.699+0000 7fc6346b03c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:17.483 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:17.475+0000 7fc6346b03c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:18.361 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-22T16:23:18.373 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:23:18.459 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:18.450+0000 7f80d6f8c3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-22T16:23:18.460 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:18.450+0000 7f80d6f8c3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-22T16:23:18.460 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:18.450+0000 7f80d6f8c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-22T16:23:18.460 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:18.450+0000 7f80d6f8c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-22T16:23:18.460 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:18.450+0000 7f80d6f8c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-22T16:23:18.461 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:18.450+0000 7f80d6f8c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-22T16:23:19.026 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:19.018+0000 7f80d6f8c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:19.806 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:19.798+0000 7f80d6f8c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:20.584 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:20.574+0000 7f80d6f8c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:21.453 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-22T16:23:21.468 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:23:21.504 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:21.494+0000 7f323402a3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-22T16:23:21.505 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:21.494+0000 7f323402a3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-22T16:23:21.505 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:21.494+0000 7f323402a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-22T16:23:21.505 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:21.498+0000 7f323402a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-22T16:23:21.505 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:21.498+0000 7f323402a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-22T16:23:21.506 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:21.498+0000 7f323402a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-22T16:23:22.061 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:22.054+0000 7f323402a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:22.699 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:23:22.702 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:23:22.856 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:22.846+0000 7f323402a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:23.636 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:23.626+0000 7f323402a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-22T16:23:24.496 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-22T16:23:24.510 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-22T16:23:24.511 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:23:24.511 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-22T16:23:24.527 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:23:24.527 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-22T16:23:24.537 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:23:24.538 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-22T16:23:24.594 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:23:24.595 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-22T16:23:24.605 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:23:24.606 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-22T16:23:24.618 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:23:24.618 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-22T16:23:24.675 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:23:24.675 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-22T16:23:24.686 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:23:24.686 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-22T16:23:24.702 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:23:24.702 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-22T16:23:24.762 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:23:24.762 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-22T16:23:24.777 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:23:24.777 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-22T16:23:24.793 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:23:24.794 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-22T16:23:24.807 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:23:24.807 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-22T16:23:24.817 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:23:24.818 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-22T16:23:24.831 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:23:24.831 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-22T16:23:24.838 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:23:24.838 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-22T16:23:24.885 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:23:24.885 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-22T16:23:24.892 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:23:24.892 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-22T16:23:24.938 INFO:tasks.ceph:Adding keys to all mons... 2023-06-22T16:23:24.939 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-22T16:23:24.941 DEBUG:teuthology.orchestra.run.smithi196:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-22T16:23:24.952 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.y] 2023-06-22T16:23:24.953 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBddZRkGv5oNRAADcXORLy5FdWevZjKC76MHA== 2023-06-22T16:23:24.953 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2023-06-22T16:23:24.953 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBddZRkvp37OhAAC/k1Wj5zgqsXyLdqOsBqVQ== 2023-06-22T16:23:24.953 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2023-06-22T16:23:24.953 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBedZRkDbmSBRAAIzKI+bEaIEqc08b45+Bc/Q== 2023-06-22T16:23:24.953 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.0] 2023-06-22T16:23:24.954 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBhdZRk+195CBAAW9R3+/Kab4sf7hprtTPjwQ== 2023-06-22T16:23:24.954 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.1] 2023-06-22T16:23:24.954 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBkdZRkmv0QGhAAU7fgtBC0NEEPHshQTmEnRA== 2023-06-22T16:23:24.955 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.2] 2023-06-22T16:23:24.955 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBndZRk5SAXHBAA2w69nI++xC5aytUGgxu3PQ== 2023-06-22T16:23:24.955 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.3] 2023-06-22T16:23:24.955 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBqdZRkmWVjIRAA4MsUsqwrR4rgvBZePvs9cQ== 2023-06-22T16:23:24.955 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.x] 2023-06-22T16:23:24.955 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBddZRkX3UqOBAACztV5ZWkcSWJqXQZxziedA== 2023-06-22T16:23:24.955 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2023-06-22T16:23:24.955 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBedZRkrLOXCRAAyjE4qan//rkWNw2Gvy7rAg== 2023-06-22T16:23:24.956 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2023-06-22T16:23:24.956 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBedZRkaj3mDBAABaE4EQX/tZi+D01eh4oR1A== 2023-06-22T16:23:24.956 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.4] 2023-06-22T16:23:24.956 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBwdZRkV0ipBBAAo0p3wXa+EOXF/ZF+eAzdcA== 2023-06-22T16:23:24.956 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.5] 2023-06-22T16:23:24.956 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBzdZRkVHJJFRAAIlsb9QWC3XuTCKdFHVFf5Q== 2023-06-22T16:23:24.956 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.6] 2023-06-22T16:23:24.957 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQB2dZRkdwwmGxAAEe4wk7ScTAJRZROUX15KjQ== 2023-06-22T16:23:24.957 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.7] 2023-06-22T16:23:24.957 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQB5dZRk+nXZHRAAoyOY9b2P4wHYr4thFgevag== 2023-06-22T16:23:24.957 INFO:teuthology.orchestra.run.smithi196.stdout:[client.0] 2023-06-22T16:23:24.957 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBedZRkpOKzEhAAbk19TM3lR1kDci7aSQncNQ== 2023-06-22T16:23:24.957 INFO:teuthology.orchestra.run.smithi196.stdout:[client.2] 2023-06-22T16:23:24.957 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBedZRklgZOGBAAJZ87LW9zv7H+MYx8UVplKA== 2023-06-22T16:23:24.958 INFO:teuthology.orchestra.run.smithi196.stdout:[client.1] 2023-06-22T16:23:24.958 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBedZRkTA9WGxAAfkkOokp4VAb1bpw/SiCwQw== 2023-06-22T16:23:24.958 INFO:teuthology.orchestra.run.smithi196.stdout:[client.3] 2023-06-22T16:23:24.958 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBedZRkmjwGHhAAUMSk7bszFGLvl2KdhpgT+g== 2023-06-22T16:23:24.959 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2023-06-22T16:23:24.959 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBddZRkGv5oNRAADcXORLy5FdWevZjKC76MHA== 2023-06-22T16:23:24.959 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2023-06-22T16:23:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBddZRkvp37OhAAC/k1Wj5zgqsXyLdqOsBqVQ== 2023-06-22T16:23:24.960 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2023-06-22T16:23:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBedZRkDbmSBRAAIzKI+bEaIEqc08b45+Bc/Q== 2023-06-22T16:23:24.960 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2023-06-22T16:23:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBhdZRk+195CBAAW9R3+/Kab4sf7hprtTPjwQ== 2023-06-22T16:23:24.960 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2023-06-22T16:23:24.960 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBkdZRkmv0QGhAAU7fgtBC0NEEPHshQTmEnRA== 2023-06-22T16:23:24.961 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2023-06-22T16:23:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBndZRk5SAXHBAA2w69nI++xC5aytUGgxu3PQ== 2023-06-22T16:23:24.961 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2023-06-22T16:23:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBqdZRkmWVjIRAA4MsUsqwrR4rgvBZePvs9cQ== 2023-06-22T16:23:24.961 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2023-06-22T16:23:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBddZRkX3UqOBAACztV5ZWkcSWJqXQZxziedA== 2023-06-22T16:23:24.961 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2023-06-22T16:23:24.961 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBedZRkrLOXCRAAyjE4qan//rkWNw2Gvy7rAg== 2023-06-22T16:23:24.962 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2023-06-22T16:23:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBedZRkaj3mDBAABaE4EQX/tZi+D01eh4oR1A== 2023-06-22T16:23:24.962 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2023-06-22T16:23:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBwdZRkV0ipBBAAo0p3wXa+EOXF/ZF+eAzdcA== 2023-06-22T16:23:24.962 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2023-06-22T16:23:24.962 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBzdZRkVHJJFRAAIlsb9QWC3XuTCKdFHVFf5Q== 2023-06-22T16:23:24.962 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2023-06-22T16:23:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQB2dZRkdwwmGxAAEe4wk7ScTAJRZROUX15KjQ== 2023-06-22T16:23:24.963 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2023-06-22T16:23:24.963 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQB5dZRk+nXZHRAAoyOY9b2P4wHYr4thFgevag== 2023-06-22T16:23:24.964 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2023-06-22T16:23:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBedZRkpOKzEhAAbk19TM3lR1kDci7aSQncNQ== 2023-06-22T16:23:24.964 INFO:teuthology.orchestra.run.smithi149.stdout:[client.2] 2023-06-22T16:23:24.964 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBedZRklgZOGBAAJZ87LW9zv7H+MYx8UVplKA== 2023-06-22T16:23:24.965 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2023-06-22T16:23:24.965 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBedZRkTA9WGxAAfkkOokp4VAb1bpw/SiCwQw== 2023-06-22T16:23:24.965 INFO:teuthology.orchestra.run.smithi149.stdout:[client.3] 2023-06-22T16:23:24.966 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBedZRkmjwGHhAAUMSk7bszFGLvl2KdhpgT+g== 2023-06-22T16:23:24.966 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-22T16:23:25.005 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-22T16:23:25.051 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T16:23:25.053 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T16:23:25.141 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T16:23:25.144 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T16:23:25.189 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.191 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.232 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.234 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.318 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.320 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.364 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.366 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.407 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-22T16:23:25.448 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-22T16:23:25.493 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T16:23:25.495 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T16:23:25.540 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T16:23:25.542 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T16:23:25.584 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.586 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.671 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.673 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.717 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.719 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.761 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.763 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T16:23:25.849 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T16:23:25.851 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T16:23:25.898 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T16:23:25.900 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T16:23:25.946 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T16:23:25.948 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T16:23:26.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T16:23:26.072 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T16:23:26.147 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-22T16:23:26.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-22T16:23:26.164 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-22T16:23:26.222 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-22T16:23:26.235 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-22T16:23:26.252 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-22T16:23:26.305 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-22T16:23:26.319 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-22T16:23:26.328 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-22T16:23:26.383 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-22T16:23:26.395 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:23:26.398 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-22T16:23:26.403 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-22T16:23:26.403 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-22T16:23:26.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-22T16:23:26.444 INFO:tasks.ceph.mon.a:Started 2023-06-22T16:23:26.445 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-22T16:23:26.445 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-22T16:23:26.450 INFO:tasks.ceph.mon.b:Started 2023-06-22T16:23:26.450 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-22T16:23:26.450 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-22T16:23:26.453 INFO:tasks.ceph.mon.c:Started 2023-06-22T16:23:26.453 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-22T16:23:26.453 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-22T16:23:26.454 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-22T16:23:26.456 INFO:tasks.ceph.mgr.y:Started 2023-06-22T16:23:26.456 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-22T16:23:26.456 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-22T16:23:26.459 INFO:tasks.ceph.mgr.x:Started 2023-06-22T16:23:26.459 INFO:tasks.ceph:Setting crush tunables to default 2023-06-22T16:23:26.460 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd crush tunables default 2023-06-22T16:23:26.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a339c1700 1 Processor -- start 2023-06-22T16:23:26.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a339c1700 1 -- start start 2023-06-22T16:23:26.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a339c1700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:26.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a339c1700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:26.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a339c1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2c0ab180 con 0x7f5a2c067070 2023-06-22T16:23:26.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a339c1700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2c0ab460 con 0x7f5a2c15a2c0 2023-06-22T16:23:26.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a339c1700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c06e450 con 0x7f5a2c067440 2023-06-22T16:23:26.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a3175d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f5a2c067070 0x7f5a2c0aa700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:41298/0 (socket says 172.21.15.149:41298) 2023-06-22T16:23:26.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a3175d700 1 -- 172.21.15.149:0/2609035793 learned_addr learned my addr 172.21.15.149:0/2609035793 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-22T16:23:26.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:26.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a31f5e700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 msgr2=0x7f5a2c0ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-22T16:23:26.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a31f5e700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 msgr2=0x7f5a2c0ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:26.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:26.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:26.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:26.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 msgr2=0x7f5a2c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-22T16:23:26.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 msgr2=0x7f5a2c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:26.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:26.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.564+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:26.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.764+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:26.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.764+0000 7f5a31f5e700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 msgr2=0x7f5a2c0ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-22T16:23:26.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.764+0000 7f5a31f5e700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 msgr2=0x7f5a2c0ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:26.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.764+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:26.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.764+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-22T16:23:26.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.764+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:26.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.764+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 msgr2=0x7f5a2c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-22T16:23:26.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.764+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 msgr2=0x7f5a2c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:26.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.764+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:26.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:26.764+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-22T16:23:27.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.168+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:27.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.168+0000 7f5a31f5e700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 msgr2=0x7f5a2c0ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-22T16:23:27.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.168+0000 7f5a31f5e700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 msgr2=0x7f5a2c0ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:27.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.168+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:27.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.168+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-22T16:23:27.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.168+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:27.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.168+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 msgr2=0x7f5a2c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-22T16:23:27.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.168+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 msgr2=0x7f5a2c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:27.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.168+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:27.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.168+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-22T16:23:27.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.969+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:27.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.969+0000 7f5a31f5e700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 msgr2=0x7f5a2c0ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-22T16:23:27.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.969+0000 7f5a31f5e700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 msgr2=0x7f5a2c0ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:27.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.969+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:27.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.969+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-22T16:23:27.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.969+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:27.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.969+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 msgr2=0x7f5a2c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-22T16:23:27.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.969+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 msgr2=0x7f5a2c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:27.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.969+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:27.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:27.969+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-22T16:23:29.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.565+0000 7f5a22ffd700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 msgr2=0x7f5a2c159d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T16:23:29.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.565+0000 7f5a22ffd700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a2c067440 0x7f5a2c159d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:29.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.565+0000 7f5a22ffd700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 msgr2=0x7f5a2c0ab790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T16:23:29.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.565+0000 7f5a22ffd700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.149:3300/0 conn(0x7f5a2c15a2c0 0x7f5a2c0ab790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:29.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.565+0000 7f5a22ffd700 1 -- 172.21.15.149:0/2609035793 >> v1:172.21.15.149:6789/0 conn(0x7f5a2c067070 legacy=0x7f5a2c0aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:29.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.565+0000 7f5a22ffd700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:29.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.565+0000 7f5a22ffd700 1 -- 172.21.15.149:0/2609035793 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2c06e730 con 0x7f5a10003710 2023-06-22T16:23:29.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.565+0000 7f5a22ffd700 1 -- 172.21.15.149:0/2609035793 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2c06e450 con 0x7f5a10007390 2023-06-22T16:23:29.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.565+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:29.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.565+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 msgr2=0x7f5a10009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-22T16:23:29.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.565+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 msgr2=0x7f5a10009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:29.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.565+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:29.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.565+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:29.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.769+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:29.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.769+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 msgr2=0x7f5a10009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-22T16:23:29.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.769+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 msgr2=0x7f5a10009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:29.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.769+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:29.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:29.769+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-22T16:23:30.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:30.169+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:30.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:30.169+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 msgr2=0x7f5a10009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-22T16:23:30.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:30.169+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 msgr2=0x7f5a10009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:30.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:30.169+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:30.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:30.169+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-22T16:23:30.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:30.969+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:30.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:30.969+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 msgr2=0x7f5a10009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-22T16:23:30.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:30.969+0000 7f5a30f5c700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 msgr2=0x7f5a10009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:30.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:30.969+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:30.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:30.969+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-22T16:23:31.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.645+0000 7f5a23fff700 1 -- 172.21.15.149:0/2609035793 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490465442 0 0) 0x7f5a2c06e730 con 0x7f5a10003710 2023-06-22T16:23:31.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.645+0000 7f5a23fff700 1 -- 172.21.15.149:0/2609035793 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a18003570 con 0x7f5a10003710 2023-06-22T16:23:31.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.645+0000 7f5a23fff700 1 -- 172.21.15.149:0/2609035793 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883401684 0 0) 0x7f5a18003570 con 0x7f5a10003710 2023-06-22T16:23:31.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.645+0000 7f5a23fff700 1 -- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 msgr2=0x7f5a10009840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T16:23:31.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.645+0000 7f5a23fff700 1 --2- 172.21.15.149:0/2609035793 >> v2:172.21.15.196:3300/0 conn(0x7f5a10007390 0x7f5a10009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:31.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.645+0000 7f5a23fff700 1 -- 172.21.15.149:0/2609035793 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1000af40 con 0x7f5a10003710 2023-06-22T16:23:31.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.645+0000 7f5a23fff700 1 -- 172.21.15.149:0/2609035793 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 882791489 0 0) 0x7f5a24001870 con 0x7f5a10003710 2023-06-22T16:23:31.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a23fff700 1 -- 172.21.15.149:0/2609035793 >> v1:172.21.15.196:6789/0 conn(0x7f5a10003710 legacy=0x7f5a10005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:31.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a31f5e700 1 -- 172.21.15.149:0/2609035793 reap_dead start 2023-06-22T16:23:31.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a23fff700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a18003a60 0x7f5a18003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:31.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a23fff700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a18004810 0x7f5a18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:31.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a23fff700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a180052e0 0x7f5a1800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:31.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a23fff700 1 -- 172.21.15.149:0/2609035793 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c06e450 con 0x7f5a18003a60 2023-06-22T16:23:31.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a23fff700 1 -- 172.21.15.149:0/2609035793 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1800c2a0 con 0x7f5a18004810 2023-06-22T16:23:31.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a23fff700 1 -- 172.21.15.149:0/2609035793 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1800c460 con 0x7f5a180052e0 2023-06-22T16:23:31.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a3175d700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a18003a60 0x7f5a18003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:31.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a180052e0 0x7f5a1800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:31.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a18004810 0x7f5a18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:31.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a31f5e700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a180052e0 msgr2=0x7f5a1800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-22T16:23:31.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a31f5e700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a180052e0 msgr2=0x7f5a1800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:31.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a180052e0 0x7f5a1800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:31.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a31f5e700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a180052e0 0x7f5a1800ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:31.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a3175d700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a180052e0 msgr2=0x7f5a1800ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T16:23:31.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a3175d700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a180052e0 0x7f5a1800ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:31.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a3175d700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a18004810 msgr2=0x7f5a18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:31.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a3175d700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a18004810 0x7f5a18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:31.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a3175d700 1 -- 172.21.15.149:0/2609035793 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a18003570 con 0x7f5a18003a60 2023-06-22T16:23:31.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.649+0000 7f5a3175d700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a18003a60 0x7f5a18003e50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400a950 tx=0x7f5a240021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605bd9ed5b12f097 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:31.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.653+0000 7f5a23fff700 1 -- 172.21.15.149:0/2609035793 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a240070d0 con 0x7f5a18003a60 2023-06-22T16:23:31.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.653+0000 7f5a23fff700 1 -- 172.21.15.149:0/2609035793 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a24007250 con 0x7f5a18003a60 2023-06-22T16:23:31.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.653+0000 7f5a23fff700 1 -- 172.21.15.149:0/2609035793 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24007610 con 0x7f5a18003a60 2023-06-22T16:23:31.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.653+0000 7f5a339c1700 1 -- 172.21.15.149:0/2609035793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a18003a60 msgr2=0x7f5a18003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:31.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.653+0000 7f5a339c1700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a18003a60 0x7f5a18003e50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400a950 tx=0x7f5a240021f0 comp rx=0 tx=0).stop 2023-06-22T16:23:31.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.657+0000 7f5a339c1700 1 -- 172.21.15.149:0/2609035793 shutdown_connections 2023-06-22T16:23:31.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.657+0000 7f5a339c1700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a180052e0 0x7f5a1800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:31.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.657+0000 7f5a339c1700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a18004810 0x7f5a18004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:31.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.657+0000 7f5a339c1700 1 --2- 172.21.15.149:0/2609035793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a18003a60 0x7f5a18003e50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:31.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.657+0000 7f5a339c1700 1 -- 172.21.15.149:0/2609035793 >> 172.21.15.149:0/2609035793 conn(0x7f5a2c06ce10 msgr2=0x7f5a2c0cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:31.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.657+0000 7f5a339c1700 1 -- 172.21.15.149:0/2609035793 shutdown_connections 2023-06-22T16:23:31.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.657+0000 7f5a339c1700 1 -- 172.21.15.149:0/2609035793 wait complete. 2023-06-22T16:23:31.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a339c1700 1 Processor -- start 2023-06-22T16:23:31.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a339c1700 1 -- start start 2023-06-22T16:23:31.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a339c1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a18003a60 0x7f5a2c16dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:31.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a339c1700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a18004810 0x7f5a2c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:31.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a339c1700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a180052e0 0x7f5a2c0ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:31.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a339c1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c0adc20 con 0x7f5a18003a60 2023-06-22T16:23:31.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a339c1700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c0ae7e0 con 0x7f5a180052e0 2023-06-22T16:23:31.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a339c1700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c16e530 con 0x7f5a18004810 2023-06-22T16:23:31.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a3175d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a18003a60 0x7f5a2c16dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:31.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a30f5c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a18004810 0x7f5a2c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:31.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a31f5e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a180052e0 0x7f5a2c0ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:31.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a30f5c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a18004810 0x7f5a2c152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.149:60228/0 (socket says 172.21.15.149:60228) 2023-06-22T16:23:31.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a30f5c700 1 -- 172.21.15.149:0/1024195882 learned_addr learned my addr 172.21.15.149:0/1024195882 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:31.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a30f5c700 1 -- 172.21.15.149:0/1024195882 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a18004810 msgr2=0x7f5a2c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-06-22T16:23:31.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a30f5c700 1 -- 172.21.15.149:0/1024195882 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a18004810 msgr2=0x7f5a2c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-06-22T16:23:31.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/1024195882 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a18004810 0x7f5a2c152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:31.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a30f5c700 1 --2- 172.21.15.149:0/1024195882 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a18004810 0x7f5a2c152be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:31.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a3175d700 1 -- 172.21.15.149:0/1024195882 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a18004810 msgr2=0x7f5a2c152be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-22T16:23:31.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a3175d700 1 --2- 172.21.15.149:0/1024195882 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a18004810 0x7f5a2c152be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:31.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a3175d700 1 -- 172.21.15.149:0/1024195882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a180052e0 msgr2=0x7f5a2c0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:31.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a3175d700 1 --2- 172.21.15.149:0/1024195882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a180052e0 0x7f5a2c0ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:31.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a3175d700 1 -- 172.21.15.149:0/1024195882 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c0abcc0 con 0x7f5a18003a60 2023-06-22T16:23:31.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.661+0000 7f5a3175d700 1 --2- 172.21.15.149:0/1024195882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a18003a60 0x7f5a2c16dff0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5a24015000 tx=0x7f5a24016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:31.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.665+0000 7f5a217fa700 1 -- 172.21.15.149:0/1024195882 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24001c10 con 0x7f5a18003a60 2023-06-22T16:23:31.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.665+0000 7f5a217fa700 1 -- 172.21.15.149:0/1024195882 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a24027470 con 0x7f5a18003a60 2023-06-22T16:23:31.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.665+0000 7f5a339c1700 1 -- 172.21.15.149:0/1024195882 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2c0abfa0 con 0x7f5a18003a60 2023-06-22T16:23:31.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.665+0000 7f5a217fa700 1 -- 172.21.15.149:0/1024195882 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24027830 con 0x7f5a18003a60 2023-06-22T16:23:31.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.665+0000 7f5a339c1700 1 -- 172.21.15.149:0/1024195882 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2c0ac560 con 0x7f5a18003a60 2023-06-22T16:23:31.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.665+0000 7f5a217fa700 1 -- 172.21.15.149:0/1024195882 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5a24024070 con 0x7f5a18003a60 2023-06-22T16:23:31.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.665+0000 7f5a217fa700 1 -- 172.21.15.149:0/1024195882 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5a2401d430 con 0x7f5a18003a60 2023-06-22T16:23:31.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.665+0000 7f5a339c1700 1 -- 172.21.15.149:0/1024195882 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2c0ae970 con 0x7f5a18003a60 2023-06-22T16:23:31.679 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.673+0000 7f5a217fa700 1 -- 172.21.15.149:0/1024195882 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f5a2401d5f0 con 0x7f5a18003a60 2023-06-22T16:23:31.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.741+0000 7f5a339c1700 1 -- 172.21.15.149:0/1024195882 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5a2c04bc30 con 0x7f5a18003a60 2023-06-22T16:23:31.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.749+0000 7f5a217fa700 1 -- 172.21.15.149:0/1024195882 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5a2401d790 con 0x7f5a18003a60 2023-06-22T16:23:31.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.749+0000 7f5a339c1700 1 -- 172.21.15.149:0/1024195882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a18003a60 msgr2=0x7f5a2c16dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:31.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.749+0000 7f5a339c1700 1 --2- 172.21.15.149:0/1024195882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a18003a60 0x7f5a2c16dff0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5a24015000 tx=0x7f5a24016000 comp rx=0 tx=0).stop 2023-06-22T16:23:31.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.749+0000 7f5a339c1700 1 -- 172.21.15.149:0/1024195882 shutdown_connections 2023-06-22T16:23:31.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.749+0000 7f5a339c1700 1 --2- 172.21.15.149:0/1024195882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5a180052e0 0x7f5a2c0ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:31.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.749+0000 7f5a339c1700 1 --2- 172.21.15.149:0/1024195882 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5a18004810 0x7f5a2c152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:31.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.749+0000 7f5a339c1700 1 --2- 172.21.15.149:0/1024195882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a18003a60 0x7f5a2c16dff0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:31.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.749+0000 7f5a339c1700 1 -- 172.21.15.149:0/1024195882 >> 172.21.15.149:0/1024195882 conn(0x7f5a2c06ce10 msgr2=0x7f5a2c158910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:31.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.749+0000 7f5a339c1700 1 -- 172.21.15.149:0/1024195882 shutdown_connections 2023-06-22T16:23:31.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:31.749+0000 7f5a339c1700 1 -- 172.21.15.149:0/1024195882 wait complete. 2023-06-22T16:23:31.759 INFO:teuthology.orchestra.run.smithi149.stderr:adjusted tunables profile to default 2023-06-22T16:23:31.771 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-22T16:23:31.772 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:23:31.772 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-22T16:23:31.787 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:23:31.787 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-22T16:23:31.798 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:23:31.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-22T16:23:31.809 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-22T16:23:31.809 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-22T16:23:31.817 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:23:31.818 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-22T16:23:31.835 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:23:31.836 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-22T16:23:31.838 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:31.830+0000 7fb1dc005000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-22T16:23:31.851 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:23:31.851 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-22T16:23:31.871 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:31.865+0000 7f3581224000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-22T16:23:31.906 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-06-22T16:23:31.907 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-22T16:23:31.916 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 56ddaf00-fc77-44cf-b823-5bd377b92576 0 2023-06-22T16:23:32.015 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.006+0000 7f97dbfff700 1 Processor -- start 2023-06-22T16:23:32.016 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.006+0000 7f97dbfff700 1 -- start start 2023-06-22T16:23:32.019 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97dbfff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 0x7f97dc06c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.019 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97dbfff700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97dc0ccb20 con 0x7f97dc06c5b0 2023-06-22T16:23:32.020 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97dbfff700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97dc0ab710 con 0x7f97dc0b24f0 2023-06-22T16:23:32.020 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97dbfff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0ab9d0 con 0x7f97dc0cd6c0 2023-06-22T16:23:32.020 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97da7fc700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 0x7f97dc06c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.020 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97da7fc700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 0x7f97dc06c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:35604/0 (socket says 172.21.15.196:35604) 2023-06-22T16:23:32.020 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97da7fc700 1 -- 172.21.15.196:0/1966129838 learned_addr learned my addr 172.21.15.196:0/1966129838 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-06-22T16:23:32.021 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97db7fe700 1 --1- 172.21.15.196:0/1966129838 >> v1:172.21.15.196:6789/0 conn(0x7f97dc0b24f0 0x7f97dc1588b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:48912/0 (socket says 172.21.15.196:48912) 2023-06-22T16:23:32.021 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97da7fc700 1 -- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 msgr2=0x7f97dc06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-22T16:23:32.021 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97da7fc700 1 -- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 msgr2=0x7f97dc06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:32.021 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97da7fc700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 0x7f97dc06c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:32.021 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97da7fc700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 0x7f97dc06c980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:32.021 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105371541 0 0) 0x7f97dc0ab710 con 0x7f97dc0b24f0 2023-06-22T16:23:32.021 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c4003570 con 0x7f97dc0b24f0 2023-06-22T16:23:32.022 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3704089402 0 0) 0x7f97c4003570 con 0x7f97dc0b24f0 2023-06-22T16:23:32.022 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 msgr2=0x7f97dc06c980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T16:23:32.022 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 0x7f97dc06c980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.022 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 >> v1:172.21.15.149:6789/0 conn(0x7f97dc06c5b0 legacy=0x7f97dc0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.022 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc0abcb0 con 0x7f97dc0b24f0 2023-06-22T16:23:32.022 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 882791489 0 0) 0x7f97d40017f0 con 0x7f97dc0b24f0 2023-06-22T16:23:32.022 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 >> v1:172.21.15.196:6789/0 conn(0x7f97dc0b24f0 legacy=0x7f97dc1588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.023 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97c4003a60 0x7f97c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.023 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 0x7f97c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.023 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c4004d50 0x7f97c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.023 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0ab9d0 con 0x7f97c4003a60 2023-06-22T16:23:32.023 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c400bb70 con 0x7f97c4004d50 2023-06-22T16:23:32.023 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c400bd30 con 0x7f97dc0cd6c0 2023-06-22T16:23:32.023 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97da7fc700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 0x7f97c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.024 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97db7fe700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c4004d50 0x7f97c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.024 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97da7fc700 1 -- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 msgr2=0x7f97c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-22T16:23:32.024 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97da7fc700 1 -- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 msgr2=0x7f97c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:32.024 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97daffd700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97c4003a60 0x7f97c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.024 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97da7fc700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 0x7f97c4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:32.024 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97da7fc700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 0x7f97c4004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:32.024 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97db7fe700 1 -- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 msgr2=0x7f97c4004810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T16:23:32.025 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97db7fe700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc0cd6c0 0x7f97c4004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.025 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97db7fe700 1 -- 172.21.15.196:0/1966129838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97c4003a60 msgr2=0x7f97c4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:32.025 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97db7fe700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97c4003a60 0x7f97c4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.025 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97db7fe700 1 -- 172.21.15.196:0/1966129838 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c4003570 con 0x7f97c4004d50 2023-06-22T16:23:32.025 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97db7fe700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c4004d50 0x7f97c40051c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f97d400a950 tx=0x7f97d40021f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88577c292dd5363f server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:32.025 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4005be0 con 0x7f97c4004d50 2023-06-22T16:23:32.025 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d4005d40 con 0x7f97c4004d50 2023-06-22T16:23:32.026 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97d9ffb700 1 -- 172.21.15.196:0/1966129838 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4007320 con 0x7f97c4004d50 2023-06-22T16:23:32.028 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97dbfff700 1 -- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c4004d50 msgr2=0x7f97c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.028 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97dbfff700 1 --2- 172.21.15.196:0/1966129838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c4004d50 0x7f97c40051c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f97d400a950 tx=0x7f97d40021f0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.028 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97db7fe700 1 -- 172.21.15.196:0/1966129838 reap_dead start 2023-06-22T16:23:32.029 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97dbfff700 1 -- 172.21.15.196:0/1966129838 shutdown_connections 2023-06-22T16:23:32.029 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97dbfff700 1 -- 172.21.15.196:0/1966129838 >> 172.21.15.196:0/1966129838 conn(0x7f97dc06df10 msgr2=0x7f97dc06b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:32.029 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97dbfff700 1 -- 172.21.15.196:0/1966129838 shutdown_connections 2023-06-22T16:23:32.029 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.010+0000 7f97dbfff700 1 -- 172.21.15.196:0/1966129838 wait complete. 2023-06-22T16:23:32.029 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97dbfff700 1 Processor -- start 2023-06-22T16:23:32.030 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97dbfff700 1 -- start start 2023-06-22T16:23:32.030 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97dbfff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c4004d50 0x7f97dc13a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.030 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97dbfff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc14e2c0 0x7f97dc14e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.030 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97dbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97dc157440 0x7f97dc1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.031 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97dbfff700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc157df0 con 0x7f97dc157440 2023-06-22T16:23:32.031 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97dbfff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc14c490 con 0x7f97c4004d50 2023-06-22T16:23:32.031 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97dbfff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc14b880 con 0x7f97dc14e2c0 2023-06-22T16:23:32.031 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97da7fc700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc14e2c0 0x7f97dc14e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.031 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97da7fc700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc14e2c0 0x7f97dc14e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:35620/0 (socket says 172.21.15.196:35620) 2023-06-22T16:23:32.031 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97da7fc700 1 -- 172.21.15.196:0/2974648507 learned_addr learned my addr 172.21.15.196:0/2974648507 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-06-22T16:23:32.032 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97daffd700 1 --2- 172.21.15.196:0/2974648507 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c4004d50 0x7f97dc13a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.032 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97da7fc700 1 -- 172.21.15.196:0/2974648507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc14e2c0 msgr2=0x7f97dc14e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-06-22T16:23:32.032 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97da7fc700 1 -- 172.21.15.196:0/2974648507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc14e2c0 msgr2=0x7f97dc14e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-06-22T16:23:32.032 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97da7fc700 1 --2- 172.21.15.196:0/2974648507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc14e2c0 0x7f97dc14e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:32.032 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97da7fc700 1 --2- 172.21.15.196:0/2974648507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc14e2c0 0x7f97dc14e730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:32.032 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97db7fe700 1 --2- 172.21.15.196:0/2974648507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97dc157440 0x7f97dc1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.033 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97daffd700 1 -- 172.21.15.196:0/2974648507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc14e2c0 msgr2=0x7f97dc14e730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-22T16:23:32.033 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97daffd700 1 --2- 172.21.15.196:0/2974648507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc14e2c0 0x7f97dc14e730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.033 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97daffd700 1 -- 172.21.15.196:0/2974648507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97dc157440 msgr2=0x7f97dc1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.033 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97daffd700 1 --2- 172.21.15.196:0/2974648507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97dc157440 0x7f97dc1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.033 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97daffd700 1 -- 172.21.15.196:0/2974648507 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc14bb60 con 0x7f97c4004d50 2023-06-22T16:23:32.033 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97daffd700 1 --2- 172.21.15.196:0/2974648507 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c4004d50 0x7f97dc13a900 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f97cc0029e0 tx=0x7f97cc007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:32.033 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97c2ffd700 1 -- 172.21.15.196:0/2974648507 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00f8d0 con 0x7f97c4004d50 2023-06-22T16:23:32.034 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97c2ffd700 1 -- 172.21.15.196:0/2974648507 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc00fa50 con 0x7f97c4004d50 2023-06-22T16:23:32.034 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97dbfff700 1 -- 172.21.15.196:0/2974648507 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc14be40 con 0x7f97c4004d50 2023-06-22T16:23:32.034 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97c2ffd700 1 -- 172.21.15.196:0/2974648507 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00fe10 con 0x7f97c4004d50 2023-06-22T16:23:32.034 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97dbfff700 1 -- 172.21.15.196:0/2974648507 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc14b2e0 con 0x7f97c4004d50 2023-06-22T16:23:32.034 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97c2ffd700 1 -- 172.21.15.196:0/2974648507 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f97cc013880 con 0x7f97c4004d50 2023-06-22T16:23:32.034 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.014+0000 7f97c2ffd700 1 -- 172.21.15.196:0/2974648507 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f97cc01c7e0 con 0x7f97c4004d50 2023-06-22T16:23:32.034 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.018+0000 7f97dbfff700 1 -- 172.21.15.196:0/2974648507 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc069d70 con 0x7f97c4004d50 2023-06-22T16:23:32.034 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.018+0000 7f97c2ffd700 1 -- 172.21.15.196:0/2974648507 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f97cc03b6e0 con 0x7f97c4004d50 2023-06-22T16:23:32.102 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.094+0000 7f97dbfff700 1 -- 172.21.15.196:0/2974648507 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "56ddaf00-fc77-44cf-b823-5bd377b92576", "id": 0} v 0) v1 -- 0x7f97dc0abf90 con 0x7f97c4004d50 2023-06-22T16:23:32.113 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.106+0000 7f97c2ffd700 1 -- 172.21.15.196:0/2974648507 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56ddaf00-fc77-44cf-b823-5bd377b92576", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f97cc02a070 con 0x7f97c4004d50 2023-06-22T16:23:32.114 INFO:teuthology.orchestra.run.smithi196.stdout:0 2023-06-22T16:23:32.115 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.106+0000 7f97dbfff700 1 -- 172.21.15.196:0/2974648507 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c4004d50 msgr2=0x7f97dc13a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.115 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.106+0000 7f97dbfff700 1 --2- 172.21.15.196:0/2974648507 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c4004d50 0x7f97dc13a900 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f97cc0029e0 tx=0x7f97cc007d10 comp rx=0 tx=0).stop 2023-06-22T16:23:32.115 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.106+0000 7f97dbfff700 1 -- 172.21.15.196:0/2974648507 shutdown_connections 2023-06-22T16:23:32.116 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.106+0000 7f97dbfff700 1 --2- 172.21.15.196:0/2974648507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97dc157440 0x7f97dc1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.116 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.106+0000 7f97dbfff700 1 --2- 172.21.15.196:0/2974648507 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97dc14e2c0 0x7f97dc14e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.116 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.106+0000 7f97dbfff700 1 --2- 172.21.15.196:0/2974648507 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97c4004d50 0x7f97dc13a900 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.116 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.106+0000 7f97dbfff700 1 -- 172.21.15.196:0/2974648507 >> 172.21.15.196:0/2974648507 conn(0x7f97dc06df10 msgr2=0x7f97dc0ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:32.116 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.106+0000 7f97dbfff700 1 -- 172.21.15.196:0/2974648507 shutdown_connections 2023-06-22T16:23:32.116 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.106+0000 7f97dbfff700 1 -- 172.21.15.196:0/2974648507 wait complete. 2023-06-22T16:23:32.130 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 532f10bd-8b84-4a0b-9aed-28e7afb4a863 1 2023-06-22T16:23:32.230 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f8b60700 1 Processor -- start 2023-06-22T16:23:32.230 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f8b60700 1 -- start start 2023-06-22T16:23:32.231 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f8b60700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 0x7f33f4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.231 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f8b60700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f415b660 con 0x7f33f40b1a90 2023-06-22T16:23:32.232 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f8b60700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f415ae40 con 0x7f33f406bd50 2023-06-22T16:23:32.232 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f8b60700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f415b0a0 con 0x7f33f40abe20 2023-06-22T16:23:32.232 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 0x7f33f4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.232 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f2ffd700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f33f406bd50 0x7f33f415a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:48922/0 (socket says 172.21.15.196:48922) 2023-06-22T16:23:32.232 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f2ffd700 1 -- 172.21.15.196:0/2881929303 learned_addr learned my addr 172.21.15.196:0/2881929303 (peer_addr_for_me v1:172.21.15.196:0/0) 2023-06-22T16:23:32.235 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f37fe700 1 -- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 msgr2=0x7f33f4157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-22T16:23:32.235 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f37fe700 1 -- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 msgr2=0x7f33f4157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:32.236 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f37fe700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 0x7f33f4157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:32.236 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f37fe700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 0x7f33f4157a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:32.236 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386510408 0 0) 0x7f33f415ae40 con 0x7f33f406bd50 2023-06-22T16:23:32.236 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33dc003570 con 0x7f33f406bd50 2023-06-22T16:23:32.236 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523865935 0 0) 0x7f33f415b660 con 0x7f33f40b1a90 2023-06-22T16:23:32.236 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33f415ae40 con 0x7f33f40b1a90 2023-06-22T16:23:32.237 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2557496161 0 0) 0x7f33dc003570 con 0x7f33f406bd50 2023-06-22T16:23:32.237 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 msgr2=0x7f33f4157a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T16:23:32.237 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f27fc700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 0x7f33f4157a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.237 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 >> v1:172.21.15.149:6789/0 conn(0x7f33f40b1a90 legacy=0x7f33f40672a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.237 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f415b380 con 0x7f33f406bd50 2023-06-22T16:23:32.237 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.222+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 882791489 0 0) 0x7f33e8001470 con 0x7f33f406bd50 2023-06-22T16:23:32.238 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 >> v1:172.21.15.196:6789/0 conn(0x7f33f406bd50 legacy=0x7f33f415a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.238 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f27fc700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33dc003bf0 0x7f33dc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.238 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f27fc700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 0x7f33dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.238 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f27fc700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33dc004d50 0x7f33dc0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.238 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f415b0a0 con 0x7f33dc003bf0 2023-06-22T16:23:32.239 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc00bbf0 con 0x7f33dc004d50 2023-06-22T16:23:32.239 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc00bd80 con 0x7f33f40abe20 2023-06-22T16:23:32.239 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f2ffd700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 0x7f33dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.239 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f3fff700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33dc004d50 0x7f33dc0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.239 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f2ffd700 1 -- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 msgr2=0x7f33dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-22T16:23:32.240 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f37fe700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33dc003bf0 0x7f33dc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.240 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f2ffd700 1 -- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 msgr2=0x7f33dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:32.240 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f2ffd700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 0x7f33dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:32.241 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f2ffd700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 0x7f33dc004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:32.241 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f3fff700 1 -- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 msgr2=0x7f33dc004810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T16:23:32.241 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f3fff700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f40abe20 0x7f33dc004810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.241 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f3fff700 1 -- 172.21.15.196:0/2881929303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33dc003bf0 msgr2=0x7f33dc003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:32.241 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f3fff700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33dc003bf0 0x7f33dc003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.241 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f3fff700 1 -- 172.21.15.196:0/2881929303 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc003570 con 0x7f33dc004d50 2023-06-22T16:23:32.241 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f3fff700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33dc004d50 0x7f33dc0051a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f33e4001a10 tx=0x7f33e4007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1eeba607864fb48 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:32.242 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e400c5d0 con 0x7f33dc004d50 2023-06-22T16:23:32.242 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e400c730 con 0x7f33dc004d50 2023-06-22T16:23:32.242 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f27fc700 1 -- 172.21.15.196:0/2881929303 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e400cad0 con 0x7f33dc004d50 2023-06-22T16:23:32.242 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f8b60700 1 -- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33dc004d50 msgr2=0x7f33dc0051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.242 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f8b60700 1 --2- 172.21.15.196:0/2881929303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33dc004d50 0x7f33dc0051a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f33e4001a10 tx=0x7f33e4007d30 comp rx=0 tx=0).stop 2023-06-22T16:23:32.242 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f3fff700 1 -- 172.21.15.196:0/2881929303 reap_dead start 2023-06-22T16:23:32.242 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f8b60700 1 -- 172.21.15.196:0/2881929303 shutdown_connections 2023-06-22T16:23:32.243 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f8b60700 1 -- 172.21.15.196:0/2881929303 >> 172.21.15.196:0/2881929303 conn(0x7f33f406df10 msgr2=0x7f33f406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:32.243 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f8b60700 1 -- 172.21.15.196:0/2881929303 shutdown_connections 2023-06-22T16:23:32.243 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.226+0000 7f33f8b60700 1 -- 172.21.15.196:0/2881929303 wait complete. 2023-06-22T16:23:32.245 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.230+0000 7f33f8b60700 1 Processor -- start 2023-06-22T16:23:32.245 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.230+0000 7f33f8b60700 1 -- start start 2023-06-22T16:23:32.245 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f8b60700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f4154640 0x7f33f40a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.245 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f8b60700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33f40a6100 0x7f33f40a89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.246 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f8b60700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f40a8ee0 0x7f33f40a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.246 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f8b60700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40a48d0 con 0x7f33f40a6100 2023-06-22T16:23:32.246 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f8b60700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40a5730 con 0x7f33f40a8ee0 2023-06-22T16:23:32.246 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f8b60700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40a4b20 con 0x7f33f4154640 2023-06-22T16:23:32.246 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f4154640 0x7f33f40a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.246 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f3fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f40a8ee0 0x7f33f40a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.246 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f4154640 0x7f33f40a5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:35656/0 (socket says 172.21.15.196:35656) 2023-06-22T16:23:32.247 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f37fe700 1 -- 172.21.15.196:0/4205090884 learned_addr learned my addr 172.21.15.196:0/4205090884 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-06-22T16:23:32.247 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f37fe700 1 -- 172.21.15.196:0/4205090884 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f4154640 msgr2=0x7f33f40a5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-06-22T16:23:32.247 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f37fe700 1 -- 172.21.15.196:0/4205090884 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f4154640 msgr2=0x7f33f40a5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-06-22T16:23:32.247 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f37fe700 1 --2- 172.21.15.196:0/4205090884 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f4154640 0x7f33f40a5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:32.247 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f2ffd700 1 --2- 172.21.15.196:0/4205090884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33f40a6100 0x7f33f40a89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.247 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f37fe700 1 --2- 172.21.15.196:0/4205090884 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f4154640 0x7f33f40a5bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:32.247 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f3fff700 1 -- 172.21.15.196:0/4205090884 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f4154640 msgr2=0x7f33f40a5bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-22T16:23:32.248 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f3fff700 1 --2- 172.21.15.196:0/4205090884 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f4154640 0x7f33f40a5bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.248 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f3fff700 1 -- 172.21.15.196:0/4205090884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33f40a6100 msgr2=0x7f33f40a89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.248 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f3fff700 1 --2- 172.21.15.196:0/4205090884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33f40a6100 0x7f33f40a89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.248 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f3fff700 1 -- 172.21.15.196:0/4205090884 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f40a4e00 con 0x7f33f40a8ee0 2023-06-22T16:23:32.248 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f3fff700 1 --2- 172.21.15.196:0/4205090884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f40a8ee0 0x7f33f40a9ea0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f33e4014000 tx=0x7f33e4015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:32.249 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33db7fe700 1 -- 172.21.15.196:0/4205090884 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4023070 con 0x7f33f40a8ee0 2023-06-22T16:23:32.249 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33db7fe700 1 -- 172.21.15.196:0/4205090884 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4000fe0 con 0x7f33f40a8ee0 2023-06-22T16:23:32.249 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f8b60700 1 -- 172.21.15.196:0/4205090884 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f40a50e0 con 0x7f33f40a8ee0 2023-06-22T16:23:32.249 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33db7fe700 1 -- 172.21.15.196:0/4205090884 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e400c5d0 con 0x7f33f40a8ee0 2023-06-22T16:23:32.249 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f8b60700 1 -- 172.21.15.196:0/4205090884 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f4154a10 con 0x7f33f40a8ee0 2023-06-22T16:23:32.250 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33db7fe700 1 -- 172.21.15.196:0/4205090884 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f33e4019030 con 0x7f33f40a8ee0 2023-06-22T16:23:32.250 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33db7fe700 1 -- 172.21.15.196:0/4205090884 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f33e4028410 con 0x7f33f40a8ee0 2023-06-22T16:23:32.250 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.234+0000 7f33f8b60700 1 -- 172.21.15.196:0/4205090884 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f4069d70 con 0x7f33f40a8ee0 2023-06-22T16:23:32.250 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.238+0000 7f33db7fe700 1 -- 172.21.15.196:0/4205090884 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f33e4017070 con 0x7f33f40a8ee0 2023-06-22T16:23:32.323 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.314+0000 7f33f8b60700 1 -- 172.21.15.196:0/4205090884 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "532f10bd-8b84-4a0b-9aed-28e7afb4a863", "id": 1} v 0) v1 -- 0x7f33f40c9c80 con 0x7f33f40a8ee0 2023-06-22T16:23:32.333 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.326+0000 7f33db7fe700 1 -- 172.21.15.196:0/4205090884 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "532f10bd-8b84-4a0b-9aed-28e7afb4a863", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f33e4001300 con 0x7f33f40a8ee0 2023-06-22T16:23:32.333 INFO:teuthology.orchestra.run.smithi196.stdout:1 2023-06-22T16:23:32.334 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.326+0000 7f33f8b60700 1 -- 172.21.15.196:0/4205090884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f40a8ee0 msgr2=0x7f33f40a9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.334 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.326+0000 7f33f8b60700 1 --2- 172.21.15.196:0/4205090884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f40a8ee0 0x7f33f40a9ea0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f33e4014000 tx=0x7f33e4015000 comp rx=0 tx=0).stop 2023-06-22T16:23:32.334 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.326+0000 7f33f8b60700 1 -- 172.21.15.196:0/4205090884 shutdown_connections 2023-06-22T16:23:32.335 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.326+0000 7f33f8b60700 1 --2- 172.21.15.196:0/4205090884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f40a8ee0 0x7f33f40a9ea0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.335 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.326+0000 7f33f8b60700 1 --2- 172.21.15.196:0/4205090884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33f40a6100 0x7f33f40a89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.335 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.326+0000 7f33f8b60700 1 --2- 172.21.15.196:0/4205090884 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33f4154640 0x7f33f40a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.335 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.326+0000 7f33f8b60700 1 -- 172.21.15.196:0/4205090884 >> 172.21.15.196:0/4205090884 conn(0x7f33f406df10 msgr2=0x7f33f40cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:32.335 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.326+0000 7f33f8b60700 1 -- 172.21.15.196:0/4205090884 shutdown_connections 2023-06-22T16:23:32.335 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.326+0000 7f33f8b60700 1 -- 172.21.15.196:0/4205090884 wait complete. 2023-06-22T16:23:32.346 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new bc3c458c-c810-4c5a-b258-2de1cb3ca1f3 2 2023-06-22T16:23:32.454 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.446+0000 7f0de18b5700 1 Processor -- start 2023-06-22T16:23:32.454 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.446+0000 7f0de18b5700 1 -- start start 2023-06-22T16:23:32.459 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.446+0000 7f0de18b5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0ddc06bd50 0x7f0ddc15a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.459 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.446+0000 7f0de18b5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc15b660 con 0x7f0ddc0b1a90 2023-06-22T16:23:32.460 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.446+0000 7f0de18b5700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc158150 con 0x7f0ddc0abe20 2023-06-22T16:23:32.460 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.446+0000 7f0de18b5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc15b0a0 con 0x7f0ddc06bd50 2023-06-22T16:23:32.460 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.446+0000 7f0de08b3700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0ddc0abe20 0x7f0ddc157a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:48936/0 (socket says 172.21.15.196:48936) 2023-06-22T16:23:32.460 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.446+0000 7f0de08b3700 1 -- 172.21.15.196:0/1943765674 learned_addr learned my addr 172.21.15.196:0/1943765674 (peer_addr_for_me v1:172.21.15.196:0/0) 2023-06-22T16:23:32.461 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddbfff700 1 --2- 172.21.15.196:0/1943765674 >> v2:172.21.15.149:3300/0 conn(0x7f0ddc06bd50 0x7f0ddc15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.461 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967336823 0 0) 0x7f0ddc158150 con 0x7f0ddc0abe20 2023-06-22T16:23:32.461 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc8003570 con 0x7f0ddc0abe20 2023-06-22T16:23:32.461 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639890414 0 0) 0x7f0ddc15b660 con 0x7f0ddc0b1a90 2023-06-22T16:23:32.462 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ddc158150 con 0x7f0ddc0b1a90 2023-06-22T16:23:32.462 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1219323240 0 0) 0x7f0dc8003570 con 0x7f0ddc0abe20 2023-06-22T16:23:32.462 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 >> v2:172.21.15.149:3300/0 conn(0x7f0ddc06bd50 msgr2=0x7f0ddc15a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:32.463 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 --2- 172.21.15.196:0/1943765674 >> v2:172.21.15.149:3300/0 conn(0x7f0ddc06bd50 0x7f0ddc15a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.463 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 >> v1:172.21.15.149:6789/0 conn(0x7f0ddc0b1a90 legacy=0x7f0ddc0b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.463 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc15b380 con 0x7f0ddc0abe20 2023-06-22T16:23:32.463 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 882791489 0 0) 0x7f0dcc001470 con 0x7f0ddc0abe20 2023-06-22T16:23:32.464 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 >> v1:172.21.15.196:6789/0 conn(0x7f0ddc0abe20 legacy=0x7f0ddc157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.464 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc8003bf0 0x7f0dc8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.464 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dc8004810 0x7f0dc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.465 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dc80051c0 0x7f0dc800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.465 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc15b0a0 con 0x7f0dc8004810 2023-06-22T16:23:32.465 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc800c160 con 0x7f0dc80051c0 2023-06-22T16:23:32.465 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc800c320 con 0x7f0dc8003bf0 2023-06-22T16:23:32.466 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de08b3700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc8003bf0 0x7f0dc8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.466 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de10b4700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dc80051c0 0x7f0dc800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.466 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de08b3700 1 -- 172.21.15.196:0/1943765674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc8003bf0 msgr2=0x7f0dc8003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-22T16:23:32.467 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de08b3700 1 -- 172.21.15.196:0/1943765674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc8003bf0 msgr2=0x7f0dc8003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:32.467 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de08b3700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc8003bf0 0x7f0dc8003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:32.467 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de08b3700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc8003bf0 0x7f0dc8003fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:32.467 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddbfff700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dc8004810 0x7f0dc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.468 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddbfff700 1 -- 172.21.15.196:0/1943765674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc8003bf0 msgr2=0x7f0dc8003fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T16:23:32.468 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddbfff700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0dc8003bf0 0x7f0dc8003fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.468 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddbfff700 1 -- 172.21.15.196:0/1943765674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dc80051c0 msgr2=0x7f0dc800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:32.469 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddbfff700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dc80051c0 0x7f0dc800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.469 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddbfff700 1 -- 172.21.15.196:0/1943765674 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc8003570 con 0x7f0dc8004810 2023-06-22T16:23:32.469 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de10b4700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dc80051c0 0x7f0dc800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T16:23:32.470 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de10b4700 1 -- 172.21.15.196:0/1943765674 reap_dead start 2023-06-22T16:23:32.470 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddbfff700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dc8004810 0x7f0dc8004c80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4006f00 tx=0x7f0dc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411088bdc4c1c89d server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:32.470 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc400e6e0 con 0x7f0dc8004810 2023-06-22T16:23:32.470 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc400e840 con 0x7f0dc8004810 2023-06-22T16:23:32.471 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0ddb7fe700 1 -- 172.21.15.196:0/1943765674 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc400ec00 con 0x7f0dc8004810 2023-06-22T16:23:32.474 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de18b5700 1 -- 172.21.15.196:0/1943765674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dc8004810 msgr2=0x7f0dc8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.474 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de18b5700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dc8004810 0x7f0dc8004c80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4006f00 tx=0x7f0dc40091a0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.474 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de18b5700 1 -- 172.21.15.196:0/1943765674 shutdown_connections 2023-06-22T16:23:32.474 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de18b5700 1 --2- 172.21.15.196:0/1943765674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dc8004810 0x7f0dc8004c80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.475 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de18b5700 1 -- 172.21.15.196:0/1943765674 >> 172.21.15.196:0/1943765674 conn(0x7f0ddc06df10 msgr2=0x7f0ddc06b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:32.475 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de18b5700 1 -- 172.21.15.196:0/1943765674 shutdown_connections 2023-06-22T16:23:32.475 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.450+0000 7f0de18b5700 1 -- 172.21.15.196:0/1943765674 wait complete. 2023-06-22T16:23:32.475 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de18b5700 1 Processor -- start 2023-06-22T16:23:32.476 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de18b5700 1 -- start start 2023-06-22T16:23:32.476 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de18b5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dc8004810 0x7f0ddc0c3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.476 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de18b5700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ddc0c3ac0 0x7f0ddc0c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.476 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de18b5700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ddc0c2660 0x7f0ddc0ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.476 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de18b5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0c3f30 con 0x7f0dc8004810 2023-06-22T16:23:32.476 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de18b5700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0ac390 con 0x7f0ddc0c3ac0 2023-06-22T16:23:32.476 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de18b5700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0ac670 con 0x7f0ddc0c2660 2023-06-22T16:23:32.477 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de10b4700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ddc0c2660 0x7f0ddc0ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.477 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de10b4700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ddc0c2660 0x7f0ddc0ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:35678/0 (socket says 172.21.15.196:35678) 2023-06-22T16:23:32.477 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de10b4700 1 -- 172.21.15.196:0/2680164073 learned_addr learned my addr 172.21.15.196:0/2680164073 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-06-22T16:23:32.477 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0ddbfff700 1 --2- 172.21.15.196:0/2680164073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ddc0c3ac0 0x7f0ddc0c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.477 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de10b4700 1 -- 172.21.15.196:0/2680164073 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ddc0c2660 msgr2=0x7f0ddc0ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-06-22T16:23:32.478 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de10b4700 1 -- 172.21.15.196:0/2680164073 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ddc0c2660 msgr2=0x7f0ddc0ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-06-22T16:23:32.478 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de10b4700 1 --2- 172.21.15.196:0/2680164073 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ddc0c2660 0x7f0ddc0ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:32.478 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de08b3700 1 --2- 172.21.15.196:0/2680164073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dc8004810 0x7f0ddc0c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.478 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de10b4700 1 --2- 172.21.15.196:0/2680164073 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ddc0c2660 0x7f0ddc0ad150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:32.479 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0ddbfff700 1 -- 172.21.15.196:0/2680164073 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ddc0c2660 msgr2=0x7f0ddc0ad150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-22T16:23:32.479 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0ddbfff700 1 --2- 172.21.15.196:0/2680164073 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ddc0c2660 0x7f0ddc0ad150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.479 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0ddbfff700 1 -- 172.21.15.196:0/2680164073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dc8004810 msgr2=0x7f0ddc0c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.479 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0ddbfff700 1 --2- 172.21.15.196:0/2680164073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dc8004810 0x7f0ddc0c3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.480 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0ddbfff700 1 -- 172.21.15.196:0/2680164073 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc0ac950 con 0x7f0ddc0c3ac0 2023-06-22T16:23:32.480 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0ddbfff700 1 --2- 172.21.15.196:0/2680164073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ddc0c3ac0 0x7f0ddc0c2120 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4019000 tx=0x7f0dc401a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:32.480 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0dd8ff9700 1 -- 172.21.15.196:0/2680164073 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4022070 con 0x7f0ddc0c3ac0 2023-06-22T16:23:32.481 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0dd8ff9700 1 -- 172.21.15.196:0/2680164073 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc400e9b0 con 0x7f0ddc0c3ac0 2023-06-22T16:23:32.481 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de18b5700 1 -- 172.21.15.196:0/2680164073 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc0acc30 con 0x7f0ddc0c3ac0 2023-06-22T16:23:32.481 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0dd8ff9700 1 -- 172.21.15.196:0/2680164073 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc401c680 con 0x7f0ddc0c3ac0 2023-06-22T16:23:32.481 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.454+0000 7f0de18b5700 1 -- 172.21.15.196:0/2680164073 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc0ad690 con 0x7f0ddc0c3ac0 2023-06-22T16:23:32.482 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.458+0000 7f0dd8ff9700 1 -- 172.21.15.196:0/2680164073 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0dc401cd30 con 0x7f0ddc0c3ac0 2023-06-22T16:23:32.482 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.458+0000 7f0dd8ff9700 1 -- 172.21.15.196:0/2680164073 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f0dc4026890 con 0x7f0ddc0c3ac0 2023-06-22T16:23:32.482 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.462+0000 7f0de18b5700 1 -- 172.21.15.196:0/2680164073 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc069d70 con 0x7f0ddc0c3ac0 2023-06-22T16:23:32.483 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.462+0000 7f0dd8ff9700 1 -- 172.21.15.196:0/2680164073 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f0dc402b070 con 0x7f0ddc0c3ac0 2023-06-22T16:23:32.483 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:32.466+0000 7fb1dc005000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-22T16:23:32.502 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:32.493+0000 7f3581224000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-22T16:23:32.529 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:32.522+0000 7fb1dc005000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-22T16:23:32.550 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.542+0000 7f0de18b5700 1 -- 172.21.15.196:0/2680164073 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bc3c458c-c810-4c5a-b258-2de1cb3ca1f3", "id": 2} v 0) v1 -- 0x7f0ddc0c9c80 con 0x7f0ddc0c3ac0 2023-06-22T16:23:32.558 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.550+0000 7f0dd8ff9700 1 -- 172.21.15.196:0/2680164073 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bc3c458c-c810-4c5a-b258-2de1cb3ca1f3", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0dc4017070 con 0x7f0ddc0c3ac0 2023-06-22T16:23:32.559 INFO:teuthology.orchestra.run.smithi196.stdout:2 2023-06-22T16:23:32.559 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:32.553+0000 7f3581224000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-22T16:23:32.560 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.550+0000 7f0de18b5700 1 -- 172.21.15.196:0/2680164073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ddc0c3ac0 msgr2=0x7f0ddc0c2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.561 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.550+0000 7f0de18b5700 1 --2- 172.21.15.196:0/2680164073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ddc0c3ac0 0x7f0ddc0c2120 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4019000 tx=0x7f0dc401a000 comp rx=0 tx=0).stop 2023-06-22T16:23:32.561 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.550+0000 7f0de18b5700 1 -- 172.21.15.196:0/2680164073 shutdown_connections 2023-06-22T16:23:32.561 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.550+0000 7f0de18b5700 1 --2- 172.21.15.196:0/2680164073 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ddc0c2660 0x7f0ddc0ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.561 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.554+0000 7f0de18b5700 1 --2- 172.21.15.196:0/2680164073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ddc0c3ac0 0x7f0ddc0c2120 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.561 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.554+0000 7f0de18b5700 1 --2- 172.21.15.196:0/2680164073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0dc8004810 0x7f0ddc0c3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.561 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.554+0000 7f0de18b5700 1 -- 172.21.15.196:0/2680164073 >> 172.21.15.196:0/2680164073 conn(0x7f0ddc06df10 msgr2=0x7f0ddc0c91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:32.562 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.554+0000 7f0de18b5700 1 -- 172.21.15.196:0/2680164073 shutdown_connections 2023-06-22T16:23:32.562 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.554+0000 7f0de18b5700 1 -- 172.21.15.196:0/2680164073 wait complete. 2023-06-22T16:23:32.576 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 04bf7f65-1946-499c-aea9-c4caa92e8488 3 2023-06-22T16:23:32.636 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:32.626+0000 7fb1dc005000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-22T16:23:32.674 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:32.665+0000 7f3581224000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-22T16:23:32.680 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.670+0000 7f96c69cd700 1 Processor -- start 2023-06-22T16:23:32.680 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.670+0000 7f96c69cd700 1 -- start start 2023-06-22T16:23:32.681 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f96c0158be0 0x7f96c015d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.682 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f96c0069f10 0x7f96c006d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.682 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c015d780 con 0x7f96c006f1b0 2023-06-22T16:23:32.682 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c00cb7d0 con 0x7f96c0158be0 2023-06-22T16:23:32.682 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c00cbab0 con 0x7f96c0069f10 2023-06-22T16:23:32.682 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c51ca700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f96c006f1b0 0x7f96c0069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:48942/0 (socket says 172.21.15.196:48942) 2023-06-22T16:23:32.683 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c51ca700 1 -- 172.21.15.196:0/2249418783 learned_addr learned my addr 172.21.15.196:0/2249418783 (peer_addr_for_me v1:172.21.15.196:0/0) 2023-06-22T16:23:32.683 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c61cc700 1 --2- 172.21.15.196:0/2249418783 >> v2:172.21.15.196:3300/0 conn(0x7f96c0069f10 0x7f96c006d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.683 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c59cb700 1 --2- 172.21.15.196:0/2249418783 >> v2:172.21.15.149:3300/0 conn(0x7f96c0158be0 0x7f96c015d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.683 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c49c9700 1 -- 172.21.15.196:0/2249418783 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284317883 0 0) 0x7f96c015d780 con 0x7f96c006f1b0 2023-06-22T16:23:32.683 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c49c9700 1 -- 172.21.15.196:0/2249418783 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96ac003570 con 0x7f96c006f1b0 2023-06-22T16:23:32.683 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c61cc700 1 -- 172.21.15.196:0/2249418783 >> v2:172.21.15.149:3300/0 conn(0x7f96c0158be0 msgr2=0x7f96c015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:32.684 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c61cc700 1 --2- 172.21.15.196:0/2249418783 >> v2:172.21.15.149:3300/0 conn(0x7f96c0158be0 0x7f96c015d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.684 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c61cc700 1 -- 172.21.15.196:0/2249418783 >> v1:172.21.15.196:6789/0 conn(0x7f96c006f1b0 legacy=0x7f96c0069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.684 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c61cc700 1 -- 172.21.15.196:0/2249418783 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c00cc250 con 0x7f96c0069f10 2023-06-22T16:23:32.687 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c61cc700 1 --2- 172.21.15.196:0/2249418783 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96c0069f10 0x7f96c006d880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f96c00cd7b0 tx=0x7f96b8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e94ed1e146328f7d server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:32.687 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c49c9700 1 -- 172.21.15.196:0/2249418783 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b800e070 con 0x7f96c0069f10 2023-06-22T16:23:32.687 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c49c9700 1 -- 172.21.15.196:0/2249418783 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b800bab0 con 0x7f96c0069f10 2023-06-22T16:23:32.687 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c49c9700 1 -- 172.21.15.196:0/2249418783 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b800be50 con 0x7f96c0069f10 2023-06-22T16:23:32.687 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 -- 172.21.15.196:0/2249418783 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96c0069f10 msgr2=0x7f96c006d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.688 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 --2- 172.21.15.196:0/2249418783 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96c0069f10 0x7f96c006d880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f96c00cd7b0 tx=0x7f96b8009780 comp rx=0 tx=0).stop 2023-06-22T16:23:32.688 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 -- 172.21.15.196:0/2249418783 shutdown_connections 2023-06-22T16:23:32.688 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 --2- 172.21.15.196:0/2249418783 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96c0069f10 0x7f96c006d880 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.688 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 --2- 172.21.15.196:0/2249418783 >> v2:172.21.15.149:3300/0 conn(0x7f96c0158be0 0x7f96c015d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.689 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 -- 172.21.15.196:0/2249418783 >> 172.21.15.196:0/2249418783 conn(0x7f96c0068180 msgr2=0x7f96c0068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:32.689 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 -- 172.21.15.196:0/2249418783 shutdown_connections 2023-06-22T16:23:32.689 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 -- 172.21.15.196:0/2249418783 wait complete. 2023-06-22T16:23:32.689 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 Processor -- start 2023-06-22T16:23:32.689 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.674+0000 7f96c69cd700 1 -- start start 2023-06-22T16:23:32.689 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c69cd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96c0069f10 0x7f96c00b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.690 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c69cd700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96c006f1b0 0x7f96c013fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.690 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c69cd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96c0158be0 0x7f96c015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.690 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c69cd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c00b10e0 con 0x7f96c0069f10 2023-06-22T16:23:32.690 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c69cd700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c00b3890 con 0x7f96c0158be0 2023-06-22T16:23:32.690 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c69cd700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c00c58d0 con 0x7f96c006f1b0 2023-06-22T16:23:32.690 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c51ca700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96c006f1b0 0x7f96c013fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.690 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c51ca700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96c006f1b0 0x7f96c013fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:35688/0 (socket says 172.21.15.196:35688) 2023-06-22T16:23:32.691 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c51ca700 1 -- 172.21.15.196:0/4275719997 learned_addr learned my addr 172.21.15.196:0/4275719997 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-06-22T16:23:32.691 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c61cc700 1 --2- 172.21.15.196:0/4275719997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96c0158be0 0x7f96c015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.691 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c59cb700 1 --2- 172.21.15.196:0/4275719997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96c0069f10 0x7f96c00b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.691 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c51ca700 1 -- 172.21.15.196:0/4275719997 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96c006f1b0 msgr2=0x7f96c013fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-06-22T16:23:32.692 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c51ca700 1 -- 172.21.15.196:0/4275719997 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96c006f1b0 msgr2=0x7f96c013fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-06-22T16:23:32.692 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c51ca700 1 --2- 172.21.15.196:0/4275719997 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96c006f1b0 0x7f96c013fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:32.692 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c51ca700 1 --2- 172.21.15.196:0/4275719997 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96c006f1b0 0x7f96c013fc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:32.692 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c59cb700 1 -- 172.21.15.196:0/4275719997 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96c006f1b0 msgr2=0x7f96c013fc40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-22T16:23:32.692 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c59cb700 1 --2- 172.21.15.196:0/4275719997 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96c006f1b0 0x7f96c013fc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.692 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c59cb700 1 -- 172.21.15.196:0/4275719997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96c0158be0 msgr2=0x7f96c015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.692 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c59cb700 1 --2- 172.21.15.196:0/4275719997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96c0158be0 0x7f96c015d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.693 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c59cb700 1 -- 172.21.15.196:0/4275719997 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b8009a20 con 0x7f96c0069f10 2023-06-22T16:23:32.693 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c61cc700 1 --2- 172.21.15.196:0/4275719997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96c0158be0 0x7f96c015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T16:23:32.693 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c59cb700 1 --2- 172.21.15.196:0/4275719997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96c0069f10 0x7f96c00b0ba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f96bc00e900 tx=0x7f96bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:32.694 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96b5ffb700 1 -- 172.21.15.196:0/4275719997 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc009450 con 0x7f96c0069f10 2023-06-22T16:23:32.694 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96b5ffb700 1 -- 172.21.15.196:0/4275719997 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc013680 con 0x7f96c0069f10 2023-06-22T16:23:32.694 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c69cd700 1 -- 172.21.15.196:0/4275719997 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c00c4fa0 con 0x7f96c0069f10 2023-06-22T16:23:32.694 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96b5ffb700 1 -- 172.21.15.196:0/4275719997 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc013a40 con 0x7f96c0069f10 2023-06-22T16:23:32.695 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c69cd700 1 -- 172.21.15.196:0/4275719997 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c00c5560 con 0x7f96c0069f10 2023-06-22T16:23:32.695 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96b5ffb700 1 -- 172.21.15.196:0/4275719997 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f96bc005c80 con 0x7f96c0069f10 2023-06-22T16:23:32.695 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96b5ffb700 1 -- 172.21.15.196:0/4275719997 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f96bc013db0 con 0x7f96c0069f10 2023-06-22T16:23:32.695 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.678+0000 7f96c69cd700 1 -- 172.21.15.196:0/4275719997 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c006b670 con 0x7f96c0069f10 2023-06-22T16:23:32.696 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.686+0000 7f96b5ffb700 1 -- 172.21.15.196:0/4275719997 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f96bc021060 con 0x7f96c0069f10 2023-06-22T16:23:32.769 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.762+0000 7f96c69cd700 1 -- 172.21.15.196:0/4275719997 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "04bf7f65-1946-499c-aea9-c4caa92e8488", "id": 3} v 0) v1 -- 0x7f96c00cc530 con 0x7f96c0069f10 2023-06-22T16:23:32.792 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.782+0000 7f96b5ffb700 1 -- 172.21.15.196:0/4275719997 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "04bf7f65-1946-499c-aea9-c4caa92e8488", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f96bc029020 con 0x7f96c0069f10 2023-06-22T16:23:32.793 INFO:teuthology.orchestra.run.smithi196.stdout:3 2023-06-22T16:23:32.794 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.786+0000 7f96c69cd700 1 -- 172.21.15.196:0/4275719997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96c0069f10 msgr2=0x7f96c00b0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.794 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.786+0000 7f96c69cd700 1 --2- 172.21.15.196:0/4275719997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96c0069f10 0x7f96c00b0ba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f96bc00e900 tx=0x7f96bc0091a0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.794 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.786+0000 7f96c69cd700 1 -- 172.21.15.196:0/4275719997 shutdown_connections 2023-06-22T16:23:32.794 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.786+0000 7f96c69cd700 1 --2- 172.21.15.196:0/4275719997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96c0158be0 0x7f96c015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.794 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.786+0000 7f96c69cd700 1 --2- 172.21.15.196:0/4275719997 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96c006f1b0 0x7f96c013fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.794 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.786+0000 7f96c69cd700 1 --2- 172.21.15.196:0/4275719997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96c0069f10 0x7f96c00b0ba0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.794 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.786+0000 7f96c69cd700 1 -- 172.21.15.196:0/4275719997 >> 172.21.15.196:0/4275719997 conn(0x7f96c0068180 msgr2=0x7f96c00c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:32.795 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.786+0000 7f96c69cd700 1 -- 172.21.15.196:0/4275719997 shutdown_connections 2023-06-22T16:23:32.795 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.786+0000 7f96c69cd700 1 -- 172.21.15.196:0/4275719997 wait complete. 2023-06-22T16:23:32.807 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new e49f385d-76d9-4304-8486-3e1f3cb8fd23 4 2023-06-22T16:23:32.864 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:32.854+0000 7fb1dc005000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-22T16:23:32.908 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.898+0000 7efe1db8d700 1 Processor -- start 2023-06-22T16:23:32.909 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.898+0000 7efe1db8d700 1 -- start start 2023-06-22T16:23:32.910 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe1db8d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efe180cd6c0 0x7efe1806c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.910 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe1db8d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe180ccb20 con 0x7efe180b24f0 2023-06-22T16:23:32.910 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe1db8d700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe180ab710 con 0x7efe1806c5b0 2023-06-22T16:23:32.910 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe1db8d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe180ab9d0 con 0x7efe180cd6c0 2023-06-22T16:23:32.910 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe1cb8b700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7efe1806c5b0 0x7efe180ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:48950/0 (socket says 172.21.15.196:48950) 2023-06-22T16:23:32.910 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe1cb8b700 1 -- 172.21.15.196:0/3374594197 learned_addr learned my addr 172.21.15.196:0/3374594197 (peer_addr_for_me v1:172.21.15.196:0/0) 2023-06-22T16:23:32.911 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe17fff700 1 --2- 172.21.15.196:0/3374594197 >> v2:172.21.15.149:3300/0 conn(0x7efe180cd6c0 0x7efe1806c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.911 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe177fe700 1 -- 172.21.15.196:0/3374594197 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955469241 0 0) 0x7efe180ab710 con 0x7efe1806c5b0 2023-06-22T16:23:32.911 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe177fe700 1 -- 172.21.15.196:0/3374594197 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe08003570 con 0x7efe1806c5b0 2023-06-22T16:23:32.912 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe17fff700 1 -- 172.21.15.196:0/3374594197 >> v1:172.21.15.196:6789/0 conn(0x7efe1806c5b0 legacy=0x7efe180ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.912 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe17fff700 1 -- 172.21.15.196:0/3374594197 >> v1:172.21.15.149:6789/0 conn(0x7efe180b24f0 legacy=0x7efe181588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.912 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe17fff700 1 -- 172.21.15.196:0/3374594197 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe180abcb0 con 0x7efe180cd6c0 2023-06-22T16:23:32.912 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe17fff700 1 --2- 172.21.15.196:0/3374594197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe180cd6c0 0x7efe1806c980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efe040098e0 tx=0x7efe040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c33dcbb3109f8a server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:32.912 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe177fe700 1 -- 172.21.15.196:0/3374594197 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0400b640 con 0x7efe180cd6c0 2023-06-22T16:23:32.912 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:32.902+0000 7fb1dc005000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-22T16:23:32.916 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:32.909+0000 7f3581224000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-22T16:23:32.918 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe177fe700 1 -- 172.21.15.196:0/3374594197 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0400b7a0 con 0x7efe180cd6c0 2023-06-22T16:23:32.918 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe177fe700 1 -- 172.21.15.196:0/3374594197 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0400bb40 con 0x7efe180cd6c0 2023-06-22T16:23:32.918 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe1db8d700 1 -- 172.21.15.196:0/3374594197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe180cd6c0 msgr2=0x7efe1806c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.918 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe1db8d700 1 --2- 172.21.15.196:0/3374594197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe180cd6c0 0x7efe1806c980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efe040098e0 tx=0x7efe040091a0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.918 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe1db8d700 1 -- 172.21.15.196:0/3374594197 shutdown_connections 2023-06-22T16:23:32.919 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe1db8d700 1 --2- 172.21.15.196:0/3374594197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe180cd6c0 0x7efe1806c980 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.919 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe1db8d700 1 -- 172.21.15.196:0/3374594197 >> 172.21.15.196:0/3374594197 conn(0x7efe1806df10 msgr2=0x7efe1806b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:32.919 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe1db8d700 1 -- 172.21.15.196:0/3374594197 shutdown_connections 2023-06-22T16:23:32.919 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.902+0000 7efe1db8d700 1 -- 172.21.15.196:0/3374594197 wait complete. 2023-06-22T16:23:32.919 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1db8d700 1 Processor -- start 2023-06-22T16:23:32.919 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1db8d700 1 -- start start 2023-06-22T16:23:32.919 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1db8d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe1806c5b0 0x7efe181520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.920 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1db8d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe180b24f0 0x7efe180c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.920 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1db8d700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe180cd6c0 0x7efe180c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:32.920 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1db8d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe18159fc0 con 0x7efe1806c5b0 2023-06-22T16:23:32.920 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1db8d700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe181593b0 con 0x7efe180b24f0 2023-06-22T16:23:32.920 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1db8d700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe18159690 con 0x7efe180cd6c0 2023-06-22T16:23:32.920 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe17fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe180b24f0 0x7efe180c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.920 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1d38c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe180cd6c0 0x7efe180c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.920 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe17fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe180b24f0 0x7efe180c67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:47812/0 (socket says 172.21.15.196:47812) 2023-06-22T16:23:32.921 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1cb8b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe1806c5b0 0x7efe181520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:32.921 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe17fff700 1 -- 172.21.15.196:0/1029188296 learned_addr learned my addr 172.21.15.196:0/1029188296 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-06-22T16:23:32.921 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1d38c700 1 -- 172.21.15.196:0/1029188296 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe180cd6c0 msgr2=0x7efe180c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-06-22T16:23:32.921 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1d38c700 1 -- 172.21.15.196:0/1029188296 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe180cd6c0 msgr2=0x7efe180c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-06-22T16:23:32.921 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1d38c700 1 --2- 172.21.15.196:0/1029188296 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe180cd6c0 0x7efe180c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:32.921 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1d38c700 1 --2- 172.21.15.196:0/1029188296 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe180cd6c0 0x7efe180c6cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:32.921 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe17fff700 1 -- 172.21.15.196:0/1029188296 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe180cd6c0 msgr2=0x7efe180c6cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-22T16:23:32.921 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe17fff700 1 --2- 172.21.15.196:0/1029188296 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe180cd6c0 0x7efe180c6cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.922 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe17fff700 1 -- 172.21.15.196:0/1029188296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe1806c5b0 msgr2=0x7efe181520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:32.922 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe17fff700 1 --2- 172.21.15.196:0/1029188296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe1806c5b0 0x7efe181520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:32.922 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe17fff700 1 -- 172.21.15.196:0/1029188296 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04009420 con 0x7efe180b24f0 2023-06-22T16:23:32.922 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe17fff700 1 --2- 172.21.15.196:0/1029188296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe180b24f0 0x7efe180c67b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efe04013000 tx=0x7efe04017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:32.922 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe14ff9700 1 -- 172.21.15.196:0/1029188296 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04000d10 con 0x7efe180b24f0 2023-06-22T16:23:32.922 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe14ff9700 1 -- 172.21.15.196:0/1029188296 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0400bb20 con 0x7efe180b24f0 2023-06-22T16:23:32.922 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1db8d700 1 -- 172.21.15.196:0/1029188296 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe18159970 con 0x7efe180b24f0 2023-06-22T16:23:32.923 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe14ff9700 1 -- 172.21.15.196:0/1029188296 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04011650 con 0x7efe180b24f0 2023-06-22T16:23:32.923 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1db8d700 1 -- 172.21.15.196:0/1029188296 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe18152600 con 0x7efe180b24f0 2023-06-22T16:23:32.923 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe14ff9700 1 -- 172.21.15.196:0/1029188296 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7efe04011c80 con 0x7efe180b24f0 2023-06-22T16:23:32.923 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe14ff9700 1 -- 172.21.15.196:0/1029188296 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7efe0402d3f0 con 0x7efe180b24f0 2023-06-22T16:23:32.923 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.906+0000 7efe1db8d700 1 -- 172.21.15.196:0/1029188296 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe18069d70 con 0x7efe180b24f0 2023-06-22T16:23:32.923 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.910+0000 7efe14ff9700 1 -- 172.21.15.196:0/1029188296 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7efe04029070 con 0x7efe180b24f0 2023-06-22T16:23:32.966 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:32.957+0000 7f3581224000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-22T16:23:32.993 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.986+0000 7efe1db8d700 1 -- 172.21.15.196:0/1029188296 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e49f385d-76d9-4304-8486-3e1f3cb8fd23", "id": 4} v 0) v1 -- 0x7efe180abf90 con 0x7efe180b24f0 2023-06-22T16:23:33.002 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.994+0000 7efe14ff9700 1 -- 172.21.15.196:0/1029188296 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e49f385d-76d9-4304-8486-3e1f3cb8fd23", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7efe04015020 con 0x7efe180b24f0 2023-06-22T16:23:33.003 INFO:teuthology.orchestra.run.smithi196.stdout:4 2023-06-22T16:23:33.004 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.994+0000 7efe1db8d700 1 -- 172.21.15.196:0/1029188296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe180b24f0 msgr2=0x7efe180c67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.004 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.994+0000 7efe1db8d700 1 --2- 172.21.15.196:0/1029188296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe180b24f0 0x7efe180c67b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efe04013000 tx=0x7efe04017000 comp rx=0 tx=0).stop 2023-06-22T16:23:33.005 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.994+0000 7efe1db8d700 1 -- 172.21.15.196:0/1029188296 shutdown_connections 2023-06-22T16:23:33.005 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.994+0000 7efe1db8d700 1 --2- 172.21.15.196:0/1029188296 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe180cd6c0 0x7efe180c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.006 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.994+0000 7efe1db8d700 1 --2- 172.21.15.196:0/1029188296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe180b24f0 0x7efe180c67b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.006 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.994+0000 7efe1db8d700 1 --2- 172.21.15.196:0/1029188296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe1806c5b0 0x7efe181520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.006 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.994+0000 7efe1db8d700 1 -- 172.21.15.196:0/1029188296 >> 172.21.15.196:0/1029188296 conn(0x7efe1806df10 msgr2=0x7efe18156b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:33.006 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.994+0000 7efe1db8d700 1 -- 172.21.15.196:0/1029188296 shutdown_connections 2023-06-22T16:23:33.007 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:32.994+0000 7efe1db8d700 1 -- 172.21.15.196:0/1029188296 wait complete. 2023-06-22T16:23:33.016 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 671a4069-7c86-4a14-825c-1179a74928c4 5 2023-06-22T16:23:33.079 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:33.070+0000 7fb1dc005000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-22T16:23:33.118 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f82df700 1 Processor -- start 2023-06-22T16:23:33.118 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f82df700 1 -- start start 2023-06-22T16:23:33.119 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f82df700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 0x7f91f00c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.120 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f82df700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f91f006d5d0 0x7f91f00c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.120 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f82df700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f00c9560 con 0x7f91f0147080 2023-06-22T16:23:33.120 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f82df700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f00c8950 con 0x7f91f006d5d0 2023-06-22T16:23:33.120 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f82df700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00c8c30 con 0x7f91f00691f0 2023-06-22T16:23:33.120 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f687c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f91f006d5d0 0x7f91f00c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.121 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f587a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 0x7f91f00c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.121 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f687c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f91f006d5d0 0x7f91f00c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:47820/0 (socket says 172.21.15.196:47820) 2023-06-22T16:23:33.121 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f687c700 1 -- 172.21.15.196:0/3797342653 learned_addr learned my addr 172.21.15.196:0/3797342653 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-06-22T16:23:33.121 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f587a700 1 -- 172.21.15.196:0/3797342653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 msgr2=0x7f91f00c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-22T16:23:33.121 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f587a700 1 -- 172.21.15.196:0/3797342653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 msgr2=0x7f91f00c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:33.122 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f587a700 1 --2- 172.21.15.196:0/3797342653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 0x7f91f00c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:33.122 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f587a700 1 --2- 172.21.15.196:0/3797342653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 0x7f91f00c7b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:33.123 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f687c700 1 -- 172.21.15.196:0/3797342653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 msgr2=0x7f91f00c7b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T16:23:33.123 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f687c700 1 --2- 172.21.15.196:0/3797342653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 0x7f91f00c7b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.123 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f687c700 1 -- 172.21.15.196:0/3797342653 >> v1:172.21.15.149:6789/0 conn(0x7f91f0147080 legacy=0x7f91f0068ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.124 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f687c700 1 -- 172.21.15.196:0/3797342653 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f00c8f10 con 0x7f91f006d5d0 2023-06-22T16:23:33.124 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.110+0000 7f91f687c700 1 --2- 172.21.15.196:0/3797342653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91f006d5d0 0x7f91f00c80d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f91e8009f20 tx=0x7f91e8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f558064af6adbee server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:33.124 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f5079700 1 -- 172.21.15.196:0/3797342653 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e800e070 con 0x7f91f006d5d0 2023-06-22T16:23:33.124 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f5079700 1 -- 172.21.15.196:0/3797342653 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e800ba80 con 0x7f91f006d5d0 2023-06-22T16:23:33.124 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f5079700 1 -- 172.21.15.196:0/3797342653 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e80092e0 con 0x7f91f006d5d0 2023-06-22T16:23:33.124 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 -- 172.21.15.196:0/3797342653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91f006d5d0 msgr2=0x7f91f00c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.124 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 --2- 172.21.15.196:0/3797342653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91f006d5d0 0x7f91f00c80d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f91e8009f20 tx=0x7f91e8009840 comp rx=0 tx=0).stop 2023-06-22T16:23:33.125 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 -- 172.21.15.196:0/3797342653 shutdown_connections 2023-06-22T16:23:33.125 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 --2- 172.21.15.196:0/3797342653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91f006d5d0 0x7f91f00c80d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.125 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 --2- 172.21.15.196:0/3797342653 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 0x7f91f00c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.125 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 -- 172.21.15.196:0/3797342653 >> 172.21.15.196:0/3797342653 conn(0x7f91f0067f50 msgr2=0x7f91f00ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:33.125 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 -- 172.21.15.196:0/3797342653 shutdown_connections 2023-06-22T16:23:33.125 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 -- 172.21.15.196:0/3797342653 wait complete. 2023-06-22T16:23:33.125 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 Processor -- start 2023-06-22T16:23:33.126 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 -- start start 2023-06-22T16:23:33.127 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 0x7f91f00c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.128 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f006d5d0 0x7f91f01434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.128 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91f0147080 0x7f91f0170aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.128 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00c35a0 con 0x7f91f006d5d0 2023-06-22T16:23:33.128 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00c2990 con 0x7f91f0147080 2023-06-22T16:23:33.128 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f82df700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00c2c70 con 0x7f91f00691f0 2023-06-22T16:23:33.129 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f607b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 0x7f91f00c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.129 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f607b700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 0x7f91f00c2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:35720/0 (socket says 172.21.15.196:35720) 2023-06-22T16:23:33.129 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f687c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91f0147080 0x7f91f0170aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.129 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f607b700 1 -- 172.21.15.196:0/582774079 learned_addr learned my addr 172.21.15.196:0/582774079 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-06-22T16:23:33.129 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f587a700 1 --2- 172.21.15.196:0/582774079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f006d5d0 0x7f91f01434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.129 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f607b700 1 -- 172.21.15.196:0/582774079 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 msgr2=0x7f91f00c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-06-22T16:23:33.130 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f607b700 1 -- 172.21.15.196:0/582774079 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 msgr2=0x7f91f00c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-06-22T16:23:33.130 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f607b700 1 --2- 172.21.15.196:0/582774079 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 0x7f91f00c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:33.130 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.114+0000 7f91f607b700 1 --2- 172.21.15.196:0/582774079 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 0x7f91f00c2140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:33.130 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91f687c700 1 -- 172.21.15.196:0/582774079 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 msgr2=0x7f91f00c2140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-22T16:23:33.130 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91f687c700 1 --2- 172.21.15.196:0/582774079 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 0x7f91f00c2140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.130 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91f687c700 1 -- 172.21.15.196:0/582774079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f006d5d0 msgr2=0x7f91f01434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.130 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91f687c700 1 --2- 172.21.15.196:0/582774079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f006d5d0 0x7f91f01434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.131 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91f687c700 1 -- 172.21.15.196:0/582774079 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e8009ae0 con 0x7f91f0147080 2023-06-22T16:23:33.131 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91f687c700 1 --2- 172.21.15.196:0/582774079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91f0147080 0x7f91f0170aa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f91e8015000 tx=0x7f91e8018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:33.131 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91e67fc700 1 -- 172.21.15.196:0/582774079 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e80032f0 con 0x7f91f0147080 2023-06-22T16:23:33.131 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91e67fc700 1 -- 172.21.15.196:0/582774079 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e8008dd0 con 0x7f91f0147080 2023-06-22T16:23:33.131 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91f82df700 1 -- 172.21.15.196:0/582774079 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f00c2f50 con 0x7f91f0147080 2023-06-22T16:23:33.131 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91e67fc700 1 -- 172.21.15.196:0/582774079 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8026690 con 0x7f91f0147080 2023-06-22T16:23:33.131 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91f82df700 1 -- 172.21.15.196:0/582774079 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f00c3a30 con 0x7f91f0147080 2023-06-22T16:23:33.132 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91e67fc700 1 -- 172.21.15.196:0/582774079 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f91e8003040 con 0x7f91f0147080 2023-06-22T16:23:33.132 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91e67fc700 1 -- 172.21.15.196:0/582774079 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f91e8026df0 con 0x7f91f0147080 2023-06-22T16:23:33.132 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.118+0000 7f91f82df700 1 -- 172.21.15.196:0/582774079 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f004bc30 con 0x7f91f0147080 2023-06-22T16:23:33.133 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.122+0000 7f91e67fc700 1 -- 172.21.15.196:0/582774079 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f91e8021070 con 0x7f91f0147080 2023-06-22T16:23:33.143 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:33.134+0000 7fb1dc005000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-22T16:23:33.151 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:33.145+0000 7f3581224000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-22T16:23:33.203 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.194+0000 7f91f82df700 1 -- 172.21.15.196:0/582774079 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "671a4069-7c86-4a14-825c-1179a74928c4", "id": 5} v 0) v1 -- 0x7f91f0070ab0 con 0x7f91f0147080 2023-06-22T16:23:33.204 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:33.194+0000 7fb1dc005000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-22T16:23:33.211 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:33.205+0000 7f3581224000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-22T16:23:33.213 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.206+0000 7f91e67fc700 1 -- 172.21.15.196:0/582774079 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "671a4069-7c86-4a14-825c-1179a74928c4", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f91e8031440 con 0x7f91f0147080 2023-06-22T16:23:33.213 INFO:teuthology.orchestra.run.smithi196.stdout:5 2023-06-22T16:23:33.215 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.206+0000 7f91f82df700 1 -- 172.21.15.196:0/582774079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91f0147080 msgr2=0x7f91f0170aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.215 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.206+0000 7f91f82df700 1 --2- 172.21.15.196:0/582774079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91f0147080 0x7f91f0170aa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f91e8015000 tx=0x7f91e8018000 comp rx=0 tx=0).stop 2023-06-22T16:23:33.215 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.206+0000 7f91f82df700 1 -- 172.21.15.196:0/582774079 shutdown_connections 2023-06-22T16:23:33.215 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.206+0000 7f91f82df700 1 --2- 172.21.15.196:0/582774079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91f0147080 0x7f91f0170aa0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.216 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.206+0000 7f91f82df700 1 --2- 172.21.15.196:0/582774079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f006d5d0 0x7f91f01434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.216 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.206+0000 7f91f82df700 1 --2- 172.21.15.196:0/582774079 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91f00691f0 0x7f91f00c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.216 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.206+0000 7f91f82df700 1 -- 172.21.15.196:0/582774079 >> 172.21.15.196:0/582774079 conn(0x7f91f0067f50 msgr2=0x7f91f015cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:33.216 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.206+0000 7f91f82df700 1 -- 172.21.15.196:0/582774079 shutdown_connections 2023-06-22T16:23:33.216 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.206+0000 7f91f82df700 1 -- 172.21.15.196:0/582774079 wait complete. 2023-06-22T16:23:33.228 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 7114b0c3-27fe-4816-8cc8-fb3679b8e707 6 2023-06-22T16:23:33.272 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:33.265+0000 7f3581224000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-22T16:23:33.334 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d8a633700 1 Processor -- start 2023-06-22T16:23:33.335 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d8a633700 1 -- start start 2023-06-22T16:23:33.336 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d8a633700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84154fc0 0x7f2d84155390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.336 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d8a633700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d84068b70 0x7f2d8406c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.336 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d8a633700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2d84068fc0 0x7f2d8406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.336 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d8a633700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8406d1f0 con 0x7f2d84068b70 2023-06-22T16:23:33.336 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d8a633700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d84067ad0 con 0x7f2d84068fc0 2023-06-22T16:23:33.337 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d8a633700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84067db0 con 0x7f2d84154fc0 2023-06-22T16:23:33.337 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d89631700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84154fc0 0x7f2d84155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.337 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d89631700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84154fc0 0x7f2d84155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:51610/0 (socket says 172.21.15.196:51610) 2023-06-22T16:23:33.337 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d89631700 1 -- 172.21.15.196:0/3103830779 learned_addr learned my addr 172.21.15.196:0/3103830779 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-06-22T16:23:33.337 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d89e32700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2d84068fc0 0x7f2d8406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.339 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d88e30700 1 --2- 172.21.15.196:0/3103830779 >> v2:172.21.15.149:3300/0 conn(0x7f2d84068b70 0x7f2d8406c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.339 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d89631700 1 -- 172.21.15.196:0/3103830779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84154fc0 msgr2=0x7f2d84155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-22T16:23:33.339 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.326+0000 7f2d89631700 1 -- 172.21.15.196:0/3103830779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84154fc0 msgr2=0x7f2d84155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T16:23:33.339 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d89631700 1 --2- 172.21.15.196:0/3103830779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84154fc0 0x7f2d84155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:33.339 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d89631700 1 --2- 172.21.15.196:0/3103830779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84154fc0 0x7f2d84155390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:33.339 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d89e32700 1 -- 172.21.15.196:0/3103830779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84154fc0 msgr2=0x7f2d84155390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T16:23:33.339 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d89e32700 1 --2- 172.21.15.196:0/3103830779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84154fc0 0x7f2d84155390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.340 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d89e32700 1 -- 172.21.15.196:0/3103830779 >> v2:172.21.15.149:3300/0 conn(0x7f2d84068b70 msgr2=0x7f2d8406c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:33.340 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d89e32700 1 --2- 172.21.15.196:0/3103830779 >> v2:172.21.15.149:3300/0 conn(0x7f2d84068b70 0x7f2d8406c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.340 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d89e32700 1 -- 172.21.15.196:0/3103830779 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d84068090 con 0x7f2d84068fc0 2023-06-22T16:23:33.340 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d89e32700 1 --2- 172.21.15.196:0/3103830779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d84068fc0 0x7f2d8406c8c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2d840c87b0 tx=0x7f2d7c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=206dee1a209ec614 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:33.340 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d7bfff700 1 -- 172.21.15.196:0/3103830779 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c00e070 con 0x7f2d84068fc0 2023-06-22T16:23:33.340 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d7bfff700 1 -- 172.21.15.196:0/3103830779 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c00bb60 con 0x7f2d84068fc0 2023-06-22T16:23:33.340 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d7bfff700 1 -- 172.21.15.196:0/3103830779 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c012430 con 0x7f2d84068fc0 2023-06-22T16:23:33.341 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 -- 172.21.15.196:0/3103830779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d84068fc0 msgr2=0x7f2d8406c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.341 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 --2- 172.21.15.196:0/3103830779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d84068fc0 0x7f2d8406c8c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2d840c87b0 tx=0x7f2d7c009780 comp rx=0 tx=0).stop 2023-06-22T16:23:33.341 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 -- 172.21.15.196:0/3103830779 shutdown_connections 2023-06-22T16:23:33.341 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 --2- 172.21.15.196:0/3103830779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d84068fc0 0x7f2d8406c8c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.341 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 --2- 172.21.15.196:0/3103830779 >> v2:172.21.15.149:3300/0 conn(0x7f2d84068b70 0x7f2d8406c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.341 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 --2- 172.21.15.196:0/3103830779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84154fc0 0x7f2d84155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.341 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 -- 172.21.15.196:0/3103830779 >> 172.21.15.196:0/3103830779 conn(0x7f2d840c8bb0 msgr2=0x7f2d840c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:33.341 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 -- 172.21.15.196:0/3103830779 shutdown_connections 2023-06-22T16:23:33.342 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 -- 172.21.15.196:0/3103830779 wait complete. 2023-06-22T16:23:33.344 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 Processor -- start 2023-06-22T16:23:33.344 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 -- start start 2023-06-22T16:23:33.344 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d84068b70 0x7f2d840a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.344 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84068fc0 0x7f2d840c3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.344 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d84154fc0 0x7f2d840aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.344 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8416ceb0 con 0x7f2d84068b70 2023-06-22T16:23:33.344 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8414b1c0 con 0x7f2d84154fc0 2023-06-22T16:23:33.345 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d8a633700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d840ad700 con 0x7f2d84068fc0 2023-06-22T16:23:33.345 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d89e32700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d84154fc0 0x7f2d840aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.345 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d89e32700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d84154fc0 0x7f2d840aa9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:40830/0 (socket says 172.21.15.196:40830) 2023-06-22T16:23:33.345 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d89e32700 1 -- 172.21.15.196:0/3303560014 learned_addr learned my addr 172.21.15.196:0/3303560014 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-06-22T16:23:33.345 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d88e30700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84068fc0 0x7f2d840c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.345 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d89631700 1 --2- 172.21.15.196:0/3303560014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d84068b70 0x7f2d840a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.345 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.330+0000 7f2d88e30700 1 -- 172.21.15.196:0/3303560014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84068fc0 msgr2=0x7f2d840c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-06-22T16:23:33.346 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d88e30700 1 -- 172.21.15.196:0/3303560014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84068fc0 msgr2=0x7f2d840c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-06-22T16:23:33.346 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d88e30700 1 --2- 172.21.15.196:0/3303560014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84068fc0 0x7f2d840c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:33.346 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d89e32700 1 -- 172.21.15.196:0/3303560014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84068fc0 msgr2=0x7f2d840c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.346 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d88e30700 1 --2- 172.21.15.196:0/3303560014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84068fc0 0x7f2d840c3380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:33.346 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d89e32700 1 --2- 172.21.15.196:0/3303560014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84068fc0 0x7f2d840c3380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.346 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d89e32700 1 -- 172.21.15.196:0/3303560014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d84068b70 msgr2=0x7f2d840a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.346 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d89e32700 1 --2- 172.21.15.196:0/3303560014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d84068b70 0x7f2d840a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.346 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d89e32700 1 -- 172.21.15.196:0/3303560014 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c009a20 con 0x7f2d84154fc0 2023-06-22T16:23:33.347 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d89e32700 1 --2- 172.21.15.196:0/3303560014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d84154fc0 0x7f2d840aa9d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c013000 tx=0x7f2d7c019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:33.347 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d797fa700 1 -- 172.21.15.196:0/3303560014 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c027470 con 0x7f2d84154fc0 2023-06-22T16:23:33.347 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d797fa700 1 -- 172.21.15.196:0/3303560014 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c0275f0 con 0x7f2d84154fc0 2023-06-22T16:23:33.347 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d8a633700 1 -- 172.21.15.196:0/3303560014 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8416cbd0 con 0x7f2d84154fc0 2023-06-22T16:23:33.347 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d797fa700 1 -- 172.21.15.196:0/3303560014 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0279b0 con 0x7f2d84154fc0 2023-06-22T16:23:33.347 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d8a633700 1 -- 172.21.15.196:0/3303560014 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d840ad390 con 0x7f2d84154fc0 2023-06-22T16:23:33.347 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d797fa700 1 -- 172.21.15.196:0/3303560014 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2d7c024070 con 0x7f2d84154fc0 2023-06-22T16:23:33.347 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d797fa700 1 -- 172.21.15.196:0/3303560014 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f2d7c01ea60 con 0x7f2d84154fc0 2023-06-22T16:23:33.348 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d8a633700 1 -- 172.21.15.196:0/3303560014 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d840acf10 con 0x7f2d84154fc0 2023-06-22T16:23:33.348 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.334+0000 7f2d797fa700 1 -- 172.21.15.196:0/3303560014 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f2d7c0466e0 con 0x7f2d84154fc0 2023-06-22T16:23:33.422 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.414+0000 7f2d8a633700 1 -- 172.21.15.196:0/3303560014 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7114b0c3-27fe-4816-8cc8-fb3679b8e707", "id": 6} v 0) v1 -- 0x7f2d840ad840 con 0x7f2d84154fc0 2023-06-22T16:23:33.433 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.426+0000 7f2d797fa700 1 -- 172.21.15.196:0/3303560014 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7114b0c3-27fe-4816-8cc8-fb3679b8e707", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d7c035030 con 0x7f2d84154fc0 2023-06-22T16:23:33.433 INFO:teuthology.orchestra.run.smithi196.stdout:6 2023-06-22T16:23:33.434 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.426+0000 7f2d8a633700 1 -- 172.21.15.196:0/3303560014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d84154fc0 msgr2=0x7f2d840aa9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.435 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.426+0000 7f2d8a633700 1 --2- 172.21.15.196:0/3303560014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d84154fc0 0x7f2d840aa9d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c013000 tx=0x7f2d7c019000 comp rx=0 tx=0).stop 2023-06-22T16:23:33.435 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.426+0000 7f2d8a633700 1 -- 172.21.15.196:0/3303560014 shutdown_connections 2023-06-22T16:23:33.435 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.426+0000 7f2d8a633700 1 --2- 172.21.15.196:0/3303560014 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d84154fc0 0x7f2d840aa9d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.435 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.426+0000 7f2d8a633700 1 --2- 172.21.15.196:0/3303560014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d84068fc0 0x7f2d840c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.435 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.426+0000 7f2d8a633700 1 --2- 172.21.15.196:0/3303560014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d84068b70 0x7f2d840a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.435 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.426+0000 7f2d8a633700 1 -- 172.21.15.196:0/3303560014 >> 172.21.15.196:0/3303560014 conn(0x7f2d840c8bb0 msgr2=0x7f2d840ab720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:33.435 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.426+0000 7f2d8a633700 1 -- 172.21.15.196:0/3303560014 shutdown_connections 2023-06-22T16:23:33.436 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.426+0000 7f2d8a633700 1 -- 172.21.15.196:0/3303560014 wait complete. 2023-06-22T16:23:33.449 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new f9e6e633-0952-40bf-97e6-7c8b0bc804bd 7 2023-06-22T16:23:33.555 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.546+0000 7fa8bc81d700 1 Processor -- start 2023-06-22T16:23:33.555 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.546+0000 7fa8bc81d700 1 -- start start 2023-06-22T16:23:33.556 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.546+0000 7fa8bc81d700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa8b8158bf0 0x7fa8b80b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.557 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.546+0000 7fa8bc81d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa8b80b1c50 0x7fa8b8159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.557 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.546+0000 7fa8bc81d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b80b2060 con 0x7fa8b80b2b00 2023-06-22T16:23:33.557 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.546+0000 7fa8bc81d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b80b4b60 con 0x7fa8b80b1c50 2023-06-22T16:23:33.558 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.546+0000 7fa8bc81d700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b80b3ac0 con 0x7fa8b8158bf0 2023-06-22T16:23:33.558 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.546+0000 7fa8b77fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa8b8158bf0 0x7fa8b80b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.558 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.546+0000 7fa8b77fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa8b8158bf0 0x7fa8b80b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:40838/0 (socket says 172.21.15.196:40838) 2023-06-22T16:23:33.558 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.546+0000 7fa8b77fe700 1 -- 172.21.15.196:0/1033317100 learned_addr learned my addr 172.21.15.196:0/1033317100 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-06-22T16:23:33.558 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8b7fff700 1 --2- 172.21.15.196:0/1033317100 >> v2:172.21.15.149:3300/0 conn(0x7fa8b80b1c50 0x7fa8b8159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.559 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8b77fe700 1 -- 172.21.15.196:0/1033317100 >> v2:172.21.15.149:3300/0 conn(0x7fa8b80b1c50 msgr2=0x7fa8b8159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:33.559 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8b77fe700 1 --2- 172.21.15.196:0/1033317100 >> v2:172.21.15.149:3300/0 conn(0x7fa8b80b1c50 0x7fa8b8159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.559 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8b77fe700 1 -- 172.21.15.196:0/1033317100 >> v1:172.21.15.149:6789/0 conn(0x7fa8b80b2b00 legacy=0x7fa8b80ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.559 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8b77fe700 1 -- 172.21.15.196:0/1033317100 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b80b3da0 con 0x7fa8b8158bf0 2023-06-22T16:23:33.560 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8b77fe700 1 --2- 172.21.15.196:0/1033317100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8b8158bf0 0x7fa8b80b1710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa8b806c690 tx=0x7fa8a8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fef8162a2711ff75 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:33.561 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8b67fc700 1 -- 172.21.15.196:0/1033317100 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8009e70 con 0x7fa8b8158bf0 2023-06-22T16:23:33.561 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8b67fc700 1 -- 172.21.15.196:0/1033317100 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a800b860 con 0x7fa8b8158bf0 2023-06-22T16:23:33.561 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8b67fc700 1 -- 172.21.15.196:0/1033317100 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a800bc00 con 0x7fa8b8158bf0 2023-06-22T16:23:33.561 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8bc81d700 1 -- 172.21.15.196:0/1033317100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8b8158bf0 msgr2=0x7fa8b80b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.561 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8bc81d700 1 --2- 172.21.15.196:0/1033317100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8b8158bf0 0x7fa8b80b1710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa8b806c690 tx=0x7fa8a8009250 comp rx=0 tx=0).stop 2023-06-22T16:23:33.562 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8bc81d700 1 -- 172.21.15.196:0/1033317100 shutdown_connections 2023-06-22T16:23:33.562 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8bc81d700 1 --2- 172.21.15.196:0/1033317100 >> v2:172.21.15.149:3300/0 conn(0x7fa8b80b1c50 0x7fa8b8159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.562 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8bc81d700 1 --2- 172.21.15.196:0/1033317100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8b8158bf0 0x7fa8b80b1710 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.562 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8bc81d700 1 -- 172.21.15.196:0/1033317100 >> 172.21.15.196:0/1033317100 conn(0x7fa8b8063460 msgr2=0x7fa8b806da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:33.562 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8bc81d700 1 -- 172.21.15.196:0/1033317100 shutdown_connections 2023-06-22T16:23:33.562 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.550+0000 7fa8bc81d700 1 -- 172.21.15.196:0/1033317100 wait complete. 2023-06-22T16:23:33.562 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8bc81d700 1 Processor -- start 2023-06-22T16:23:33.563 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8bc81d700 1 -- start start 2023-06-22T16:23:33.565 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8bc81d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8b80b1c50 0x7fa8b813e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.565 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8bc81d700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8b80b2b00 0x7fa8b815aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.566 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8bc81d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8b8158bf0 0x7fa8b815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.566 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8bc81d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b815d490 con 0x7fa8b80b1c50 2023-06-22T16:23:33.566 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8bc81d700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b815c880 con 0x7fa8b8158bf0 2023-06-22T16:23:33.566 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8bc81d700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b815cb60 con 0x7fa8b80b2b00 2023-06-22T16:23:33.566 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b7fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8b8158bf0 0x7fa8b815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.566 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b6ffd700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8b80b2b00 0x7fa8b815aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.566 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b6ffd700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8b80b2b00 0x7fa8b815aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:51634/0 (socket says 172.21.15.196:51634) 2023-06-22T16:23:33.567 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b6ffd700 1 -- 172.21.15.196:0/971238535 learned_addr learned my addr 172.21.15.196:0/971238535 (peer_addr_for_me v2:172.21.15.196:0/0) 2023-06-22T16:23:33.567 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b77fe700 1 --2- 172.21.15.196:0/971238535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8b80b1c50 0x7fa8b813e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.567 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b6ffd700 1 -- 172.21.15.196:0/971238535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8b80b2b00 msgr2=0x7fa8b815aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-06-22T16:23:33.567 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b6ffd700 1 -- 172.21.15.196:0/971238535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8b80b2b00 msgr2=0x7fa8b815aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-06-22T16:23:33.567 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b6ffd700 1 --2- 172.21.15.196:0/971238535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8b80b2b00 0x7fa8b815aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:33.567 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b6ffd700 1 --2- 172.21.15.196:0/971238535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8b80b2b00 0x7fa8b815aac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:33.567 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b7fff700 1 -- 172.21.15.196:0/971238535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8b80b2b00 msgr2=0x7fa8b815aac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-22T16:23:33.568 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b7fff700 1 --2- 172.21.15.196:0/971238535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8b80b2b00 0x7fa8b815aac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.568 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b7fff700 1 -- 172.21.15.196:0/971238535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8b80b1c50 msgr2=0x7fa8b813e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.568 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b7fff700 1 --2- 172.21.15.196:0/971238535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8b80b1c50 0x7fa8b813e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.568 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b7fff700 1 -- 172.21.15.196:0/971238535 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a80094f0 con 0x7fa8b8158bf0 2023-06-22T16:23:33.568 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8b7fff700 1 --2- 172.21.15.196:0/971238535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8b8158bf0 0x7fa8b815b000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009e50 tx=0x7fa8b000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:33.568 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa89f7fe700 1 -- 172.21.15.196:0/971238535 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000cb50 con 0x7fa8b8158bf0 2023-06-22T16:23:33.569 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa89f7fe700 1 -- 172.21.15.196:0/971238535 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b000f040 con 0x7fa8b8158bf0 2023-06-22T16:23:33.569 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8bc81d700 1 -- 172.21.15.196:0/971238535 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b815ce40 con 0x7fa8b8158bf0 2023-06-22T16:23:33.569 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa89f7fe700 1 -- 172.21.15.196:0/971238535 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0014480 con 0x7fa8b8158bf0 2023-06-22T16:23:33.569 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8bc81d700 1 -- 172.21.15.196:0/971238535 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b813ea40 con 0x7fa8b8158bf0 2023-06-22T16:23:33.569 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa89f7fe700 1 -- 172.21.15.196:0/971238535 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa8b00147f0 con 0x7fa8b8158bf0 2023-06-22T16:23:33.570 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa89f7fe700 1 -- 172.21.15.196:0/971238535 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fa8b001dc00 con 0x7fa8b8158bf0 2023-06-22T16:23:33.570 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.554+0000 7fa8bc81d700 1 -- 172.21.15.196:0/971238535 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b815d640 con 0x7fa8b8158bf0 2023-06-22T16:23:33.570 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.558+0000 7fa89f7fe700 1 -- 172.21.15.196:0/971238535 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fa8b003b6e0 con 0x7fa8b8158bf0 2023-06-22T16:23:33.624 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:33.614+0000 7fb1dc005000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-22T16:23:33.640 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.630+0000 7fa8bc81d700 1 -- 172.21.15.196:0/971238535 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f9e6e633-0952-40bf-97e6-7c8b0bc804bd", "id": 7} v 0) v1 -- 0x7fa8b813ecc0 con 0x7fa8b8158bf0 2023-06-22T16:23:33.649 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.642+0000 7fa89f7fe700 1 -- 172.21.15.196:0/971238535 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9e6e633-0952-40bf-97e6-7c8b0bc804bd", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa8b002a070 con 0x7fa8b8158bf0 2023-06-22T16:23:33.649 INFO:teuthology.orchestra.run.smithi196.stdout:7 2023-06-22T16:23:33.650 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.642+0000 7fa8bc81d700 1 -- 172.21.15.196:0/971238535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8b8158bf0 msgr2=0x7fa8b815b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.650 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.642+0000 7fa8bc81d700 1 --2- 172.21.15.196:0/971238535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8b8158bf0 0x7fa8b815b000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009e50 tx=0x7fa8b000b040 comp rx=0 tx=0).stop 2023-06-22T16:23:33.651 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.642+0000 7fa8bc81d700 1 -- 172.21.15.196:0/971238535 shutdown_connections 2023-06-22T16:23:33.651 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.642+0000 7fa8bc81d700 1 --2- 172.21.15.196:0/971238535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8b8158bf0 0x7fa8b815b000 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.651 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.642+0000 7fa8bc81d700 1 --2- 172.21.15.196:0/971238535 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8b80b2b00 0x7fa8b815aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.651 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.642+0000 7fa8bc81d700 1 --2- 172.21.15.196:0/971238535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8b80b1c50 0x7fa8b813e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.651 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.642+0000 7fa8bc81d700 1 -- 172.21.15.196:0/971238535 >> 172.21.15.196:0/971238535 conn(0x7fa8b8063460 msgr2=0x7fa8b81510d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:33.651 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.642+0000 7fa8bc81d700 1 -- 172.21.15.196:0/971238535 shutdown_connections 2023-06-22T16:23:33.652 INFO:teuthology.orchestra.run.smithi196.stderr:2023-06-22T16:23:33.642+0000 7fa8bc81d700 1 -- 172.21.15.196:0/971238535 wait complete. 2023-06-22T16:23:33.655 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:33.649+0000 7f3581224000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-22T16:23:33.663 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-22T16:23:33.663 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-22T16:23:33.666 INFO:tasks.ceph.osd.0:Started 2023-06-22T16:23:33.667 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-22T16:23:33.668 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-22T16:23:33.670 INFO:tasks.ceph.osd.1:Started 2023-06-22T16:23:33.671 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-22T16:23:33.671 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-22T16:23:33.673 INFO:tasks.ceph.osd.2:Started 2023-06-22T16:23:33.673 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-22T16:23:33.674 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-22T16:23:33.676 INFO:tasks.ceph.osd.3:Started 2023-06-22T16:23:33.676 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-22T16:23:33.677 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-22T16:23:33.678 INFO:tasks.ceph.osd.4:Started 2023-06-22T16:23:33.679 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-22T16:23:33.679 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-22T16:23:33.681 INFO:tasks.ceph.osd.5:Started 2023-06-22T16:23:33.682 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-22T16:23:33.682 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-22T16:23:33.685 INFO:tasks.ceph.osd.6:Started 2023-06-22T16:23:33.685 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-22T16:23:33.686 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-22T16:23:33.688 INFO:tasks.ceph.osd.7:Started 2023-06-22T16:23:33.689 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T16:23:33.766 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:33.758+0000 7fb1dc005000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-22T16:23:33.794 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:33.785+0000 7f3581224000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-22T16:23:33.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.785+0000 7fa1baf02700 1 Processor -- start 2023-06-22T16:23:33.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.785+0000 7fa1baf02700 1 -- start start 2023-06-22T16:23:33.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1baf02700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa1b4158d60 0x7fa1b4159130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1baf02700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa1b40b3df0 0x7fa1b40b4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1baf02700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b40cabb0 con 0x7fa1b40b1d10 2023-06-22T16:23:33.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1baf02700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b40b4b20 con 0x7fa1b40b3df0 2023-06-22T16:23:33.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1baf02700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b40b4e00 con 0x7fa1b4158d60 2023-06-22T16:23:33.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b949f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa1b40b3df0 0x7fa1b40b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b949f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa1b40b3df0 0x7fa1b40b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33522/0 (socket says 172.21.15.149:33522) 2023-06-22T16:23:33.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b949f700 1 -- 172.21.15.149:0/1603055779 learned_addr learned my addr 172.21.15.149:0/1603055779 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:33.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b8c9e700 1 --2- 172.21.15.149:0/1603055779 >> v2:172.21.15.196:3300/0 conn(0x7fa1b4158d60 0x7fa1b4159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b8c9e700 1 -- 172.21.15.149:0/1603055779 >> v2:172.21.15.149:3300/0 conn(0x7fa1b40b3df0 msgr2=0x7fa1b40b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:33.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b8c9e700 1 --2- 172.21.15.149:0/1603055779 >> v2:172.21.15.149:3300/0 conn(0x7fa1b40b3df0 0x7fa1b40b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b8c9e700 1 -- 172.21.15.149:0/1603055779 >> v1:172.21.15.196:6789/0 conn(0x7fa1b40b1d10 legacy=0x7fa1b40b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b8c9e700 1 -- 172.21.15.149:0/1603055779 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b40b50e0 con 0x7fa1b4158d60 2023-06-22T16:23:33.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b949f700 1 --2- 172.21.15.149:0/1603055779 >> v2:172.21.15.149:3300/0 conn(0x7fa1b40b3df0 0x7fa1b40b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T16:23:33.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b37fe700 1 -- 172.21.15.149:0/1603055779 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570545047 0 0) 0x7fa1b40cabb0 con 0x7fa1b40b1d10 2023-06-22T16:23:33.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b8c9e700 1 --2- 172.21.15.149:0/1603055779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b4158d60 0x7fa1b4159130 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40ca730 tx=0x7fa1a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a3a31c1dc4b11d2 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:33.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b37fe700 1 -- 172.21.15.149:0/1603055779 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8011630 con 0x7fa1b4158d60 2023-06-22T16:23:33.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b37fe700 1 -- 172.21.15.149:0/1603055779 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a8011790 con 0x7fa1b4158d60 2023-06-22T16:23:33.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1b37fe700 1 -- 172.21.15.149:0/1603055779 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8011b30 con 0x7fa1b4158d60 2023-06-22T16:23:33.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1baf02700 1 -- 172.21.15.149:0/1603055779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b4158d60 msgr2=0x7fa1b4159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1baf02700 1 --2- 172.21.15.149:0/1603055779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b4158d60 0x7fa1b4159130 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40ca730 tx=0x7fa1a80091a0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1baf02700 1 -- 172.21.15.149:0/1603055779 shutdown_connections 2023-06-22T16:23:33.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1baf02700 1 --2- 172.21.15.149:0/1603055779 >> v2:172.21.15.149:3300/0 conn(0x7fa1b40b3df0 0x7fa1b40b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1baf02700 1 --2- 172.21.15.149:0/1603055779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b4158d60 0x7fa1b4159130 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1baf02700 1 -- 172.21.15.149:0/1603055779 >> 172.21.15.149:0/1603055779 conn(0x7fa1b4062990 msgr2=0x7fa1b4062d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:33.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1baf02700 1 -- 172.21.15.149:0/1603055779 shutdown_connections 2023-06-22T16:23:33.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.789+0000 7fa1baf02700 1 -- 172.21.15.149:0/1603055779 wait complete. 2023-06-22T16:23:33.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1baf02700 1 Processor -- start 2023-06-22T16:23:33.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1baf02700 1 -- start start 2023-06-22T16:23:33.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1baf02700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b40b1d10 0x7fa1b416d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1baf02700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b40b3df0 0x7fa1b40c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1baf02700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1b4158d60 0x7fa1b40ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:33.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1baf02700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b4153c40 con 0x7fa1b4158d60 2023-06-22T16:23:33.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1baf02700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40c4ec0 con 0x7fa1b40b3df0 2023-06-22T16:23:33.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1baf02700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40c51a0 con 0x7fa1b40b1d10 2023-06-22T16:23:33.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b949f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1b4158d60 0x7fa1b40ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b8c9e700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b40b1d10 0x7fa1b416d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b3fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b40b3df0 0x7fa1b40c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:33.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b8c9e700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b40b1d10 0x7fa1b416d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.149:60280/0 (socket says 172.21.15.149:60280) 2023-06-22T16:23:33.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b949f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1b4158d60 0x7fa1b40ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33530/0 (socket says 172.21.15.149:33530) 2023-06-22T16:23:33.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b8c9e700 1 -- 172.21.15.149:0/1738238707 learned_addr learned my addr 172.21.15.149:0/1738238707 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:33.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b8c9e700 1 -- 172.21.15.149:0/1738238707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b40b1d10 msgr2=0x7fa1b416d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-06-22T16:23:33.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b8c9e700 1 -- 172.21.15.149:0/1738238707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b40b1d10 msgr2=0x7fa1b416d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-06-22T16:23:33.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b8c9e700 1 --2- 172.21.15.149:0/1738238707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b40b1d10 0x7fa1b416d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-22T16:23:33.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b8c9e700 1 --2- 172.21.15.149:0/1738238707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b40b1d10 0x7fa1b416d340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T16:23:33.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b3fff700 1 -- 172.21.15.149:0/1738238707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b40b1d10 msgr2=0x7fa1b416d340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-22T16:23:33.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b3fff700 1 --2- 172.21.15.149:0/1738238707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b40b1d10 0x7fa1b416d340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b3fff700 1 -- 172.21.15.149:0/1738238707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1b4158d60 msgr2=0x7fa1b40ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b3fff700 1 --2- 172.21.15.149:0/1738238707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1b4158d60 0x7fa1b40ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b3fff700 1 -- 172.21.15.149:0/1738238707 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac009ae0 con 0x7fa1b40b3df0 2023-06-22T16:23:33.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b3fff700 1 --2- 172.21.15.149:0/1738238707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b40b3df0 0x7fa1b40c2b90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000c5b0 tx=0x7fa1a0007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:33.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b0ff9700 1 -- 172.21.15.149:0/1738238707 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0011590 con 0x7fa1b40b3df0 2023-06-22T16:23:33.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b0ff9700 1 -- 172.21.15.149:0/1738238707 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0011710 con 0x7fa1b40b3df0 2023-06-22T16:23:33.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1baf02700 1 -- 172.21.15.149:0/1738238707 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a8009420 con 0x7fa1b40b3df0 2023-06-22T16:23:33.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b0ff9700 1 -- 172.21.15.149:0/1738238707 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0011ad0 con 0x7fa1b40b3df0 2023-06-22T16:23:33.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1baf02700 1 -- 172.21.15.149:0/1738238707 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b40c5760 con 0x7fa1b40b3df0 2023-06-22T16:23:33.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b0ff9700 1 -- 172.21.15.149:0/1738238707 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa1a001c6c0 con 0x7fa1b40b3df0 2023-06-22T16:23:33.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.793+0000 7fa1b0ff9700 1 -- 172.21.15.149:0/1738238707 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fa1a0012b00 con 0x7fa1b40b3df0 2023-06-22T16:23:33.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.797+0000 7fa1baf02700 1 -- 172.21.15.149:0/1738238707 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b404bc30 con 0x7fa1b40b3df0 2023-06-22T16:23:33.806 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.797+0000 7fa1b0ff9700 1 -- 172.21.15.149:0/1738238707 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fa1a0021060 con 0x7fa1b40b3df0 2023-06-22T16:23:33.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.861+0000 7fa1baf02700 1 -- 172.21.15.149:0/1738238707 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1b40b53c0 con 0x7fa1b40b3df0 2023-06-22T16:23:33.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.865+0000 7fa1b0ff9700 1 -- 172.21.15.149:0/1738238707 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fa1a0017070 con 0x7fa1b40b3df0 2023-06-22T16:23:33.871 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:23:33.871 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":10,"fsid":"0dba7f42-2446-45e3-aae5-b3ca874cf325","created":"2023-06-22T16:23:31.621362+0000","modified":"2023-06-22T16:23:33.638142+0000","last_up_change":"0.000000","last_in_change":"2023-06-22T16:23:33.638142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"56ddaf00-fc77-44cf-b823-5bd377b92576","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"532f10bd-8b84-4a0b-9aed-28e7afb4a863","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bc3c458c-c810-4c5a-b258-2de1cb3ca1f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"04bf7f65-1946-499c-aea9-c4caa92e8488","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e49f385d-76d9-4304-8486-3e1f3cb8fd23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"671a4069-7c86-4a14-825c-1179a74928c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7114b0c3-27fe-4816-8cc8-fb3679b8e707","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f9e6e633-0952-40bf-97e6-7c8b0bc804bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T16:23:33.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.865+0000 7fa1baf02700 1 -- 172.21.15.149:0/1738238707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b40b3df0 msgr2=0x7fa1b40c2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:33.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.865+0000 7fa1baf02700 1 --2- 172.21.15.149:0/1738238707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b40b3df0 0x7fa1b40c2b90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000c5b0 tx=0x7fa1a0007d30 comp rx=0 tx=0).stop 2023-06-22T16:23:33.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.865+0000 7fa1baf02700 1 -- 172.21.15.149:0/1738238707 shutdown_connections 2023-06-22T16:23:33.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.865+0000 7fa1baf02700 1 --2- 172.21.15.149:0/1738238707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1b4158d60 0x7fa1b40ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.865+0000 7fa1baf02700 1 --2- 172.21.15.149:0/1738238707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b40b3df0 0x7fa1b40c2b90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.865+0000 7fa1baf02700 1 --2- 172.21.15.149:0/1738238707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b40b1d10 0x7fa1b416d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:33.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.865+0000 7fa1baf02700 1 -- 172.21.15.149:0/1738238707 >> 172.21.15.149:0/1738238707 conn(0x7fa1b4062990 msgr2=0x7fa1b40cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:33.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.865+0000 7fa1baf02700 1 -- 172.21.15.149:0/1738238707 shutdown_connections 2023-06-22T16:23:33.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:33.865+0000 7fa1baf02700 1 -- 172.21.15.149:0/1738238707 wait complete. 2023-06-22T16:23:33.883 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-22T16:23:33.884 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-22T16:23:34.028 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-22T16:23:34.021+0000 7fc52872d3c0 -1 Falling back to public interface 2023-06-22T16:23:34.043 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-22T16:23:34.037+0000 7fdfeb9083c0 -1 Falling back to public interface 2023-06-22T16:23:34.044 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-22T16:23:34.037+0000 7f003ab693c0 -1 Falling back to public interface 2023-06-22T16:23:34.046 INFO:tasks.ceph.osd.6.smithi196.stderr:2023-06-22T16:23:34.038+0000 7f18fb93e3c0 -1 Falling back to public interface 2023-06-22T16:23:34.062 INFO:tasks.ceph.osd.4.smithi196.stderr:2023-06-22T16:23:34.054+0000 7fbd62f1e3c0 -1 Falling back to public interface 2023-06-22T16:23:34.063 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-22T16:23:34.057+0000 7f4f8ebe13c0 -1 Falling back to public interface 2023-06-22T16:23:34.065 INFO:tasks.ceph.osd.7.smithi196.stderr:2023-06-22T16:23:34.058+0000 7f637f9a13c0 -1 Falling back to public interface 2023-06-22T16:23:34.086 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:34.078+0000 7fb1dc005000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-22T16:23:34.095 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:34.089+0000 7f3581224000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-22T16:23:34.256 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:34.246+0000 7fb1dc005000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-22T16:23:34.257 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:34.249+0000 7f3581224000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-22T16:23:34.306 INFO:tasks.ceph.osd.5.smithi196.stderr:2023-06-22T16:23:34.298+0000 7fe5f34a73c0 -1 Falling back to public interface 2023-06-22T16:23:34.321 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:34.314+0000 7fb1dc005000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-22T16:23:34.322 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:34.313+0000 7f3581224000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-22T16:23:34.373 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:34.365+0000 7f3581224000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-22T16:23:34.373 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:34.366+0000 7fb1dc005000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-22T16:23:34.430 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:34.422+0000 7fb1dc005000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-22T16:23:34.431 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:34.425+0000 7f3581224000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-22T16:23:34.688 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-22T16:23:34.724 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:34.717+0000 7f3581224000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-22T16:23:34.725 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:34.718+0000 7fb1dc005000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-22T16:23:34.781 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.773+0000 7f3c0544f700 1 Processor -- start 2023-06-22T16:23:34.782 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.773+0000 7f3c0544f700 1 -- start start 2023-06-22T16:23:34.782 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:34.773+0000 7f3581224000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-22T16:23:34.783 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.773+0000 7f3c0544f700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3c00150080 0x7f3c00067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:34.784 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.773+0000 7f3c0544f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3c00150450 0x7f3c000b0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:34.784 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.773+0000 7f3c0544f700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c00156ab0 con 0x7f3c00156f40 2023-06-22T16:23:34.784 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.773+0000 7f3c0544f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c00156250 con 0x7f3c00150450 2023-06-22T16:23:34.784 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.773+0000 7f3c0544f700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c000b0750 con 0x7f3c00150080 2023-06-22T16:23:34.784 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bff7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3c00150450 0x7f3c000b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:34.784 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bff7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3c00150450 0x7f3c000b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33540/0 (socket says 172.21.15.149:33540) 2023-06-22T16:23:34.785 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bff7fe700 1 -- 172.21.15.149:0/2464190752 learned_addr learned my addr 172.21.15.149:0/2464190752 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:34.785 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bfeffd700 1 --2- 172.21.15.149:0/2464190752 >> v2:172.21.15.196:3300/0 conn(0x7f3c00150080 0x7f3c00067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:34.785 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bff7fe700 1 -- 172.21.15.149:0/2464190752 >> v2:172.21.15.196:3300/0 conn(0x7f3c00150080 msgr2=0x7f3c00067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:34.785 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bff7fe700 1 --2- 172.21.15.149:0/2464190752 >> v2:172.21.15.196:3300/0 conn(0x7f3c00150080 0x7f3c00067560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:34.785 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bff7fe700 1 -- 172.21.15.149:0/2464190752 >> v1:172.21.15.196:6789/0 conn(0x7f3c00156f40 legacy=0x7f3c000afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:34.785 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bff7fe700 1 -- 172.21.15.149:0/2464190752 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c00156460 con 0x7f3c00150450 2023-06-22T16:23:34.785 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bff7fe700 1 --2- 172.21.15.149:0/2464190752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c00150450 0x7f3c000b0130 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c000642e0 tx=0x7f3bf8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c8fb8058cdec4b server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:34.785 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bfe7fc700 1 -- 172.21.15.149:0/2464190752 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf800e070 con 0x7f3c00150450 2023-06-22T16:23:34.786 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bfe7fc700 1 -- 172.21.15.149:0/2464190752 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf800ba50 con 0x7f3c00150450 2023-06-22T16:23:34.786 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bfe7fc700 1 -- 172.21.15.149:0/2464190752 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80092e0 con 0x7f3c00150450 2023-06-22T16:23:34.786 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 -- 172.21.15.149:0/2464190752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c00150450 msgr2=0x7f3c000b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:34.786 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 --2- 172.21.15.149:0/2464190752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c00150450 0x7f3c000b0130 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c000642e0 tx=0x7f3bf8009840 comp rx=0 tx=0).stop 2023-06-22T16:23:34.786 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:34.774+0000 7fb1dc005000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-22T16:23:34.788 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 -- 172.21.15.149:0/2464190752 shutdown_connections 2023-06-22T16:23:34.789 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 --2- 172.21.15.149:0/2464190752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c00150450 0x7f3c000b0130 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:34.789 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 --2- 172.21.15.149:0/2464190752 >> v2:172.21.15.196:3300/0 conn(0x7f3c00150080 0x7f3c00067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:34.789 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 -- 172.21.15.149:0/2464190752 >> 172.21.15.149:0/2464190752 conn(0x7f3c000ccc60 msgr2=0x7f3c000cd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:34.789 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 -- 172.21.15.149:0/2464190752 shutdown_connections 2023-06-22T16:23:34.789 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 -- 172.21.15.149:0/2464190752 wait complete. 2023-06-22T16:23:34.789 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 Processor -- start 2023-06-22T16:23:34.789 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 -- start start 2023-06-22T16:23:34.790 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c00150080 0x7f3c0014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:34.790 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c00150450 0x7f3c000ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:34.790 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c00156f40 0x7f3c0014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:34.790 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0006d2b0 con 0x7f3c00150450 2023-06-22T16:23:34.790 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0006ce20 con 0x7f3c00156f40 2023-06-22T16:23:34.790 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3c0544f700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000af300 con 0x7f3c00150080 2023-06-22T16:23:34.790 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bf67fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c00150450 0x7f3c000ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:34.790 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bf67fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c00150450 0x7f3c000ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33546/0 (socket says 172.21.15.149:33546) 2023-06-22T16:23:34.791 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bf67fc700 1 -- 172.21.15.149:0/1725122318 learned_addr learned my addr 172.21.15.149:0/1725122318 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:34.791 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bfeffd700 1 --2- 172.21.15.149:0/1725122318 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c00150080 0x7f3c0014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:34.791 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.777+0000 7f3bff7fe700 1 --2- 172.21.15.149:0/1725122318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c00156f40 0x7f3c0014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:34.791 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3bf67fc700 1 -- 172.21.15.149:0/1725122318 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c00150080 msgr2=0x7f3c0014c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:34.791 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3bf67fc700 1 --2- 172.21.15.149:0/1725122318 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c00150080 0x7f3c0014c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:34.792 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3bf67fc700 1 -- 172.21.15.149:0/1725122318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c00156f40 msgr2=0x7f3c0014f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:34.792 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3bf67fc700 1 --2- 172.21.15.149:0/1725122318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c00156f40 0x7f3c0014f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:34.792 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3bf67fc700 1 -- 172.21.15.149:0/1725122318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf8009ae0 con 0x7f3c00150450 2023-06-22T16:23:34.792 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3bff7fe700 1 --2- 172.21.15.149:0/1725122318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c00156f40 0x7f3c0014f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T16:23:34.792 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3bf67fc700 1 --2- 172.21.15.149:0/1725122318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c00150450 0x7f3c000ae880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3be800c590 tx=0x7f3be800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:34.792 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3bf77fe700 1 -- 172.21.15.149:0/1725122318 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8011590 con 0x7f3c00150450 2023-06-22T16:23:34.792 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3bf77fe700 1 -- 172.21.15.149:0/1725122318 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be80116f0 con 0x7f3c00150450 2023-06-22T16:23:34.792 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3c0544f700 1 -- 172.21.15.149:0/1725122318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0006c4f0 con 0x7f3c00150450 2023-06-22T16:23:34.793 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3bf77fe700 1 -- 172.21.15.149:0/1725122318 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8011ab0 con 0x7f3c00150450 2023-06-22T16:23:34.793 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3c0544f700 1 -- 172.21.15.149:0/1725122318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0006cab0 con 0x7f3c00150450 2023-06-22T16:23:34.793 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3bf77fe700 1 -- 172.21.15.149:0/1725122318 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3be801c6c0 con 0x7f3c00150450 2023-06-22T16:23:34.793 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3bf77fe700 1 -- 172.21.15.149:0/1725122318 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f3be8011e20 con 0x7f3c00150450 2023-06-22T16:23:34.793 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.781+0000 7f3c0544f700 1 -- 172.21.15.149:0/1725122318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c00071090 con 0x7f3c00150450 2023-06-22T16:23:34.793 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.785+0000 7f3bf77fe700 1 -- 172.21.15.149:0/1725122318 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f3be8017070 con 0x7f3c00150450 2023-06-22T16:23:34.847 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:34.838+0000 7fb1dc005000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-22T16:23:34.848 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:34.841+0000 7f3581224000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-22T16:23:34.855 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.849+0000 7f3c0544f700 1 -- 172.21.15.149:0/1725122318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c00156740 con 0x7f3c00150450 2023-06-22T16:23:34.856 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.849+0000 7f3bf77fe700 1 -- 172.21.15.149:0/1725122318 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f3be801cd10 con 0x7f3c00150450 2023-06-22T16:23:34.857 INFO:teuthology.misc.health.smithi149.stdout: 2023-06-22T16:23:34.857 INFO:teuthology.misc.health.smithi149.stdout:{"epoch":10,"fsid":"0dba7f42-2446-45e3-aae5-b3ca874cf325","created":"2023-06-22T16:23:31.621362+0000","modified":"2023-06-22T16:23:33.638142+0000","last_up_change":"0.000000","last_in_change":"2023-06-22T16:23:33.638142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"56ddaf00-fc77-44cf-b823-5bd377b92576","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"532f10bd-8b84-4a0b-9aed-28e7afb4a863","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bc3c458c-c810-4c5a-b258-2de1cb3ca1f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"04bf7f65-1946-499c-aea9-c4caa92e8488","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e49f385d-76d9-4304-8486-3e1f3cb8fd23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"671a4069-7c86-4a14-825c-1179a74928c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7114b0c3-27fe-4816-8cc8-fb3679b8e707","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f9e6e633-0952-40bf-97e6-7c8b0bc804bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T16:23:34.858 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.849+0000 7f3c0544f700 1 -- 172.21.15.149:0/1725122318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c00150450 msgr2=0x7f3c000ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:34.858 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.849+0000 7f3c0544f700 1 --2- 172.21.15.149:0/1725122318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c00150450 0x7f3c000ae880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3be800c590 tx=0x7f3be800c950 comp rx=0 tx=0).stop 2023-06-22T16:23:34.858 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.849+0000 7f3c0544f700 1 -- 172.21.15.149:0/1725122318 shutdown_connections 2023-06-22T16:23:34.858 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.849+0000 7f3c0544f700 1 --2- 172.21.15.149:0/1725122318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c00156f40 0x7f3c0014f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:34.859 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.849+0000 7f3c0544f700 1 --2- 172.21.15.149:0/1725122318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c00150450 0x7f3c000ae880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:34.859 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.849+0000 7f3c0544f700 1 --2- 172.21.15.149:0/1725122318 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c00150080 0x7f3c0014c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:34.859 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.849+0000 7f3c0544f700 1 -- 172.21.15.149:0/1725122318 >> 172.21.15.149:0/1725122318 conn(0x7f3c000ccc60 msgr2=0x7f3c0006d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:34.859 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.849+0000 7f3c0544f700 1 -- 172.21.15.149:0/1725122318 shutdown_connections 2023-06-22T16:23:34.859 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:34.849+0000 7f3c0544f700 1 -- 172.21.15.149:0/1725122318 wait complete. 2023-06-22T16:23:34.867 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-22T16:23:35.003 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:34.997+0000 7f3581224000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-22T16:23:35.007 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:34.998+0000 7fb1dc005000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-22T16:23:35.069 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:35.062+0000 7fb1dc005000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-22T16:23:35.070 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:35.061+0000 7f3581224000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-22T16:23:35.767 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:35.758+0000 7fb1dc005000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-22T16:23:35.775 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-22T16:23:35.769+0000 7f3581224000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-22T16:23:36.817 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:36.810+0000 7fb1c50fc700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-22T16:23:36.818 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-06-22T16:23:36.810+0000 7fb1c50fc700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-22T16:23:37.671 INFO:tasks.ceph.osd.4.smithi196.stderr:2023-06-22T16:23:37.662+0000 7fbd62f1e3c0 -1 osd.4 0 log_to_monitors true 2023-06-22T16:23:37.821 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-22T16:23:37.813+0000 7fdfeb9083c0 -1 osd.0 0 log_to_monitors true 2023-06-22T16:23:37.836 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-22T16:23:37.829+0000 7f003ab693c0 -1 osd.1 0 log_to_monitors true 2023-06-22T16:23:37.844 INFO:tasks.ceph.osd.6.smithi196.stderr:2023-06-22T16:23:37.834+0000 7f18fb93e3c0 -1 osd.6 0 log_to_monitors true 2023-06-22T16:23:37.862 INFO:tasks.ceph.osd.7.smithi196.stderr:2023-06-22T16:23:37.854+0000 7f637f9a13c0 -1 osd.7 0 log_to_monitors true 2023-06-22T16:23:37.871 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-22T16:23:37.865+0000 7fc52872d3c0 -1 osd.3 0 log_to_monitors true 2023-06-22T16:23:37.971 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-22T16:23:37.965+0000 7f4f8ebe13c0 -1 osd.2 0 log_to_monitors true 2023-06-22T16:23:38.119 INFO:tasks.ceph.osd.5.smithi196.stderr:2023-06-22T16:23:38.110+0000 7fe5f34a73c0 -1 osd.5 0 log_to_monitors true 2023-06-22T16:23:40.548 INFO:tasks.ceph.osd.4.smithi196.stderr:2023-06-22T16:23:40.538+0000 7fbd5e6be700 -1 osd.4 0 waiting for initial osdmap 2023-06-22T16:23:40.584 INFO:tasks.ceph.osd.4.smithi196.stderr:2023-06-22T16:23:40.578+0000 7fbd57462700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T16:23:41.673 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-22T16:23:41.717 INFO:tasks.ceph.osd.6.smithi196.stderr:2023-06-22T16:23:41.710+0000 7f18f8903700 -1 osd.6 0 waiting for initial osdmap 2023-06-22T16:23:41.726 INFO:tasks.ceph.osd.6.smithi196.stderr:2023-06-22T16:23:41.718+0000 7f18efe82700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T16:23:41.739 INFO:tasks.ceph.osd.5.smithi196.stderr:2023-06-22T16:23:41.730+0000 7fe5f046c700 -1 osd.5 0 waiting for initial osdmap 2023-06-22T16:23:41.747 INFO:tasks.ceph.osd.5.smithi196.stderr:2023-06-22T16:23:41.738+0000 7fe5e79eb700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T16:23:41.760 INFO:tasks.ceph.osd.7.smithi196.stderr:2023-06-22T16:23:41.754+0000 7f637c966700 -1 osd.7 0 waiting for initial osdmap 2023-06-22T16:23:41.766 INFO:tasks.ceph.osd.7.smithi196.stderr:2023-06-22T16:23:41.758+0000 7f6373ee5700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T16:23:41.804 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.797+0000 7f7423e52700 1 Processor -- start 2023-06-22T16:23:41.804 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.797+0000 7f7423e52700 1 -- start start 2023-06-22T16:23:41.805 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.797+0000 7f7423e52700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f741c154da0 0x7f741c0c7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:41.805 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.797+0000 7f7423e52700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c06b0d0 con 0x7f741c0c76b0 2023-06-22T16:23:41.806 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.797+0000 7f7423e52700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c06a4c0 con 0x7f741c0c8a60 2023-06-22T16:23:41.806 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.797+0000 7f7423e52700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c06a7a0 con 0x7f741c154da0 2023-06-22T16:23:41.806 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.797+0000 7f74213ed700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f741c0c76b0 0x7f741c0c8350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38186/0 (socket says 172.21.15.149:38186) 2023-06-22T16:23:41.806 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.797+0000 7f74213ed700 1 -- 172.21.15.149:0/1902834599 learned_addr learned my addr 172.21.15.149:0/1902834599 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-22T16:23:41.806 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.797+0000 7f7421bee700 1 --2- 172.21.15.149:0/1902834599 >> v2:172.21.15.196:3300/0 conn(0x7f741c154da0 0x7f741c0c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:41.807 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.797+0000 7f7420bec700 1 -- 172.21.15.149:0/1902834599 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271984713 0 0) 0x7f741c06b0d0 con 0x7f741c0c76b0 2023-06-22T16:23:41.807 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.797+0000 7f7420bec700 1 -- 172.21.15.149:0/1902834599 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7408003570 con 0x7f741c0c76b0 2023-06-22T16:23:41.807 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7421bee700 1 -- 172.21.15.149:0/1902834599 >> v1:172.21.15.196:6789/0 conn(0x7f741c0c8a60 legacy=0x7f741c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:41.807 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7421bee700 1 -- 172.21.15.149:0/1902834599 >> v1:172.21.15.149:6789/0 conn(0x7f741c0c76b0 legacy=0x7f741c0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:41.807 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7421bee700 1 -- 172.21.15.149:0/1902834599 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c06aa80 con 0x7f741c154da0 2023-06-22T16:23:41.808 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7421bee700 1 --2- 172.21.15.149:0/1902834599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f741c154da0 0x7f741c0c7170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f741800aa90 tx=0x7f741800a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f21359d0e091b3dc server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:41.808 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7420bec700 1 -- 172.21.15.149:0/1902834599 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741800c930 con 0x7f741c154da0 2023-06-22T16:23:41.808 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7420bec700 1 -- 172.21.15.149:0/1902834599 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741800ca90 con 0x7f741c154da0 2023-06-22T16:23:41.808 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7420bec700 1 -- 172.21.15.149:0/1902834599 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741800ce50 con 0x7f741c154da0 2023-06-22T16:23:41.809 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7423e52700 1 -- 172.21.15.149:0/1902834599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f741c154da0 msgr2=0x7f741c0c7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:41.809 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7423e52700 1 --2- 172.21.15.149:0/1902834599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f741c154da0 0x7f741c0c7170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f741800aa90 tx=0x7f741800a330 comp rx=0 tx=0).stop 2023-06-22T16:23:41.810 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7423e52700 1 -- 172.21.15.149:0/1902834599 shutdown_connections 2023-06-22T16:23:41.810 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7423e52700 1 --2- 172.21.15.149:0/1902834599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f741c154da0 0x7f741c0c7170 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:41.810 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7423e52700 1 -- 172.21.15.149:0/1902834599 >> 172.21.15.149:0/1902834599 conn(0x7f741c068310 msgr2=0x7f741c068710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:41.810 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7423e52700 1 -- 172.21.15.149:0/1902834599 shutdown_connections 2023-06-22T16:23:41.811 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.801+0000 7f7423e52700 1 -- 172.21.15.149:0/1902834599 wait complete. 2023-06-22T16:23:41.811 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7423e52700 1 Processor -- start 2023-06-22T16:23:41.813 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7423e52700 1 -- start start 2023-06-22T16:23:41.814 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7423e52700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f741c0c76b0 0x7f741c1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:41.814 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7423e52700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f741c0c8a60 0x7f741c0ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:41.814 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7423e52700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f741c154da0 0x7f741c0cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:41.814 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7423e52700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0cbf00 con 0x7f741c0c76b0 2023-06-22T16:23:41.815 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7423e52700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c1515f0 con 0x7f741c154da0 2023-06-22T16:23:41.815 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7423e52700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0cb280 con 0x7f741c0c8a60 2023-06-22T16:23:41.815 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7421bee700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f741c0c76b0 0x7f741c1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:41.815 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7421bee700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f741c0c76b0 0x7f741c1510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:60824/0 (socket says 172.21.15.149:60824) 2023-06-22T16:23:41.815 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7421bee700 1 -- 172.21.15.149:0/2087385455 learned_addr learned my addr 172.21.15.149:0/2087385455 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:41.815 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f74213ed700 1 --2- 172.21.15.149:0/2087385455 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f741c0c8a60 0x7f741c0ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:41.815 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7421bee700 1 -- 172.21.15.149:0/2087385455 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f741c0c8a60 msgr2=0x7f741c0ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:41.816 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7421bee700 1 --2- 172.21.15.149:0/2087385455 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f741c0c8a60 0x7f741c0ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:41.816 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7421bee700 1 -- 172.21.15.149:0/2087385455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f741c154da0 msgr2=0x7f741c0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:41.816 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7421bee700 1 --2- 172.21.15.149:0/2087385455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f741c154da0 0x7f741c0cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:41.816 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7421bee700 1 -- 172.21.15.149:0/2087385455 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741800a5d0 con 0x7f741c0c76b0 2023-06-22T16:23:41.816 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.805+0000 7f7421bee700 1 --2- 172.21.15.149:0/2087385455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f741c0c76b0 0x7f741c1510b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7418002000 tx=0x7f7418019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:41.816 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.809+0000 7f7411ffb700 1 -- 172.21.15.149:0/2087385455 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418006a90 con 0x7f741c0c76b0 2023-06-22T16:23:41.817 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.809+0000 7f7411ffb700 1 -- 172.21.15.149:0/2087385455 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7418021450 con 0x7f741c0c76b0 2023-06-22T16:23:41.817 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.809+0000 7f7411ffb700 1 -- 172.21.15.149:0/2087385455 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418021810 con 0x7f741c0c76b0 2023-06-22T16:23:41.817 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.809+0000 7f7423e52700 1 -- 172.21.15.149:0/2087385455 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c0cb560 con 0x7f741c0c76b0 2023-06-22T16:23:41.817 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.809+0000 7f7423e52700 1 -- 172.21.15.149:0/2087385455 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c0cbb20 con 0x7f741c0c76b0 2023-06-22T16:23:41.818 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.809+0000 7f7423e52700 1 -- 172.21.15.149:0/2087385455 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c0c8f90 con 0x7f741c0c76b0 2023-06-22T16:23:41.818 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.809+0000 7f7411ffb700 1 -- 172.21.15.149:0/2087385455 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 79811+0+0 (secure 0 0 0) 0x7f7418021c40 con 0x7f741c0c76b0 2023-06-22T16:23:41.819 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.809+0000 7f7411ffb700 1 --2- 172.21.15.149:0/2087385455 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f7400060420 0x7f74000628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:41.819 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.809+0000 7f7411ffb700 1 -- 172.21.15.149:0/2087385455 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2507+0+0 (secure 0 0 0) 0x7f741807d1a0 con 0x7f741c0c76b0 2023-06-22T16:23:41.822 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.817+0000 7f74213ed700 1 --2- 172.21.15.149:0/2087385455 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f7400060420 0x7f74000628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:41.823 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.817+0000 7f74213ed700 1 --2- 172.21.15.149:0/2087385455 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f7400060420 0x7f74000628d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f741c158e00 tx=0x7f741400a040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:41.825 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:41.817+0000 7f7411ffb700 1 -- 172.21.15.149:0/2087385455 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f741804e6a0 con 0x7f741c0c76b0 2023-06-22T16:23:42.124 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.117+0000 7f7423e52700 1 -- 172.21.15.149:0/2087385455 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f741c0c8f90 con 0x7f741c0c76b0 2023-06-22T16:23:42.125 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.117+0000 7f7411ffb700 1 -- 172.21.15.149:0/2087385455 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7462 (secure 0 0 0) 0x7f741c0c8f90 con 0x7f741c0c76b0 2023-06-22T16:23:42.125 INFO:teuthology.misc.health.smithi149.stdout: 2023-06-22T16:23:42.125 INFO:teuthology.misc.health.smithi149.stdout:{"epoch":14,"fsid":"0dba7f42-2446-45e3-aae5-b3ca874cf325","created":"2023-06-22T16:23:31.621362+0000","modified":"2023-06-22T16:23:41.611636+0000","last_up_change":"2023-06-22T16:23:41.611636+0000","last_in_change":"2023-06-22T16:23:33.638142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"56ddaf00-fc77-44cf-b823-5bd377b92576","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"532f10bd-8b84-4a0b-9aed-28e7afb4a863","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bc3c458c-c810-4c5a-b258-2de1cb3ca1f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"04bf7f65-1946-499c-aea9-c4caa92e8488","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e49f385d-76d9-4304-8486-3e1f3cb8fd23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":33055},{"type":"v1","addr":"172.21.15.196:6809","nonce":33055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":33055},{"type":"v1","addr":"172.21.15.196:6811","nonce":33055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":33055},{"type":"v1","addr":"172.21.15.196:6815","nonce":33055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":33055},{"type":"v1","addr":"172.21.15.196:6813","nonce":33055}]},"public_addr":"172.21.15.196:6809/33055","cluster_addr":"172.21.15.196:6811/33055","heartbeat_back_addr":"172.21.15.196:6815/33055","heartbeat_front_addr":"172.21.15.196:6813/33055","state":["exists","up"]},{"osd":5,"uuid":"671a4069-7c86-4a14-825c-1179a74928c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7114b0c3-27fe-4816-8cc8-fb3679b8e707","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f9e6e633-0952-40bf-97e6-7c8b0bc804bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T16:23:42.128 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.121+0000 7f7423e52700 1 -- 172.21.15.149:0/2087385455 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f7400060420 msgr2=0x7f74000628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:42.128 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.121+0000 7f7423e52700 1 --2- 172.21.15.149:0/2087385455 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f7400060420 0x7f74000628d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f741c158e00 tx=0x7f741400a040 comp rx=0 tx=0).stop 2023-06-22T16:23:42.128 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.121+0000 7f7423e52700 1 -- 172.21.15.149:0/2087385455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f741c0c76b0 msgr2=0x7f741c1510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:42.128 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.121+0000 7f7423e52700 1 --2- 172.21.15.149:0/2087385455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f741c0c76b0 0x7f741c1510b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7418002000 tx=0x7f7418019000 comp rx=0 tx=0).stop 2023-06-22T16:23:42.128 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.121+0000 7f7423e52700 1 -- 172.21.15.149:0/2087385455 shutdown_connections 2023-06-22T16:23:42.128 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.121+0000 7f7423e52700 1 --2- 172.21.15.149:0/2087385455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f741c154da0 0x7f741c0cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:42.129 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.121+0000 7f7423e52700 1 --2- 172.21.15.149:0/2087385455 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f7400060420 0x7f74000628d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:42.129 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.121+0000 7f7423e52700 1 --2- 172.21.15.149:0/2087385455 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f741c0c8a60 0x7f741c0ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:42.129 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.121+0000 7f7423e52700 1 --2- 172.21.15.149:0/2087385455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f741c0c76b0 0x7f741c1510b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:42.129 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.121+0000 7f7423e52700 1 -- 172.21.15.149:0/2087385455 >> 172.21.15.149:0/2087385455 conn(0x7f741c068310 msgr2=0x7f741c0c60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:42.129 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.121+0000 7f7423e52700 1 -- 172.21.15.149:0/2087385455 shutdown_connections 2023-06-22T16:23:42.129 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:42.121+0000 7f7423e52700 1 -- 172.21.15.149:0/2087385455 wait complete. 2023-06-22T16:23:42.140 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-06-22T16:23:42.143 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-22T16:23:42.137+0000 7f0036309700 -1 osd.1 0 waiting for initial osdmap 2023-06-22T16:23:42.150 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-22T16:23:42.145+0000 7f002f0ad700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T16:23:42.211 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-22T16:23:42.205+0000 7fdfe88cd700 -1 osd.0 0 waiting for initial osdmap 2023-06-22T16:23:42.216 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-22T16:23:42.209+0000 7fdfdfe4c700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T16:23:42.223 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-22T16:23:42.217+0000 7f4f8a381700 -1 osd.2 0 waiting for initial osdmap 2023-06-22T16:23:42.230 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-22T16:23:42.221+0000 7f4f83125700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T16:23:42.262 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-22T16:23:42.253+0000 7fc523ecd700 -1 osd.3 0 waiting for initial osdmap 2023-06-22T16:23:42.268 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-22T16:23:42.261+0000 7fc51cc71700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T16:23:48.945 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-22T16:23:49.050 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.041+0000 7effa5600700 1 Processor -- start 2023-06-22T16:23:49.050 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.041+0000 7effa5600700 1 -- start start 2023-06-22T16:23:49.052 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa5600700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7effa00c6440 0x7effa00cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.052 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa5600700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7effa015d1f0 0x7effa00ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.052 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa5600700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa015cd60 con 0x7effa00cba40 2023-06-22T16:23:49.052 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa5600700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa015ca30 con 0x7effa015d1f0 2023-06-22T16:23:49.052 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa5600700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa00c6960 con 0x7effa00c6440 2023-06-22T16:23:49.053 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa4dff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7effa015d1f0 0x7effa00ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.053 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa4dff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7effa015d1f0 0x7effa00ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:60826/0 (socket says 172.21.15.149:60826) 2023-06-22T16:23:49.053 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa4dff700 1 -- 172.21.15.149:0/3346721738 learned_addr learned my addr 172.21.15.149:0/3346721738 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:49.053 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7eff9ffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7effa00cba40 0x7effa006ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38188/0 (socket says 172.21.15.149:38188) 2023-06-22T16:23:49.053 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7eff9f7fe700 1 --2- 172.21.15.149:0/3346721738 >> v2:172.21.15.196:3300/0 conn(0x7effa00c6440 0x7effa00cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.053 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa4dff700 1 -- 172.21.15.149:0/3346721738 >> v2:172.21.15.196:3300/0 conn(0x7effa00c6440 msgr2=0x7effa00cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:49.053 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa4dff700 1 --2- 172.21.15.149:0/3346721738 >> v2:172.21.15.196:3300/0 conn(0x7effa00c6440 0x7effa00cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.054 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa4dff700 1 -- 172.21.15.149:0/3346721738 >> v1:172.21.15.149:6789/0 conn(0x7effa00cba40 legacy=0x7effa006ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.054 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa4dff700 1 -- 172.21.15.149:0/3346721738 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa00c6c40 con 0x7effa015d1f0 2023-06-22T16:23:49.054 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7eff9f7fe700 1 --2- 172.21.15.149:0/3346721738 >> v2:172.21.15.196:3300/0 conn(0x7effa00c6440 0x7effa00cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T16:23:49.054 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa4dff700 1 --2- 172.21.15.149:0/3346721738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa015d1f0 0x7effa00ae6e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effa006ebc0 tx=0x7eff98009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed94532b93a9f3b server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:49.054 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7eff9effd700 1 -- 172.21.15.149:0/3346721738 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9800e070 con 0x7effa015d1f0 2023-06-22T16:23:49.054 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7eff9effd700 1 -- 172.21.15.149:0/3346721738 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9800ba50 con 0x7effa015d1f0 2023-06-22T16:23:49.054 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7eff9effd700 1 -- 172.21.15.149:0/3346721738 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff980092e0 con 0x7effa015d1f0 2023-06-22T16:23:49.056 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa5600700 1 -- 172.21.15.149:0/3346721738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa015d1f0 msgr2=0x7effa00ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.056 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa5600700 1 --2- 172.21.15.149:0/3346721738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa015d1f0 0x7effa00ae6e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effa006ebc0 tx=0x7eff98009840 comp rx=0 tx=0).stop 2023-06-22T16:23:49.056 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa5600700 1 -- 172.21.15.149:0/3346721738 shutdown_connections 2023-06-22T16:23:49.057 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa5600700 1 --2- 172.21.15.149:0/3346721738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa015d1f0 0x7effa00ae6e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.057 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa5600700 1 --2- 172.21.15.149:0/3346721738 >> v2:172.21.15.196:3300/0 conn(0x7effa00c6440 0x7effa00cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.057 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa5600700 1 -- 172.21.15.149:0/3346721738 >> 172.21.15.149:0/3346721738 conn(0x7effa006c450 msgr2=0x7effa006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:49.057 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa5600700 1 -- 172.21.15.149:0/3346721738 shutdown_connections 2023-06-22T16:23:49.057 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.045+0000 7effa5600700 1 -- 172.21.15.149:0/3346721738 wait complete. 2023-06-22T16:23:49.057 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa5600700 1 Processor -- start 2023-06-22T16:23:49.057 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa5600700 1 -- start start 2023-06-22T16:23:49.058 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa5600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7effa00c6440 0x7effa00b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.058 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa5600700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7effa00cba40 0x7effa014fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.058 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa5600700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa015d1f0 0x7effa00ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.058 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa5600700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa00afae0 con 0x7effa015d1f0 2023-06-22T16:23:49.058 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa5600700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0150380 con 0x7effa00c6440 2023-06-22T16:23:49.058 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa5600700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa00aec00 con 0x7effa00cba40 2023-06-22T16:23:49.058 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa4dff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa015d1f0 0x7effa00ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.058 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa4dff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa015d1f0 0x7effa00ae6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:60832/0 (socket says 172.21.15.149:60832) 2023-06-22T16:23:49.059 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa4dff700 1 -- 172.21.15.149:0/249516746 learned_addr learned my addr 172.21.15.149:0/249516746 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:49.059 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7eff9f7fe700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7effa00cba40 0x7effa014fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.059 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7eff9ffff700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7effa00c6440 0x7effa00b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.059 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa4dff700 1 -- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7effa00cba40 msgr2=0x7effa014fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.059 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa4dff700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7effa00cba40 0x7effa014fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.059 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa4dff700 1 -- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7effa00c6440 msgr2=0x7effa00b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.059 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa4dff700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7effa00c6440 0x7effa00b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.060 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa4dff700 1 -- 172.21.15.149:0/249516746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff98009ae0 con 0x7effa015d1f0 2023-06-22T16:23:49.060 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7eff9ffff700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7effa00c6440 0x7effa00b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T16:23:49.060 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7eff9f7fe700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7effa00cba40 0x7effa014fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T16:23:49.060 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa4dff700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa015d1f0 0x7effa00ae6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7effa0068600 tx=0x7eff98018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:49.061 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7eff87fff700 1 -- 172.21.15.149:0/249516746 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98008e40 con 0x7effa015d1f0 2023-06-22T16:23:49.061 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7eff87fff700 1 -- 172.21.15.149:0/249516746 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9800be60 con 0x7effa015d1f0 2023-06-22T16:23:49.061 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa5600700 1 -- 172.21.15.149:0/249516746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa00aeed0 con 0x7effa015d1f0 2023-06-22T16:23:49.061 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7eff87fff700 1 -- 172.21.15.149:0/249516746 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff980256b0 con 0x7effa015d1f0 2023-06-22T16:23:49.062 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.049+0000 7effa5600700 1 -- 172.21.15.149:0/249516746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa00af490 con 0x7effa015d1f0 2023-06-22T16:23:49.062 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.053+0000 7effa5600700 1 -- 172.21.15.149:0/249516746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa0071090 con 0x7effa015d1f0 2023-06-22T16:23:49.062 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.053+0000 7eff87fff700 1 -- 172.21.15.149:0/249516746 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7eff98003040 con 0x7effa015d1f0 2023-06-22T16:23:49.062 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.053+0000 7eff87fff700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7eff8c0604b0 0x7eff8c062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.062 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.053+0000 7eff87fff700 1 -- 172.21.15.149:0/249516746 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7eff9807e1a0 con 0x7effa015d1f0 2023-06-22T16:23:49.062 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.053+0000 7eff9ffff700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7eff8c0604b0 0x7eff8c062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.063 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.053+0000 7eff9ffff700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7eff8c0604b0 0x7eff8c062960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff94001820 tx=0x7eff94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:49.067 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.061+0000 7eff87fff700 1 -- 172.21.15.149:0/249516746 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7eff9804eb80 con 0x7effa015d1f0 2023-06-22T16:23:49.231 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.225+0000 7effa5600700 1 -- 172.21.15.149:0/249516746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effa00bedc0 con 0x7effa015d1f0 2023-06-22T16:23:49.231 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.225+0000 7eff87fff700 1 -- 172.21.15.149:0/249516746 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12175 (secure 0 0 0) 0x7eff980521a0 con 0x7effa015d1f0 2023-06-22T16:23:49.232 INFO:teuthology.misc.health.smithi149.stdout: 2023-06-22T16:23:49.232 INFO:teuthology.misc.health.smithi149.stdout:{"epoch":19,"fsid":"0dba7f42-2446-45e3-aae5-b3ca874cf325","created":"2023-06-22T16:23:31.621362+0000","modified":"2023-06-22T16:23:46.647148+0000","last_up_change":"2023-06-22T16:23:42.614261+0000","last_in_change":"2023-06-22T16:23:33.638142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T16:23:43.865433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"56ddaf00-fc77-44cf-b823-5bd377b92576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":32836},{"type":"v1","addr":"172.21.15.149:6809","nonce":32836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":32836},{"type":"v1","addr":"172.21.15.149:6811","nonce":32836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":32836},{"type":"v1","addr":"172.21.15.149:6816","nonce":32836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":32836},{"type":"v1","addr":"172.21.15.149:6813","nonce":32836}]},"public_addr":"172.21.15.149:6809/32836","cluster_addr":"172.21.15.149:6811/32836","heartbeat_back_addr":"172.21.15.149:6816/32836","heartbeat_front_addr":"172.21.15.149:6813/32836","state":["exists","up"]},{"osd":1,"uuid":"532f10bd-8b84-4a0b-9aed-28e7afb4a863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":32835},{"type":"v1","addr":"172.21.15.149:6817","nonce":32835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":32835},{"type":"v1","addr":"172.21.15.149:6819","nonce":32835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":32835},{"type":"v1","addr":"172.21.15.149:6823","nonce":32835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":32835},{"type":"v1","addr":"172.21.15.149:6821","nonce":32835}]},"public_addr":"172.21.15.149:6817/32835","cluster_addr":"172.21.15.149:6819/32835","heartbeat_back_addr":"172.21.15.149:6823/32835","heartbeat_front_addr":"172.21.15.149:6821/32835","state":["exists","up"]},{"osd":2,"uuid":"bc3c458c-c810-4c5a-b258-2de1cb3ca1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":32837},{"type":"v1","addr":"172.21.15.149:6825","nonce":32837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":32837},{"type":"v1","addr":"172.21.15.149:6827","nonce":32837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":32837},{"type":"v1","addr":"172.21.15.149:6831","nonce":32837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":32837},{"type":"v1","addr":"172.21.15.149:6829","nonce":32837}]},"public_addr":"172.21.15.149:6825/32837","cluster_addr":"172.21.15.149:6827/32837","heartbeat_back_addr":"172.21.15.149:6831/32837","heartbeat_front_addr":"172.21.15.149:6829/32837","state":["exists","up"]},{"osd":3,"uuid":"04bf7f65-1946-499c-aea9-c4caa92e8488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":32834},{"type":"v1","addr":"172.21.15.149:6801","nonce":32834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":32834},{"type":"v1","addr":"172.21.15.149:6803","nonce":32834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":32834},{"type":"v1","addr":"172.21.15.149:6807","nonce":32834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":32834},{"type":"v1","addr":"172.21.15.149:6805","nonce":32834}]},"public_addr":"172.21.15.149:6801/32834","cluster_addr":"172.21.15.149:6803/32834","heartbeat_back_addr":"172.21.15.149:6807/32834","heartbeat_front_addr":"172.21.15.149:6805/32834","state":["exists","up"]},{"osd":4,"uuid":"e49f385d-76d9-4304-8486-3e1f3cb8fd23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":33055},{"type":"v1","addr":"172.21.15.196:6809","nonce":33055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":33055},{"type":"v1","addr":"172.21.15.196:6811","nonce":33055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":33055},{"type":"v1","addr":"172.21.15.196:6815","nonce":33055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":33055},{"type":"v1","addr":"172.21.15.196:6813","nonce":33055}]},"public_addr":"172.21.15.196:6809/33055","cluster_addr":"172.21.15.196:6811/33055","heartbeat_back_addr":"172.21.15.196:6815/33055","heartbeat_front_addr":"172.21.15.196:6813/33055","state":["exists","up"]},{"osd":5,"uuid":"671a4069-7c86-4a14-825c-1179a74928c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":33057},{"type":"v1","addr":"172.21.15.196:6825","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":33057},{"type":"v1","addr":"172.21.15.196:6827","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":33057},{"type":"v1","addr":"172.21.15.196:6831","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":33057},{"type":"v1","addr":"172.21.15.196:6829","nonce":33057}]},"public_addr":"172.21.15.196:6825/33057","cluster_addr":"172.21.15.196:6827/33057","heartbeat_back_addr":"172.21.15.196:6831/33057","heartbeat_front_addr":"172.21.15.196:6829/33057","state":["exists","up"]},{"osd":6,"uuid":"7114b0c3-27fe-4816-8cc8-fb3679b8e707","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":33054},{"type":"v1","addr":"172.21.15.196:6801","nonce":33054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":33054},{"type":"v1","addr":"172.21.15.196:6803","nonce":33054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":33054},{"type":"v1","addr":"172.21.15.196:6807","nonce":33054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":33054},{"type":"v1","addr":"172.21.15.196:6805","nonce":33054}]},"public_addr":"172.21.15.196:6801/33054","cluster_addr":"172.21.15.196:6803/33054","heartbeat_back_addr":"172.21.15.196:6807/33054","heartbeat_front_addr":"172.21.15.196:6805/33054","state":["exists","up"]},{"osd":7,"uuid":"f9e6e633-0952-40bf-97e6-7c8b0bc804bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":33058},{"type":"v1","addr":"172.21.15.196:6817","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":33058},{"type":"v1","addr":"172.21.15.196:6819","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":33058},{"type":"v1","addr":"172.21.15.196:6823","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":33058},{"type":"v1","addr":"172.21.15.196:6821","nonce":33058}]},"public_addr":"172.21.15.196:6817/33058","cluster_addr":"172.21.15.196:6819/33058","heartbeat_back_addr":"172.21.15.196:6823/33058","heartbeat_front_addr":"172.21.15.196:6821/33058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.838753+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.877504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.932235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.898286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.697196+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:39.163122+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.820624+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.902436+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T16:23:49.234 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.229+0000 7effa5600700 1 -- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7eff8c0604b0 msgr2=0x7eff8c062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.234 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.229+0000 7effa5600700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7eff8c0604b0 0x7eff8c062960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff94001820 tx=0x7eff94009040 comp rx=0 tx=0).stop 2023-06-22T16:23:49.234 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.229+0000 7effa5600700 1 -- 172.21.15.149:0/249516746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa015d1f0 msgr2=0x7effa00ae6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.235 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.229+0000 7effa5600700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa015d1f0 0x7effa00ae6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7effa0068600 tx=0x7eff98018000 comp rx=0 tx=0).stop 2023-06-22T16:23:49.235 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.229+0000 7effa5600700 1 -- 172.21.15.149:0/249516746 shutdown_connections 2023-06-22T16:23:49.235 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.229+0000 7effa5600700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effa015d1f0 0x7effa00ae6c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.235 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.229+0000 7effa5600700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7eff8c0604b0 0x7eff8c062960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.235 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.229+0000 7effa5600700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7effa00cba40 0x7effa014fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.235 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.229+0000 7effa5600700 1 --2- 172.21.15.149:0/249516746 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7effa00c6440 0x7effa00b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.235 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.229+0000 7effa5600700 1 -- 172.21.15.149:0/249516746 >> 172.21.15.149:0/249516746 conn(0x7effa006c450 msgr2=0x7effa00c2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:49.236 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.229+0000 7effa5600700 1 -- 172.21.15.149:0/249516746 shutdown_connections 2023-06-22T16:23:49.236 INFO:teuthology.misc.health.smithi149.stderr:2023-06-22T16:23:49.229+0000 7effa5600700 1 -- 172.21.15.149:0/249516746 wait complete. 2023-06-22T16:23:49.245 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-22T16:23:49.245 INFO:tasks.ceph:Creating RBD pool 2023-06-22T16:23:49.246 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-22T16:23:49.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.341+0000 7fa33cdc4700 1 Processor -- start 2023-06-22T16:23:49.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.341+0000 7fa33cdc4700 1 -- start start 2023-06-22T16:23:49.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa33cdc4700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa3380b1e20 0x7fa3380cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa33cdc4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa3380b2b00 0x7fa338158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa33cdc4700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3380b3ac0 con 0x7fa338158bf0 2023-06-22T16:23:49.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa33cdc4700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3380b4b60 con 0x7fa3380b2b00 2023-06-22T16:23:49.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa33cdc4700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3380b3da0 con 0x7fa3380b1e20 2023-06-22T16:23:49.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa337fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa3380b2b00 0x7fa338158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa337fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa3380b2b00 0x7fa338158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:60836/0 (socket says 172.21.15.149:60836) 2023-06-22T16:23:49.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa337fff700 1 -- 172.21.15.149:0/2217234601 learned_addr learned my addr 172.21.15.149:0/2217234601 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:49.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa336ffd700 1 --2- 172.21.15.149:0/2217234601 >> v2:172.21.15.196:3300/0 conn(0x7fa3380b1e20 0x7fa3380cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa337fff700 1 -- 172.21.15.149:0/2217234601 >> v2:172.21.15.196:3300/0 conn(0x7fa3380b1e20 msgr2=0x7fa3380cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:49.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa337fff700 1 --2- 172.21.15.149:0/2217234601 >> v2:172.21.15.196:3300/0 conn(0x7fa3380b1e20 0x7fa3380cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa337fff700 1 -- 172.21.15.149:0/2217234601 >> v1:172.21.15.196:6789/0 conn(0x7fa338158bf0 legacy=0x7fa3380b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa337fff700 1 -- 172.21.15.149:0/2217234601 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3380b4080 con 0x7fa3380b2b00 2023-06-22T16:23:49.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa337fff700 1 --2- 172.21.15.149:0/2217234601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380b2b00 0x7fa338158fc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa3380b2880 tx=0x7fa330009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d5e727711fc6fb server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:49.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa3367fc700 1 -- 172.21.15.149:0/2217234601 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000e070 con 0x7fa3380b2b00 2023-06-22T16:23:49.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa3367fc700 1 -- 172.21.15.149:0/2217234601 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33000ba20 con 0x7fa3380b2b00 2023-06-22T16:23:49.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa3367fc700 1 -- 172.21.15.149:0/2217234601 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3300092e0 con 0x7fa3380b2b00 2023-06-22T16:23:49.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa33cdc4700 1 -- 172.21.15.149:0/2217234601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380b2b00 msgr2=0x7fa338158fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa33cdc4700 1 --2- 172.21.15.149:0/2217234601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380b2b00 0x7fa338158fc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa3380b2880 tx=0x7fa330009840 comp rx=0 tx=0).stop 2023-06-22T16:23:49.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa33cdc4700 1 -- 172.21.15.149:0/2217234601 shutdown_connections 2023-06-22T16:23:49.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa33cdc4700 1 --2- 172.21.15.149:0/2217234601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380b2b00 0x7fa338158fc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa33cdc4700 1 --2- 172.21.15.149:0/2217234601 >> v2:172.21.15.196:3300/0 conn(0x7fa3380b1e20 0x7fa3380cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa33cdc4700 1 -- 172.21.15.149:0/2217234601 >> 172.21.15.149:0/2217234601 conn(0x7fa338063460 msgr2=0x7fa33806da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:49.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa33cdc4700 1 -- 172.21.15.149:0/2217234601 shutdown_connections 2023-06-22T16:23:49.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.345+0000 7fa33cdc4700 1 -- 172.21.15.149:0/2217234601 wait complete. 2023-06-22T16:23:49.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.349+0000 7fa33cdc4700 1 Processor -- start 2023-06-22T16:23:49.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.349+0000 7fa33cdc4700 1 -- start start 2023-06-22T16:23:49.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa33cdc4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380b1e20 0x7fa3380c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa33cdc4700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3380b2b00 0x7fa3380c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa33cdc4700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa338158bf0 0x7fa338168ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa33cdc4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c5560 con 0x7fa3380b1e20 2023-06-22T16:23:49.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa33cdc4700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa338151920 con 0x7fa338158bf0 2023-06-22T16:23:49.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa33cdc4700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c6040 con 0x7fa3380b2b00 2023-06-22T16:23:49.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa3377fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380b1e20 0x7fa3380c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa3377fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380b1e20 0x7fa3380c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:60842/0 (socket says 172.21.15.149:60842) 2023-06-22T16:23:49.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa3377fe700 1 -- 172.21.15.149:0/3740424584 learned_addr learned my addr 172.21.15.149:0/3740424584 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:49.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa336ffd700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3380b2b00 0x7fa3380c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa337fff700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa338158bf0 0x7fa338168ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa3377fe700 1 -- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3380b2b00 msgr2=0x7fa3380c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa3377fe700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3380b2b00 0x7fa3380c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa3377fe700 1 -- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa338158bf0 msgr2=0x7fa338168ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa3377fe700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa338158bf0 0x7fa338168ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa3377fe700 1 -- 172.21.15.149:0/3740424584 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330009ae0 con 0x7fa3380b1e20 2023-06-22T16:23:49.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa3377fe700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380b1e20 0x7fa3380c4ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa32800c4e0 tx=0x7fa32800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:49.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa31f7fe700 1 -- 172.21.15.149:0/3740424584 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328011590 con 0x7fa3380b1e20 2023-06-22T16:23:49.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa31f7fe700 1 -- 172.21.15.149:0/3740424584 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa328011710 con 0x7fa3380b1e20 2023-06-22T16:23:49.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa33cdc4700 1 -- 172.21.15.149:0/3740424584 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3380c57a0 con 0x7fa3380b1e20 2023-06-22T16:23:49.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa31f7fe700 1 -- 172.21.15.149:0/3740424584 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328011ad0 con 0x7fa3380b1e20 2023-06-22T16:23:49.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa33cdc4700 1 -- 172.21.15.149:0/3740424584 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3380c5d60 con 0x7fa3380b1e20 2023-06-22T16:23:49.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.353+0000 7fa33cdc4700 1 -- 172.21.15.149:0/3740424584 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa338087e20 con 0x7fa3380b1e20 2023-06-22T16:23:49.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.357+0000 7fa31f7fe700 1 -- 172.21.15.149:0/3740424584 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fa32801b3b0 con 0x7fa3380b1e20 2023-06-22T16:23:49.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.357+0000 7fa31f7fe700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fa3240604b0 0x7fa324062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.357+0000 7fa31f7fe700 1 -- 172.21.15.149:0/3740424584 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa32807b6a0 con 0x7fa3380b1e20 2023-06-22T16:23:49.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.357+0000 7fa336ffd700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fa3240604b0 0x7fa324062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.357+0000 7fa336ffd700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fa3240604b0 0x7fa324062960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa3380d0cc0 tx=0x7fa32c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:49.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.365+0000 7fa31f7fe700 1 -- 172.21.15.149:0/3740424584 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fa32804c0a0 con 0x7fa3380b1e20 2023-06-22T16:23:49.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.525+0000 7fa33cdc4700 1 -- 172.21.15.149:0/3740424584 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fa3380b4360 con 0x7fa3380b1e20 2023-06-22T16:23:49.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.677+0000 7fa31f7fe700 1 -- 172.21.15.149:0/3740424584 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v20) v1 ==== 109+0+0 (secure 0 0 0) 0x7fa32804f6c0 con 0x7fa3380b1e20 2023-06-22T16:23:49.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.677+0000 7fa33cdc4700 1 -- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fa3240604b0 msgr2=0x7fa324062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.677+0000 7fa33cdc4700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fa3240604b0 0x7fa324062960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa3380d0cc0 tx=0x7fa32c0091a0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.681+0000 7fa33cdc4700 1 -- 172.21.15.149:0/3740424584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380b1e20 msgr2=0x7fa3380c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.681+0000 7fa33cdc4700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380b1e20 0x7fa3380c4ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa32800c4e0 tx=0x7fa32800c7f0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.681+0000 7fa33cdc4700 1 -- 172.21.15.149:0/3740424584 shutdown_connections 2023-06-22T16:23:49.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.681+0000 7fa33cdc4700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa338158bf0 0x7fa338168ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.681+0000 7fa33cdc4700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fa3240604b0 0x7fa324062960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.681+0000 7fa33cdc4700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa3380b2b00 0x7fa3380c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.681+0000 7fa33cdc4700 1 --2- 172.21.15.149:0/3740424584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3380b1e20 0x7fa3380c4ae0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.681+0000 7fa33cdc4700 1 -- 172.21.15.149:0/3740424584 >> 172.21.15.149:0/3740424584 conn(0x7fa338063460 msgr2=0x7fa338155240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:49.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.681+0000 7fa33cdc4700 1 -- 172.21.15.149:0/3740424584 shutdown_connections 2023-06-22T16:23:49.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.681+0000 7fa33cdc4700 1 -- 172.21.15.149:0/3740424584 wait complete. 2023-06-22T16:23:49.688 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'rbd' created 2023-06-22T16:23:49.700 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-22T16:23:49.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.809+0000 7f4dc73ac700 1 Processor -- start 2023-06-22T16:23:49.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.809+0000 7f4dc73ac700 1 -- start start 2023-06-22T16:23:49.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.809+0000 7f4dc73ac700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4dc006ca90 0x7f4dc0156000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.809+0000 7f4dc73ac700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4dc015a260 0x7f4dc0156540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.809+0000 7f4dc73ac700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc00b1100 con 0x7f4dc014fff0 2023-06-22T16:23:49.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.809+0000 7f4dc73ac700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc0156da0 con 0x7f4dc006ca90 2023-06-22T16:23:49.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.809+0000 7f4dc73ac700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc0159780 con 0x7f4dc015a260 2023-06-22T16:23:49.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc5ba9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4dc006ca90 0x7f4dc0156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc5ba9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4dc006ca90 0x7f4dc0156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:60850/0 (socket says 172.21.15.149:60850) 2023-06-22T16:23:49.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc5ba9700 1 -- 172.21.15.149:0/2860829495 learned_addr learned my addr 172.21.15.149:0/2860829495 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:49.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc6bab700 1 --2- 172.21.15.149:0/2860829495 >> v2:172.21.15.196:3300/0 conn(0x7f4dc015a260 0x7f4dc0156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc53a8700 1 -- 172.21.15.149:0/2860829495 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774641705 0 0) 0x7f4dc00b1100 con 0x7f4dc014fff0 2023-06-22T16:23:49.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc53a8700 1 -- 172.21.15.149:0/2860829495 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dac003570 con 0x7f4dc014fff0 2023-06-22T16:23:49.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc5ba9700 1 -- 172.21.15.149:0/2860829495 >> v2:172.21.15.196:3300/0 conn(0x7f4dc015a260 msgr2=0x7f4dc0156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:49.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc5ba9700 1 --2- 172.21.15.149:0/2860829495 >> v2:172.21.15.196:3300/0 conn(0x7f4dc015a260 0x7f4dc0156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc5ba9700 1 -- 172.21.15.149:0/2860829495 >> v1:172.21.15.196:6789/0 conn(0x7f4dc014fff0 legacy=0x7f4dc006c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc5ba9700 1 -- 172.21.15.149:0/2860829495 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc0159a60 con 0x7f4dc006ca90 2023-06-22T16:23:49.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc5ba9700 1 --2- 172.21.15.149:0/2860829495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc006ca90 0x7f4dc0156000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00b1a50 tx=0x7f4dbc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510bd690fc3992a5 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:49.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc53a8700 1 -- 172.21.15.149:0/2860829495 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc00e070 con 0x7f4dc006ca90 2023-06-22T16:23:49.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc53a8700 1 -- 172.21.15.149:0/2860829495 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc00b970 con 0x7f4dc006ca90 2023-06-22T16:23:49.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc53a8700 1 -- 172.21.15.149:0/2860829495 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0092e0 con 0x7f4dc006ca90 2023-06-22T16:23:49.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc73ac700 1 -- 172.21.15.149:0/2860829495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc006ca90 msgr2=0x7f4dc0156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc73ac700 1 --2- 172.21.15.149:0/2860829495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc006ca90 0x7f4dc0156000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00b1a50 tx=0x7f4dbc009840 comp rx=0 tx=0).stop 2023-06-22T16:23:49.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc73ac700 1 -- 172.21.15.149:0/2860829495 shutdown_connections 2023-06-22T16:23:49.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc73ac700 1 --2- 172.21.15.149:0/2860829495 >> v2:172.21.15.196:3300/0 conn(0x7f4dc015a260 0x7f4dc0156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc73ac700 1 --2- 172.21.15.149:0/2860829495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc006ca90 0x7f4dc0156000 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc73ac700 1 -- 172.21.15.149:0/2860829495 >> 172.21.15.149:0/2860829495 conn(0x7f4dc0062990 msgr2=0x7f4dc0062d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:49.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc73ac700 1 -- 172.21.15.149:0/2860829495 shutdown_connections 2023-06-22T16:23:49.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.813+0000 7f4dc73ac700 1 -- 172.21.15.149:0/2860829495 wait complete. 2023-06-22T16:23:49.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc73ac700 1 Processor -- start 2023-06-22T16:23:49.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc73ac700 1 -- start start 2023-06-22T16:23:49.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc73ac700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc006ca90 0x7f4dc0143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc73ac700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4dc014fff0 0x7f4dc00cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc73ac700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4dc015a260 0x7f4dc00cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc73ac700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00ca850 con 0x7f4dc006ca90 2023-06-22T16:23:49.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc73ac700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0143d80 con 0x7f4dc014fff0 2023-06-22T16:23:49.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc73ac700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00c9bd0 con 0x7f4dc015a260 2023-06-22T16:23:49.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc63aa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc006ca90 0x7f4dc0143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc63aa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc006ca90 0x7f4dc0143840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:60854/0 (socket says 172.21.15.149:60854) 2023-06-22T16:23:49.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc63aa700 1 -- 172.21.15.149:0/102463396 learned_addr learned my addr 172.21.15.149:0/102463396 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:49.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc5ba9700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4dc014fff0 0x7f4dc00cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc6bab700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4dc015a260 0x7f4dc00cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc63aa700 1 -- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4dc015a260 msgr2=0x7f4dc00cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc63aa700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4dc015a260 0x7f4dc00cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc63aa700 1 -- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4dc014fff0 msgr2=0x7f4dc00cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:49.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc63aa700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4dc014fff0 0x7f4dc00cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:49.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc63aa700 1 -- 172.21.15.149:0/102463396 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc009ae0 con 0x7f4dc006ca90 2023-06-22T16:23:49.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc6bab700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4dc015a260 0x7f4dc00cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T16:23:49.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4dc63aa700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc006ca90 0x7f4dc0143840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c7c0 tx=0x7f4db4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:49.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.817+0000 7f4db27fc700 1 -- 172.21.15.149:0/102463396 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40015d0 con 0x7f4dc006ca90 2023-06-22T16:23:49.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.821+0000 7f4db27fc700 1 -- 172.21.15.149:0/102463396 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4001730 con 0x7f4dc006ca90 2023-06-22T16:23:49.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.821+0000 7f4dc73ac700 1 -- 172.21.15.149:0/102463396 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc00c9eb0 con 0x7f4dc006ca90 2023-06-22T16:23:49.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.821+0000 7f4db27fc700 1 -- 172.21.15.149:0/102463396 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4001af0 con 0x7f4dc006ca90 2023-06-22T16:23:49.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.821+0000 7f4dc73ac700 1 -- 172.21.15.149:0/102463396 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc00ca470 con 0x7f4dc006ca90 2023-06-22T16:23:49.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.821+0000 7f4db27fc700 1 -- 172.21.15.149:0/102463396 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f4db401b3b0 con 0x7f4dc006ca90 2023-06-22T16:23:49.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.821+0000 7f4dc73ac700 1 -- 172.21.15.149:0/102463396 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc00694a0 con 0x7f4dc006ca90 2023-06-22T16:23:49.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.821+0000 7f4db27fc700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f4da40604b0 0x7f4da4062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:49.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.821+0000 7f4db27fc700 1 -- 172.21.15.149:0/102463396 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f4db407bed0 con 0x7f4dc006ca90 2023-06-22T16:23:49.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.821+0000 7f4dc5ba9700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f4da40604b0 0x7f4da4062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:49.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.825+0000 7f4dc5ba9700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f4da40604b0 0x7f4da4062960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4dc006ce90 tx=0x7f4dbc018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:49.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.829+0000 7f4db27fc700 1 -- 172.21.15.149:0/102463396 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f4db404c6e0 con 0x7f4dc006ca90 2023-06-22T16:23:49.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:49.993+0000 7f4dc73ac700 1 -- 172.21.15.149:0/102463396 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4dc0159d40 con 0x7f4dc006ca90 2023-06-22T16:23:50.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.689+0000 7f4db27fc700 1 -- 172.21.15.149:0/102463396 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v21) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4db4017020 con 0x7f4dc006ca90 2023-06-22T16:23:50.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.693+0000 7f4dc73ac700 1 -- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f4da40604b0 msgr2=0x7f4da4062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:50.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.693+0000 7f4dc73ac700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f4da40604b0 0x7f4da4062960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4dc006ce90 tx=0x7f4dbc018000 comp rx=0 tx=0).stop 2023-06-22T16:23:50.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.693+0000 7f4dc73ac700 1 -- 172.21.15.149:0/102463396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc006ca90 msgr2=0x7f4dc0143840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:50.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.693+0000 7f4dc73ac700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc006ca90 0x7f4dc0143840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c7c0 tx=0x7f4db4007d90 comp rx=0 tx=0).stop 2023-06-22T16:23:50.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.693+0000 7f4dc73ac700 1 -- 172.21.15.149:0/102463396 shutdown_connections 2023-06-22T16:23:50.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.693+0000 7f4dc73ac700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f4da40604b0 0x7f4da4062960 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:50.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.693+0000 7f4dc73ac700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4dc015a260 0x7f4dc00cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:50.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.693+0000 7f4dc73ac700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4dc014fff0 0x7f4dc00cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:50.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.693+0000 7f4dc73ac700 1 --2- 172.21.15.149:0/102463396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc006ca90 0x7f4dc0143840 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:50.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.693+0000 7f4dc73ac700 1 -- 172.21.15.149:0/102463396 >> 172.21.15.149:0/102463396 conn(0x7f4dc0062990 msgr2=0x7f4dc0155500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:50.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.693+0000 7f4dc73ac700 1 -- 172.21.15.149:0/102463396 shutdown_connections 2023-06-22T16:23:50.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.693+0000 7f4dc73ac700 1 -- 172.21.15.149:0/102463396 wait complete. 2023-06-22T16:23:50.701 INFO:teuthology.orchestra.run.smithi149.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-22T16:23:50.712 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-22T16:23:50.713 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-22T16:23:50.713 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-22T16:23:50.715 INFO:tasks.ceph.mds.a:Started 2023-06-22T16:23:50.716 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-22T16:23:50.716 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-22T16:23:50.718 INFO:tasks.ceph.mds.c:Started 2023-06-22T16:23:50.718 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-22T16:23:50.718 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-22T16:23:50.720 INFO:tasks.ceph.mds.b:Started 2023-06-22T16:23:50.721 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-22T16:23:50.721 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-22T16:23:50.723 INFO:tasks.ceph.mds.d:Started 2023-06-22T16:23:50.724 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-22T16:23:50.724 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T16:23:50.788 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-06-22T16:23:50.789 INFO:tasks.ceph.mds.b.smithi196.stdout:starting mds.b at 2023-06-22T16:23:50.792 INFO:tasks.ceph.mds.d.smithi196.stdout:starting mds.d at 2023-06-22T16:23:50.811 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2023-06-22T16:23:50.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.817+0000 7f74af18a700 1 Processor -- start 2023-06-22T16:23:50.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.817+0000 7f74af18a700 1 -- start start 2023-06-22T16:23:50.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74af18a700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f74a80cbb30 0x7f74a806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:50.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74af18a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80c7a80 con 0x7f74a81552e0 2023-06-22T16:23:50.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74af18a700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80c7d00 con 0x7f74a80caf70 2023-06-22T16:23:50.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74af18a700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a80c8980 con 0x7f74a80cbb30 2023-06-22T16:23:50.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74acf26700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f74a81552e0 0x7f74a80cb420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:38202/0 (socket says 172.21.15.149:38202) 2023-06-22T16:23:50.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74acf26700 1 -- 172.21.15.149:0/2914495456 learned_addr learned my addr 172.21.15.149:0/2914495456 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-22T16:23:50.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a7fff700 1 --2- 172.21.15.149:0/2914495456 >> v2:172.21.15.196:3300/0 conn(0x7f74a80cbb30 0x7f74a806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:50.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32419481 0 0) 0x7f74a80c7a80 con 0x7f74a81552e0 2023-06-22T16:23:50.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7490003570 con 0x7f74a81552e0 2023-06-22T16:23:50.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1552536824 0 0) 0x7f7490003570 con 0x7f74a81552e0 2023-06-22T16:23:50.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 >> v2:172.21.15.196:3300/0 conn(0x7f74a80cbb30 msgr2=0x7f74a806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:50.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 --2- 172.21.15.149:0/2914495456 >> v2:172.21.15.196:3300/0 conn(0x7f74a80cbb30 0x7f74a806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:50.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 >> v1:172.21.15.196:6789/0 conn(0x7f74a80caf70 legacy=0x7f74a81556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:50.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a80c7fe0 con 0x7f74a81552e0 2023-06-22T16:23:50.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 882791489 0 0) 0x7f749c001470 con 0x7f74a81552e0 2023-06-22T16:23:50.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 >> v1:172.21.15.149:6789/0 conn(0x7f74a81552e0 legacy=0x7f74a80cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:50.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 --2- 172.21.15.149:0/2914495456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7490003a90 0x7f7490003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:50.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 --2- 172.21.15.149:0/2914495456 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7490004810 0x7f7490004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:50.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 --2- 172.21.15.149:0/2914495456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7490005210 0x7f749000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:50.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80c8980 con 0x7f7490003a90 2023-06-22T16:23:50.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74acf26700 1 --2- 172.21.15.149:0/2914495456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7490003a90 0x7f7490003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:50.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a7fff700 1 --2- 172.21.15.149:0/2914495456 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7490004810 0x7f7490004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:50.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749000d2c0 con 0x7f7490005210 2023-06-22T16:23:50.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749000d480 con 0x7f7490004810 2023-06-22T16:23:50.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74ad727700 1 --2- 172.21.15.149:0/2914495456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7490005210 0x7f749000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:50.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74acf26700 1 -- 172.21.15.149:0/2914495456 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7490004810 msgr2=0x7f7490004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:50.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74acf26700 1 --2- 172.21.15.149:0/2914495456 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7490004810 0x7f7490004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:50.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74acf26700 1 -- 172.21.15.149:0/2914495456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7490005210 msgr2=0x7f749000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:50.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74acf26700 1 --2- 172.21.15.149:0/2914495456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7490005210 0x7f749000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:50.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74acf26700 1 -- 172.21.15.149:0/2914495456 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7490003570 con 0x7f7490003a90 2023-06-22T16:23:50.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74ad727700 1 -- 172.21.15.149:0/2914495456 reap_dead start 2023-06-22T16:23:50.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74acf26700 1 --2- 172.21.15.149:0/2914495456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7490003a90 0x7f7490003ea0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f749c00c390 tx=0x7f749c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee5ed5796eb04c9 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:50.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c00cc60 con 0x7f7490003a90 2023-06-22T16:23:50.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c00cdc0 con 0x7f7490003a90 2023-06-22T16:23:50.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74a77fe700 1 -- 172.21.15.149:0/2914495456 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c005b50 con 0x7f7490003a90 2023-06-22T16:23:50.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.821+0000 7f74af18a700 1 -- 172.21.15.149:0/2914495456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7490003a90 msgr2=0x7f7490003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:50.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 --2- 172.21.15.149:0/2914495456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7490003a90 0x7f7490003ea0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f749c00c390 tx=0x7f749c001e50 comp rx=0 tx=0).stop 2023-06-22T16:23:50.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 -- 172.21.15.149:0/2914495456 shutdown_connections 2023-06-22T16:23:50.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 --2- 172.21.15.149:0/2914495456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7490003a90 0x7f7490003ea0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:50.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 -- 172.21.15.149:0/2914495456 >> 172.21.15.149:0/2914495456 conn(0x7f74a80678c0 msgr2=0x7f74a80cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:50.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 -- 172.21.15.149:0/2914495456 shutdown_connections 2023-06-22T16:23:50.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 -- 172.21.15.149:0/2914495456 wait complete. 2023-06-22T16:23:50.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 Processor -- start 2023-06-22T16:23:50.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 -- start start 2023-06-22T16:23:50.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7490003a90 0x7f74a81578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:50.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74a8165ac0 0x7f74a8169a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:50.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74a814ffe0 0x7f74a81581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:50.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80ae9e0 con 0x7f74a814ffe0 2023-06-22T16:23:50.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8159310 con 0x7f74a8165ac0 2023-06-22T16:23:50.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74af18a700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8157df0 con 0x7f7490003a90 2023-06-22T16:23:50.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74ad727700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74a814ffe0 0x7f74a81581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:50.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74ad727700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74a814ffe0 0x7f74a81581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:60888/0 (socket says 172.21.15.149:60888) 2023-06-22T16:23:50.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74ad727700 1 -- 172.21.15.149:0/3292539873 learned_addr learned my addr 172.21.15.149:0/3292539873 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:50.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74acf26700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7490003a90 0x7f74a81578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:50.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74a7fff700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74a8165ac0 0x7f74a8169a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:50.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74ad727700 1 -- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7490003a90 msgr2=0x7f74a81578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:50.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74ad727700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7490003a90 0x7f74a81578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:50.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74ad727700 1 -- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74a8165ac0 msgr2=0x7f74a8169a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:50.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74ad727700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74a8165ac0 0x7f74a8169a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:50.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74ad727700 1 -- 172.21.15.149:0/3292539873 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8169fb0 con 0x7f74a814ffe0 2023-06-22T16:23:50.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.825+0000 7f74ad727700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74a814ffe0 0x7f74a81581f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f74a80cb390 tx=0x7f74a0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:50.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.829+0000 7f74a4ff9700 1 -- 172.21.15.149:0/3292539873 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000ee70 con 0x7f74a814ffe0 2023-06-22T16:23:50.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.829+0000 7f74a4ff9700 1 -- 172.21.15.149:0/3292539873 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0006db0 con 0x7f74a814ffe0 2023-06-22T16:23:50.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.829+0000 7f74af18a700 1 -- 172.21.15.149:0/3292539873 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a8166030 con 0x7f74a814ffe0 2023-06-22T16:23:50.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.829+0000 7f74a4ff9700 1 -- 172.21.15.149:0/3292539873 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000c800 con 0x7f74a814ffe0 2023-06-22T16:23:50.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.829+0000 7f74af18a700 1 -- 172.21.15.149:0/3292539873 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a81665f0 con 0x7f74a814ffe0 2023-06-22T16:23:50.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.829+0000 7f74af18a700 1 -- 172.21.15.149:0/3292539873 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a806b390 con 0x7f74a814ffe0 2023-06-22T16:23:50.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.829+0000 7f74a4ff9700 1 -- 172.21.15.149:0/3292539873 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f74a000cbb0 con 0x7f74a814ffe0 2023-06-22T16:23:50.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.829+0000 7f74a4ff9700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f74940604b0 0x7f7494062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:50.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.829+0000 7f74a4ff9700 1 -- 172.21.15.149:0/3292539873 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f74a007bde0 con 0x7f74a814ffe0 2023-06-22T16:23:50.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.829+0000 7f74acf26700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f74940604b0 0x7f7494062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:50.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.829+0000 7f74acf26700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f74940604b0 0x7f7494062960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f749c007cd0 tx=0x7f749c015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:50.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.837+0000 7f74a4ff9700 1 -- 172.21.15.149:0/3292539873 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f74a806b390 con 0x7f74a814ffe0 2023-06-22T16:23:51.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.997+0000 7f74af18a700 1 -- 172.21.15.149:0/3292539873 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74a806b390 con 0x7f74a814ffe0 2023-06-22T16:23:51.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.997+0000 7f74a4ff9700 1 -- 172.21.15.149:0/3292539873 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+13708 (secure 0 0 0) 0x7f74a806b390 con 0x7f74a814ffe0 2023-06-22T16:23:51.003 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:23:51.003 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":21,"fsid":"0dba7f42-2446-45e3-aae5-b3ca874cf325","created":"2023-06-22T16:23:31.621362+0000","modified":"2023-06-22T16:23:50.677763+0000","last_up_change":"2023-06-22T16:23:42.614261+0000","last_in_change":"2023-06-22T16:23:33.638142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T16:23:43.865433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T16:23:49.572200+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"56ddaf00-fc77-44cf-b823-5bd377b92576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":32836},{"type":"v1","addr":"172.21.15.149:6809","nonce":32836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":32836},{"type":"v1","addr":"172.21.15.149:6811","nonce":32836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":32836},{"type":"v1","addr":"172.21.15.149:6816","nonce":32836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":32836},{"type":"v1","addr":"172.21.15.149:6813","nonce":32836}]},"public_addr":"172.21.15.149:6809/32836","cluster_addr":"172.21.15.149:6811/32836","heartbeat_back_addr":"172.21.15.149:6816/32836","heartbeat_front_addr":"172.21.15.149:6813/32836","state":["exists","up"]},{"osd":1,"uuid":"532f10bd-8b84-4a0b-9aed-28e7afb4a863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":32835},{"type":"v1","addr":"172.21.15.149:6817","nonce":32835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":32835},{"type":"v1","addr":"172.21.15.149:6819","nonce":32835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":32835},{"type":"v1","addr":"172.21.15.149:6823","nonce":32835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":32835},{"type":"v1","addr":"172.21.15.149:6821","nonce":32835}]},"public_addr":"172.21.15.149:6817/32835","cluster_addr":"172.21.15.149:6819/32835","heartbeat_back_addr":"172.21.15.149:6823/32835","heartbeat_front_addr":"172.21.15.149:6821/32835","state":["exists","up"]},{"osd":2,"uuid":"bc3c458c-c810-4c5a-b258-2de1cb3ca1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":32837},{"type":"v1","addr":"172.21.15.149:6825","nonce":32837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":32837},{"type":"v1","addr":"172.21.15.149:6827","nonce":32837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":32837},{"type":"v1","addr":"172.21.15.149:6831","nonce":32837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":32837},{"type":"v1","addr":"172.21.15.149:6829","nonce":32837}]},"public_addr":"172.21.15.149:6825/32837","cluster_addr":"172.21.15.149:6827/32837","heartbeat_back_addr":"172.21.15.149:6831/32837","heartbeat_front_addr":"172.21.15.149:6829/32837","state":["exists","up"]},{"osd":3,"uuid":"04bf7f65-1946-499c-aea9-c4caa92e8488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":32834},{"type":"v1","addr":"172.21.15.149:6801","nonce":32834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":32834},{"type":"v1","addr":"172.21.15.149:6803","nonce":32834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":32834},{"type":"v1","addr":"172.21.15.149:6807","nonce":32834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":32834},{"type":"v1","addr":"172.21.15.149:6805","nonce":32834}]},"public_addr":"172.21.15.149:6801/32834","cluster_addr":"172.21.15.149:6803/32834","heartbeat_back_addr":"172.21.15.149:6807/32834","heartbeat_front_addr":"172.21.15.149:6805/32834","state":["exists","up"]},{"osd":4,"uuid":"e49f385d-76d9-4304-8486-3e1f3cb8fd23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":33055},{"type":"v1","addr":"172.21.15.196:6809","nonce":33055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":33055},{"type":"v1","addr":"172.21.15.196:6811","nonce":33055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":33055},{"type":"v1","addr":"172.21.15.196:6815","nonce":33055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":33055},{"type":"v1","addr":"172.21.15.196:6813","nonce":33055}]},"public_addr":"172.21.15.196:6809/33055","cluster_addr":"172.21.15.196:6811/33055","heartbeat_back_addr":"172.21.15.196:6815/33055","heartbeat_front_addr":"172.21.15.196:6813/33055","state":["exists","up"]},{"osd":5,"uuid":"671a4069-7c86-4a14-825c-1179a74928c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":33057},{"type":"v1","addr":"172.21.15.196:6825","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":33057},{"type":"v1","addr":"172.21.15.196:6827","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":33057},{"type":"v1","addr":"172.21.15.196:6831","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":33057},{"type":"v1","addr":"172.21.15.196:6829","nonce":33057}]},"public_addr":"172.21.15.196:6825/33057","cluster_addr":"172.21.15.196:6827/33057","heartbeat_back_addr":"172.21.15.196:6831/33057","heartbeat_front_addr":"172.21.15.196:6829/33057","state":["exists","up"]},{"osd":6,"uuid":"7114b0c3-27fe-4816-8cc8-fb3679b8e707","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":33054},{"type":"v1","addr":"172.21.15.196:6801","nonce":33054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":33054},{"type":"v1","addr":"172.21.15.196:6803","nonce":33054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":33054},{"type":"v1","addr":"172.21.15.196:6807","nonce":33054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":33054},{"type":"v1","addr":"172.21.15.196:6805","nonce":33054}]},"public_addr":"172.21.15.196:6801/33054","cluster_addr":"172.21.15.196:6803/33054","heartbeat_back_addr":"172.21.15.196:6807/33054","heartbeat_front_addr":"172.21.15.196:6805/33054","state":["exists","up"]},{"osd":7,"uuid":"f9e6e633-0952-40bf-97e6-7c8b0bc804bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":33058},{"type":"v1","addr":"172.21.15.196:6817","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":33058},{"type":"v1","addr":"172.21.15.196:6819","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":33058},{"type":"v1","addr":"172.21.15.196:6823","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":33058},{"type":"v1","addr":"172.21.15.196:6821","nonce":33058}]},"public_addr":"172.21.15.196:6817/33058","cluster_addr":"172.21.15.196:6819/33058","heartbeat_back_addr":"172.21.15.196:6823/33058","heartbeat_front_addr":"172.21.15.196:6821/33058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.838753+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.877504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.932235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.898286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.697196+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:39.163122+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.820624+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.902436+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T16:23:51.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.997+0000 7f74af18a700 1 -- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f74940604b0 msgr2=0x7f7494062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.997+0000 7f74af18a700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f74940604b0 0x7f7494062960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f749c007cd0 tx=0x7f749c015000 comp rx=0 tx=0).stop 2023-06-22T16:23:51.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.997+0000 7f74af18a700 1 -- 172.21.15.149:0/3292539873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74a814ffe0 msgr2=0x7f74a81581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.997+0000 7f74af18a700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74a814ffe0 0x7f74a81581f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f74a80cb390 tx=0x7f74a0001640 comp rx=0 tx=0).stop 2023-06-22T16:23:51.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.997+0000 7f74af18a700 1 -- 172.21.15.149:0/3292539873 shutdown_connections 2023-06-22T16:23:51.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.997+0000 7f74af18a700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74a814ffe0 0x7f74a81581f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.997+0000 7f74af18a700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74a8165ac0 0x7f74a8169a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.997+0000 7f74af18a700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f74940604b0 0x7f7494062960 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.997+0000 7f74af18a700 1 --2- 172.21.15.149:0/3292539873 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7490003a90 0x7f74a81578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.997+0000 7f74af18a700 1 -- 172.21.15.149:0/3292539873 >> 172.21.15.149:0/3292539873 conn(0x7f74a80678c0 msgr2=0x7f74a8150e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:51.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:50.997+0000 7f74af18a700 1 -- 172.21.15.149:0/3292539873 shutdown_connections 2023-06-22T16:23:51.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.001+0000 7f74af18a700 1 -- 172.21.15.149:0/3292539873 wait complete. 2023-06-22T16:23:51.017 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T16:23:43.865433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T16:23:49.572200+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-06-22T16:23:51.017 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T16:23:51.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.117+0000 7f90e7fff700 1 Processor -- start 2023-06-22T16:23:51.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.117+0000 7f90e7fff700 1 -- start start 2023-06-22T16:23:51.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.117+0000 7f90e7fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e8158bf0 0x7f90e80b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.117+0000 7f90e7fff700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f90e80b1c50 0x7f90e8159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.117+0000 7f90e7fff700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e80b20b0 con 0x7f90e80b2b00 2023-06-22T16:23:51.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.117+0000 7f90e7fff700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e80b4b60 con 0x7f90e80b1c50 2023-06-22T16:23:51.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.117+0000 7f90e7fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e80b3ac0 con 0x7f90e8158bf0 2023-06-22T16:23:51.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.117+0000 7f90e67fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f90e80b2b00 0x7f90e80ce420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57828/0 (socket says 172.21.15.149:57828) 2023-06-22T16:23:51.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.117+0000 7f90e67fc700 1 -- 172.21.15.149:0/3572805819 learned_addr learned my addr 172.21.15.149:0/3572805819 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-22T16:23:51.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.117+0000 7f90e6ffd700 1 --2- 172.21.15.149:0/3572805819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e8158bf0 0x7f90e80b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.117+0000 7f90e77fe700 1 --2- 172.21.15.149:0/3572805819 >> v2:172.21.15.196:3300/0 conn(0x7f90e80b1c50 0x7f90e8159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.117+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588371151 0 0) 0x7f90d8001110 con 0x7f90e80b2b00 2023-06-22T16:23:51.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d0003570 con 0x7f90e80b2b00 2023-06-22T16:23:51.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2786534578 0 0) 0x7f90d0003570 con 0x7f90e80b2b00 2023-06-22T16:23:51.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e8158bf0 msgr2=0x7f90e80b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:51.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 --2- 172.21.15.149:0/3572805819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e8158bf0 0x7f90e80b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 >> v2:172.21.15.196:3300/0 conn(0x7f90e80b1c50 msgr2=0x7f90e8159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:51.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 --2- 172.21.15.149:0/3572805819 >> v2:172.21.15.196:3300/0 conn(0x7f90e80b1c50 0x7f90e8159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e80b3da0 con 0x7f90e80b2b00 2023-06-22T16:23:51.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 882791489 0 0) 0x7f90d8001620 con 0x7f90e80b2b00 2023-06-22T16:23:51.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 >> v1:172.21.15.149:6789/0 conn(0x7f90e80b2b00 legacy=0x7f90e80ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 --2- 172.21.15.149:0/3572805819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d0003a60 0x7f90d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 --2- 172.21.15.149:0/3572805819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e8158bf0 0x7f90d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 --2- 172.21.15.149:0/3572805819 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90d0004d50 0x7f90d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e80b4b60 con 0x7f90d0003a60 2023-06-22T16:23:51.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e80b3ac0 con 0x7f90d0004d50 2023-06-22T16:23:51.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d000ba60 con 0x7f90e8158bf0 2023-06-22T16:23:51.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e6ffd700 1 --2- 172.21.15.149:0/3572805819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d0003a60 0x7f90d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e67fc700 1 --2- 172.21.15.149:0/3572805819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e8158bf0 0x7f90d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e77fe700 1 --2- 172.21.15.149:0/3572805819 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90d0004d50 0x7f90d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e6ffd700 1 -- 172.21.15.149:0/3572805819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e8158bf0 msgr2=0x7f90d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:51.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e6ffd700 1 --2- 172.21.15.149:0/3572805819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e8158bf0 0x7f90d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e6ffd700 1 -- 172.21.15.149:0/3572805819 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90d0004d50 msgr2=0x7f90d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:51.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e6ffd700 1 --2- 172.21.15.149:0/3572805819 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90d0004d50 0x7f90d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e6ffd700 1 -- 172.21.15.149:0/3572805819 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d0003570 con 0x7f90d0003a60 2023-06-22T16:23:51.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e6ffd700 1 --2- 172.21.15.149:0/3572805819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d0003a60 0x7f90d0003e70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009c00 tx=0x7f90dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba46649fde0d0c4 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:51.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc00e6b0 con 0x7f90d0003a60 2023-06-22T16:23:51.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc00e810 con 0x7f90d0003a60 2023-06-22T16:23:51.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e5ffb700 1 -- 172.21.15.149:0/3572805819 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc00ebd0 con 0x7f90d0003a60 2023-06-22T16:23:51.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e7fff700 1 -- 172.21.15.149:0/3572805819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d0003a60 msgr2=0x7f90d0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e7fff700 1 --2- 172.21.15.149:0/3572805819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d0003a60 0x7f90d0003e70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009c00 tx=0x7f90dc0091a0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e77fe700 1 -- 172.21.15.149:0/3572805819 reap_dead start 2023-06-22T16:23:51.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e7fff700 1 -- 172.21.15.149:0/3572805819 shutdown_connections 2023-06-22T16:23:51.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e7fff700 1 -- 172.21.15.149:0/3572805819 >> 172.21.15.149:0/3572805819 conn(0x7f90e8063460 msgr2=0x7f90e806da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:51.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e7fff700 1 -- 172.21.15.149:0/3572805819 shutdown_connections 2023-06-22T16:23:51.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.121+0000 7f90e7fff700 1 -- 172.21.15.149:0/3572805819 wait complete. 2023-06-22T16:23:51.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e7fff700 1 Processor -- start 2023-06-22T16:23:51.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e7fff700 1 -- start start 2023-06-22T16:23:51.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e7fff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e81607e0 0x7f90e8160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90e815e210 0x7f90e815e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e7fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90e8151980 0x7f90e8151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e7fff700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e815f8c0 con 0x7f90e815e210 2023-06-22T16:23:51.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e7fff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e815ecb0 con 0x7f90e8151980 2023-06-22T16:23:51.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e7fff700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e815ef90 con 0x7f90e81607e0 2023-06-22T16:23:51.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e67fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90e815e210 0x7f90e815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e67fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90e815e210 0x7f90e815e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33994/0 (socket says 172.21.15.149:33994) 2023-06-22T16:23:51.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e67fc700 1 -- 172.21.15.149:0/1062089424 learned_addr learned my addr 172.21.15.149:0/1062089424 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:51.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e6ffd700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e81607e0 0x7f90e8160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e77fe700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90e8151980 0x7f90e8151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e67fc700 1 -- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e81607e0 msgr2=0x7f90e8160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e67fc700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e81607e0 0x7f90e8160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e67fc700 1 -- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90e8151980 msgr2=0x7f90e8151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e67fc700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90e8151980 0x7f90e8151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e67fc700 1 -- 172.21.15.149:0/1062089424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e815f270 con 0x7f90e815e210 2023-06-22T16:23:51.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e77fe700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90e8151980 0x7f90e8151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T16:23:51.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e6ffd700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e81607e0 0x7f90e8160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T16:23:51.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e67fc700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90e815e210 0x7f90e815e680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f90d8004890 tx=0x7f90d8007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:51.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90ceffd700 1 -- 172.21.15.149:0/1062089424 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d800f8d0 con 0x7f90e815e210 2023-06-22T16:23:51.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90ceffd700 1 -- 172.21.15.149:0/1062089424 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d800fa30 con 0x7f90e815e210 2023-06-22T16:23:51.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e7fff700 1 -- 172.21.15.149:0/1062089424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e815f550 con 0x7f90e815e210 2023-06-22T16:23:51.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90ceffd700 1 -- 172.21.15.149:0/1062089424 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d800fdd0 con 0x7f90e815e210 2023-06-22T16:23:51.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.125+0000 7f90e7fff700 1 -- 172.21.15.149:0/1062089424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e814e6c0 con 0x7f90e815e210 2023-06-22T16:23:51.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.129+0000 7f90e7fff700 1 -- 172.21.15.149:0/1062089424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e815fa70 con 0x7f90e815e210 2023-06-22T16:23:51.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.129+0000 7f90ceffd700 1 -- 172.21.15.149:0/1062089424 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f90d8013600 con 0x7f90e815e210 2023-06-22T16:23:51.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.129+0000 7f90ceffd700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f90d40604b0 0x7f90d4062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.129+0000 7f90ceffd700 1 -- 172.21.15.149:0/1062089424 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f90d807c7d0 con 0x7f90e815e210 2023-06-22T16:23:51.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.129+0000 7f90e6ffd700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f90d40604b0 0x7f90d4062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.133+0000 7f90e6ffd700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f90d40604b0 0x7f90d4062960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f90e8063960 tx=0x7f90dc01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:51.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.141+0000 7f90ceffd700 1 -- 172.21.15.149:0/1062089424 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f90e815fa70 con 0x7f90e815e210 2023-06-22T16:23:51.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.301+0000 7f90e7fff700 1 -- 172.21.15.149:0/1062089424 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90e80b20b0 con 0x7f90e815e210 2023-06-22T16:23:51.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.301+0000 7f90ceffd700 1 -- 172.21.15.149:0/1062089424 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90e80b20b0 con 0x7f90e815e210 2023-06-22T16:23:51.307 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-22T16:23:51.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.301+0000 7f90e7fff700 1 -- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f90d40604b0 msgr2=0x7f90d4062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.301+0000 7f90e7fff700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f90d40604b0 0x7f90d4062960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f90e8063960 tx=0x7f90dc01a000 comp rx=0 tx=0).stop 2023-06-22T16:23:51.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.301+0000 7f90e7fff700 1 -- 172.21.15.149:0/1062089424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90e815e210 msgr2=0x7f90e815e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.301+0000 7f90e7fff700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90e815e210 0x7f90e815e680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f90d8004890 tx=0x7f90d8007a80 comp rx=0 tx=0).stop 2023-06-22T16:23:51.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.305+0000 7f90e7fff700 1 -- 172.21.15.149:0/1062089424 shutdown_connections 2023-06-22T16:23:51.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.305+0000 7f90e7fff700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90e8151980 0x7f90e8151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.305+0000 7f90e7fff700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90e815e210 0x7f90e815e680 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.305+0000 7f90e7fff700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f90d40604b0 0x7f90d4062960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.305+0000 7f90e7fff700 1 --2- 172.21.15.149:0/1062089424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90e81607e0 0x7f90e8160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.305+0000 7f90e7fff700 1 -- 172.21.15.149:0/1062089424 >> 172.21.15.149:0/1062089424 conn(0x7f90e8063460 msgr2=0x7f90e80c5120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:51.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.305+0000 7f90e7fff700 1 -- 172.21.15.149:0/1062089424 shutdown_connections 2023-06-22T16:23:51.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.305+0000 7f90e7fff700 1 -- 172.21.15.149:0/1062089424 wait complete. 2023-06-22T16:23:51.322 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T16:23:51.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.421+0000 7fa0f4b05700 1 Processor -- start 2023-06-22T16:23:51.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0f4b05700 1 -- start start 2023-06-22T16:23:51.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0f4b05700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa0f00aa950 0x7fa0f00aad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0f4b05700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f006aa90 con 0x7fa0f015b4f0 2023-06-22T16:23:51.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0f4b05700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f006a1a0 con 0x7fa0f006af20 2023-06-22T16:23:51.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0f4b05700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f006b360 con 0x7fa0f00aa950 2023-06-22T16:23:51.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0ef7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa0f00aa950 0x7fa0f00aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0eeffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa0f015b4f0 0x7fa0f00c6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57838/0 (socket says 172.21.15.149:57838) 2023-06-22T16:23:51.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0eeffd700 1 -- 172.21.15.149:0/2280666654 learned_addr learned my addr 172.21.15.149:0/2280666654 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-22T16:23:51.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0ee7fc700 1 -- 172.21.15.149:0/2280666654 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171824660 0 0) 0x7fa0f006aa90 con 0x7fa0f015b4f0 2023-06-22T16:23:51.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0ee7fc700 1 -- 172.21.15.149:0/2280666654 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0d8003570 con 0x7fa0f015b4f0 2023-06-22T16:23:51.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0ef7fe700 1 -- 172.21.15.149:0/2280666654 >> v1:172.21.15.196:6789/0 conn(0x7fa0f006af20 legacy=0x7fa0f00cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0ee7fc700 1 -- 172.21.15.149:0/2280666654 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2465531769 0 0) 0x7fa0d8003570 con 0x7fa0f015b4f0 2023-06-22T16:23:51.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0ef7fe700 1 -- 172.21.15.149:0/2280666654 >> v1:172.21.15.149:6789/0 conn(0x7fa0f015b4f0 legacy=0x7fa0f00c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0ef7fe700 1 -- 172.21.15.149:0/2280666654 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f00c6f50 con 0x7fa0f00aa950 2023-06-22T16:23:51.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0ef7fe700 1 --2- 172.21.15.149:0/2280666654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f00aa950 0x7fa0f00aad20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40098e0 tx=0x7fa0e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6770f6cab5204dd server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:51.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0ee7fc700 1 -- 172.21.15.149:0/2280666654 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0001470 con 0x7fa0f00aa950 2023-06-22T16:23:51.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0ee7fc700 1 -- 172.21.15.149:0/2280666654 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e4011420 con 0x7fa0f00aa950 2023-06-22T16:23:51.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0ee7fc700 1 -- 172.21.15.149:0/2280666654 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40117c0 con 0x7fa0f00aa950 2023-06-22T16:23:51.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2280666654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f00aa950 msgr2=0x7fa0f00aad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0f4b05700 1 --2- 172.21.15.149:0/2280666654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f00aa950 0x7fa0f00aad20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40098e0 tx=0x7fa0e40091a0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2280666654 shutdown_connections 2023-06-22T16:23:51.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0f4b05700 1 --2- 172.21.15.149:0/2280666654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f00aa950 0x7fa0f00aad20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.425+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2280666654 >> 172.21.15.149:0/2280666654 conn(0x7fa0f0067910 msgr2=0x7fa0f006c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:51.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2280666654 shutdown_connections 2023-06-22T16:23:51.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2280666654 wait complete. 2023-06-22T16:23:51.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0f4b05700 1 Processor -- start 2023-06-22T16:23:51.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0f4b05700 1 -- start start 2023-06-22T16:23:51.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0f4b05700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0f006af20 0x7fa0f014a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0f4b05700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0f00aa950 0x7fa0f014ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0f4b05700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f015b4f0 0x7fa0f00c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0f4b05700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f014a9f0 con 0x7fa0f015b4f0 2023-06-22T16:23:51.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0f4b05700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f00abc10 con 0x7fa0f006af20 2023-06-22T16:23:51.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0f4b05700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f014f010 con 0x7fa0f00aa950 2023-06-22T16:23:51.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0effff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f015b4f0 0x7fa0f00c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0effff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f015b4f0 0x7fa0f00c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34012/0 (socket says 172.21.15.149:34012) 2023-06-22T16:23:51.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0effff700 1 -- 172.21.15.149:0/2870463786 learned_addr learned my addr 172.21.15.149:0/2870463786 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:51.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0eeffd700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0f00aa950 0x7fa0f014ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0ef7fe700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0f006af20 0x7fa0f014a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0effff700 1 -- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0f00aa950 msgr2=0x7fa0f014ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0effff700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0f00aa950 0x7fa0f014ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0effff700 1 -- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0f006af20 msgr2=0x7fa0f014a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0effff700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0f006af20 0x7fa0f014a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0effff700 1 -- 172.21.15.149:0/2870463786 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e4009420 con 0x7fa0f015b4f0 2023-06-22T16:23:51.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0ef7fe700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0f006af20 0x7fa0f014a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T16:23:51.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.429+0000 7fa0effff700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f015b4f0 0x7fa0f00c4440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800cb90 tx=0x7fa0e8001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:51.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.433+0000 7fa0d77fe700 1 -- 172.21.15.149:0/2870463786 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e800a830 con 0x7fa0f015b4f0 2023-06-22T16:23:51.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.433+0000 7fa0d77fe700 1 -- 172.21.15.149:0/2870463786 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e800a990 con 0x7fa0f015b4f0 2023-06-22T16:23:51.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.433+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2870463786 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f00aad20 con 0x7fa0f015b4f0 2023-06-22T16:23:51.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.433+0000 7fa0d77fe700 1 -- 172.21.15.149:0/2870463786 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e800ad50 con 0x7fa0f015b4f0 2023-06-22T16:23:51.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.433+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2870463786 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f00ab2e0 con 0x7fa0f015b4f0 2023-06-22T16:23:51.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.433+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2870463786 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f00abdc0 con 0x7fa0f015b4f0 2023-06-22T16:23:51.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.433+0000 7fa0d77fe700 1 -- 172.21.15.149:0/2870463786 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fa0e8003030 con 0x7fa0f015b4f0 2023-06-22T16:23:51.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.433+0000 7fa0d77fe700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fa0dc0604b0 0x7fa0dc062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.433+0000 7fa0d77fe700 1 -- 172.21.15.149:0/2870463786 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa0e807c6b0 con 0x7fa0f015b4f0 2023-06-22T16:23:51.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.433+0000 7fa0ef7fe700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fa0dc0604b0 0x7fa0dc062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.437+0000 7fa0ef7fe700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fa0dc0604b0 0x7fa0dc062960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40091e0 tx=0x7fa0e4017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:51.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.441+0000 7fa0d77fe700 1 -- 172.21.15.149:0/2870463786 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fa0f00abdc0 con 0x7fa0f015b4f0 2023-06-22T16:23:51.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.605+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2870463786 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa0f00abd80 con 0x7fa0f015b4f0 2023-06-22T16:23:51.614 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.609+0000 7fa0d77fe700 1 -- 172.21.15.149:0/2870463786 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0e804cf50 con 0x7fa0f015b4f0 2023-06-22T16:23:51.614 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-22T16:23:51.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.609+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fa0dc0604b0 msgr2=0x7fa0dc062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.609+0000 7fa0f4b05700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fa0dc0604b0 0x7fa0dc062960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40091e0 tx=0x7fa0e4017000 comp rx=0 tx=0).stop 2023-06-22T16:23:51.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.609+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2870463786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f015b4f0 msgr2=0x7fa0f00c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.609+0000 7fa0f4b05700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f015b4f0 0x7fa0f00c4440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800cb90 tx=0x7fa0e8001820 comp rx=0 tx=0).stop 2023-06-22T16:23:51.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.609+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2870463786 shutdown_connections 2023-06-22T16:23:51.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.609+0000 7fa0f4b05700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f015b4f0 0x7fa0f00c4440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.609+0000 7fa0f4b05700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fa0dc0604b0 0x7fa0dc062960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.609+0000 7fa0f4b05700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa0f00aa950 0x7fa0f014ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.609+0000 7fa0f4b05700 1 --2- 172.21.15.149:0/2870463786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0f006af20 0x7fa0f014a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.609+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2870463786 >> 172.21.15.149:0/2870463786 conn(0x7fa0f0067910 msgr2=0x7fa0f00ae650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:51.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.609+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2870463786 shutdown_connections 2023-06-22T16:23:51.618 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.609+0000 7fa0f4b05700 1 -- 172.21.15.149:0/2870463786 wait complete. 2023-06-22T16:23:51.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T16:23:51.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.725+0000 7fbad5a89700 1 Processor -- start 2023-06-22T16:23:51.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.725+0000 7fbad5a89700 1 -- start start 2023-06-22T16:23:51.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5a89700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbad00c8ee0 0x7fbad00cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5a89700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad00cce70 con 0x7fbad00acda0 2023-06-22T16:23:51.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5a89700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad00cc260 con 0x7fbad00cbd90 2023-06-22T16:23:51.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5a89700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad00cd840 con 0x7fbad00c8ee0 2023-06-22T16:23:51.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad4a87700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fbad00acda0 0x7fbad00cb680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57848/0 (socket says 172.21.15.149:57848) 2023-06-22T16:23:51.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad4a87700 1 -- 172.21.15.149:0/3053276968 learned_addr learned my addr 172.21.15.149:0/3053276968 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-22T16:23:51.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5288700 1 --2- 172.21.15.149:0/3053276968 >> v2:172.21.15.196:3300/0 conn(0x7fbad00c8ee0 0x7fbad00cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbacf7fe700 1 -- 172.21.15.149:0/3053276968 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249716950 0 0) 0x7fbad00cce70 con 0x7fbad00acda0 2023-06-22T16:23:51.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbacf7fe700 1 -- 172.21.15.149:0/3053276968 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab8003570 con 0x7fbad00acda0 2023-06-22T16:23:51.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbacf7fe700 1 -- 172.21.15.149:0/3053276968 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452075944 0 0) 0x7fbad00cc260 con 0x7fbad00cbd90 2023-06-22T16:23:51.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbacf7fe700 1 -- 172.21.15.149:0/3053276968 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbad00cce70 con 0x7fbad00cbd90 2023-06-22T16:23:51.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5288700 1 -- 172.21.15.149:0/3053276968 >> v1:172.21.15.196:6789/0 conn(0x7fbad00cbd90 legacy=0x7fbad00c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbacf7fe700 1 -- 172.21.15.149:0/3053276968 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 216856916 0 0) 0x7fbab8003570 con 0x7fbad00acda0 2023-06-22T16:23:51.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5288700 1 -- 172.21.15.149:0/3053276968 >> v1:172.21.15.149:6789/0 conn(0x7fbad00acda0 legacy=0x7fbad00cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5288700 1 -- 172.21.15.149:0/3053276968 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad00cc540 con 0x7fbad00c8ee0 2023-06-22T16:23:51.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5288700 1 --2- 172.21.15.149:0/3053276968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbad00c8ee0 0x7fbad00cd300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009e60 tx=0x7fbac8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c384f89e0fac10b7 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:51.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbacf7fe700 1 -- 172.21.15.149:0/3053276968 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac800e070 con 0x7fbad00c8ee0 2023-06-22T16:23:51.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbacf7fe700 1 -- 172.21.15.149:0/3053276968 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac800b7a0 con 0x7fbad00c8ee0 2023-06-22T16:23:51.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbacf7fe700 1 -- 172.21.15.149:0/3053276968 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4001470 con 0x7fbad00c8ee0 2023-06-22T16:23:51.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5a89700 1 -- 172.21.15.149:0/3053276968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbad00c8ee0 msgr2=0x7fbad00cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5a89700 1 --2- 172.21.15.149:0/3053276968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbad00c8ee0 0x7fbad00cd300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009e60 tx=0x7fbac8009780 comp rx=0 tx=0).stop 2023-06-22T16:23:51.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5a89700 1 -- 172.21.15.149:0/3053276968 shutdown_connections 2023-06-22T16:23:51.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5a89700 1 --2- 172.21.15.149:0/3053276968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbad00c8ee0 0x7fbad00cd300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5a89700 1 -- 172.21.15.149:0/3053276968 >> 172.21.15.149:0/3053276968 conn(0x7fbad0068b80 msgr2=0x7fbad00cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:51.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5a89700 1 -- 172.21.15.149:0/3053276968 shutdown_connections 2023-06-22T16:23:51.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.729+0000 7fbad5a89700 1 -- 172.21.15.149:0/3053276968 wait complete. 2023-06-22T16:23:51.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad5a89700 1 Processor -- start 2023-06-22T16:23:51.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad5a89700 1 -- start start 2023-06-22T16:23:51.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad5a89700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbad00acda0 0x7fbad0152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad5a89700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbad00c8ee0 0x7fbad00b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad5a89700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbad00cbd90 0x7fbad0164030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad5a89700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad0166bd0 con 0x7fbad00acda0 2023-06-22T16:23:51.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad5a89700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00b2ed0 con 0x7fbad00c8ee0 2023-06-22T16:23:51.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad5a89700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad0166e70 con 0x7fbad00cbd90 2023-06-22T16:23:51.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad4a87700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbad00acda0 0x7fbad0152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad4a87700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbad00acda0 0x7fbad0152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34028/0 (socket says 172.21.15.149:34028) 2023-06-22T16:23:51.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad4a87700 1 -- 172.21.15.149:0/239383406 learned_addr learned my addr 172.21.15.149:0/239383406 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:51.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad5288700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbad00cbd90 0x7fbad0164030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbacffff700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbad00c8ee0 0x7fbad00b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad4a87700 1 -- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbad00cbd90 msgr2=0x7fbad0164030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad4a87700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbad00cbd90 0x7fbad0164030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad4a87700 1 -- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbad00c8ee0 msgr2=0x7fbad00b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad4a87700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbad00c8ee0 0x7fbad00b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad4a87700 1 -- 172.21.15.149:0/239383406 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac8009a20 con 0x7fbad00acda0 2023-06-22T16:23:51.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad4a87700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbad00acda0 0x7fbad0152280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbac400cb60 tx=0x7fbac4001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:51.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbaccff9700 1 -- 172.21.15.149:0/239383406 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4007e90 con 0x7fbad00acda0 2023-06-22T16:23:51.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad5a89700 1 -- 172.21.15.149:0/239383406 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad0152960 con 0x7fbad00acda0 2023-06-22T16:23:51.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbaccff9700 1 -- 172.21.15.149:0/239383406 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac400ce70 con 0x7fbad00acda0 2023-06-22T16:23:51.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbaccff9700 1 -- 172.21.15.149:0/239383406 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac40075b0 con 0x7fbad00acda0 2023-06-22T16:23:51.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.733+0000 7fbad5a89700 1 -- 172.21.15.149:0/239383406 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad0152f20 con 0x7fbad00acda0 2023-06-22T16:23:51.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.737+0000 7fbad5a89700 1 -- 172.21.15.149:0/239383406 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad006ade0 con 0x7fbad00acda0 2023-06-22T16:23:51.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.737+0000 7fbaccff9700 1 -- 172.21.15.149:0/239383406 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fbac4004a40 con 0x7fbad00acda0 2023-06-22T16:23:51.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.737+0000 7fbaccff9700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fbabc0604e0 0x7fbabc062990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:51.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.737+0000 7fbaccff9700 1 -- 172.21.15.149:0/239383406 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fbac407bbc0 con 0x7fbad00acda0 2023-06-22T16:23:51.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.737+0000 7fbacffff700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fbabc0604e0 0x7fbabc062990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:51.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.737+0000 7fbacffff700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fbabc0604e0 0x7fbabc062990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbad00b0030 tx=0x7fbac0007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:51.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.745+0000 7fbaccff9700 1 -- 172.21.15.149:0/239383406 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fbac404c440 con 0x7fbad00acda0 2023-06-22T16:23:51.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.945+0000 7fbad5a89700 1 -- 172.21.15.149:0/239383406 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbad004b3f0 con 0x7fbad00acda0 2023-06-22T16:23:51.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.945+0000 7fbaccff9700 1 -- 172.21.15.149:0/239383406 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3532 (secure 0 0 0) 0x7fbac4018de0 con 0x7fbad00acda0 2023-06-22T16:23:51.951 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:23:51.951 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/4010841787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":4010841787},{"type":"v1","addr":"172.21.15.196:6837","nonce":4010841787}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4315,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1083337453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1083337453},{"type":"v1","addr":"172.21.15.149:6835","nonce":1083337453}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":54149,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/917936372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":917936372},{"type":"v1","addr":"172.21.15.149:6833","nonce":917936372}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":54152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/700940480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":700940480},{"type":"v1","addr":"172.21.15.196:6835","nonce":700940480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-22T16:23:51.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.945+0000 7fbad5a89700 1 -- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fbabc0604e0 msgr2=0x7fbabc062990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.945+0000 7fbad5a89700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fbabc0604e0 0x7fbabc062990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbad00b0030 tx=0x7fbac0007d50 comp rx=0 tx=0).stop 2023-06-22T16:23:51.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.945+0000 7fbad5a89700 1 -- 172.21.15.149:0/239383406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbad00acda0 msgr2=0x7fbad0152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:51.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.945+0000 7fbad5a89700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbad00acda0 0x7fbad0152280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbac400cb60 tx=0x7fbac4001ad0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.945+0000 7fbad5a89700 1 -- 172.21.15.149:0/239383406 shutdown_connections 2023-06-22T16:23:51.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.945+0000 7fbad5a89700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fbabc0604e0 0x7fbabc062990 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.945+0000 7fbad5a89700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbad00cbd90 0x7fbad0164030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.945+0000 7fbad5a89700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbad00c8ee0 0x7fbad00b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.945+0000 7fbad5a89700 1 --2- 172.21.15.149:0/239383406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbad00acda0 0x7fbad0152280 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:51.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.949+0000 7fbad5a89700 1 -- 172.21.15.149:0/239383406 >> 172.21.15.149:0/239383406 conn(0x7fbad0068b80 msgr2=0x7fbad0155810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:51.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.949+0000 7fbad5a89700 1 -- 172.21.15.149:0/239383406 shutdown_connections 2023-06-22T16:23:51.955 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:51.949+0000 7fbad5a89700 1 -- 172.21.15.149:0/239383406 wait complete. 2023-06-22T16:23:51.956 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 3 2023-06-22T16:23:51.966 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T16:23:52.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.069+0000 7fbf81a17700 1 Processor -- start 2023-06-22T16:23:52.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.069+0000 7fbf81a17700 1 -- start start 2023-06-22T16:23:52.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.069+0000 7fbf81a17700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbf7c0cba10 0x7fbf7c0cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.069+0000 7fbf81a17700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c15b650 con 0x7fbf7c0caec0 2023-06-22T16:23:52.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.069+0000 7fbf81a17700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c15aa40 con 0x7fbf7c06ab80 2023-06-22T16:23:52.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.069+0000 7fbf81a17700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7c15ad20 con 0x7fbf7c0cba10 2023-06-22T16:23:52.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf80a15700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbf7c0cba10 0x7fbf7c0cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf80a15700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbf7c0cba10 0x7fbf7c0cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34030/0 (socket says 172.21.15.149:34030) 2023-06-22T16:23:52.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf80a15700 1 -- 172.21.15.149:0/962681647 learned_addr learned my addr 172.21.15.149:0/962681647 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:52.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf80a15700 1 -- 172.21.15.149:0/962681647 >> v1:172.21.15.196:6789/0 conn(0x7fbf7c06ab80 legacy=0x7fbf7c156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:52.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf80a15700 1 -- 172.21.15.149:0/962681647 >> v1:172.21.15.149:6789/0 conn(0x7fbf7c0caec0 legacy=0x7fbf7c06a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf80a15700 1 -- 172.21.15.149:0/962681647 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c15b000 con 0x7fbf7c0cba10 2023-06-22T16:23:52.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf80a15700 1 --2- 172.21.15.149:0/962681647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c0cba10 0x7fbf7c0cbde0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf780099b0 tx=0x7fbf78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434f6a459857943b server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:52.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf737fe700 1 -- 172.21.15.149:0/962681647 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7800b820 con 0x7fbf7c0cba10 2023-06-22T16:23:52.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf737fe700 1 -- 172.21.15.149:0/962681647 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7800b980 con 0x7fbf7c0cba10 2023-06-22T16:23:52.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf737fe700 1 -- 172.21.15.149:0/962681647 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7800bd20 con 0x7fbf7c0cba10 2023-06-22T16:23:52.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf81a17700 1 -- 172.21.15.149:0/962681647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c0cba10 msgr2=0x7fbf7c0cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf81a17700 1 --2- 172.21.15.149:0/962681647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c0cba10 0x7fbf7c0cbde0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf780099b0 tx=0x7fbf78009250 comp rx=0 tx=0).stop 2023-06-22T16:23:52.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf81a17700 1 -- 172.21.15.149:0/962681647 shutdown_connections 2023-06-22T16:23:52.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf81a17700 1 --2- 172.21.15.149:0/962681647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c0cba10 0x7fbf7c0cbde0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf81a17700 1 -- 172.21.15.149:0/962681647 >> 172.21.15.149:0/962681647 conn(0x7fbf7c062990 msgr2=0x7fbf7c062d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:52.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf81a17700 1 -- 172.21.15.149:0/962681647 shutdown_connections 2023-06-22T16:23:52.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf81a17700 1 -- 172.21.15.149:0/962681647 wait complete. 2023-06-22T16:23:52.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf81a17700 1 Processor -- start 2023-06-22T16:23:52.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.073+0000 7fbf81a17700 1 -- start start 2023-06-22T16:23:52.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf81a17700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf7c06ab80 0x7fbf7c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf81a17700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c0caec0 0x7fbf7c14f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf81a17700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf7c0cba10 0x7fbf7c16cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf81a17700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c169880 con 0x7fbf7c0caec0 2023-06-22T16:23:52.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf81a17700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c16d6a0 con 0x7fbf7c06ab80 2023-06-22T16:23:52.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf81a17700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c158df0 con 0x7fbf7c0cba10 2023-06-22T16:23:52.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf73fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c0caec0 0x7fbf7c14f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf73fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c0caec0 0x7fbf7c14f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34034/0 (socket says 172.21.15.149:34034) 2023-06-22T16:23:52.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf73fff700 1 -- 172.21.15.149:0/1543182643 learned_addr learned my addr 172.21.15.149:0/1543182643 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:52.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf81216700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf7c0cba10 0x7fbf7c16cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf80a15700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf7c06ab80 0x7fbf7c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf73fff700 1 -- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf7c0cba10 msgr2=0x7fbf7c16cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf73fff700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf7c0cba10 0x7fbf7c16cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf73fff700 1 -- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf7c06ab80 msgr2=0x7fbf7c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf73fff700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf7c06ab80 0x7fbf7c1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf73fff700 1 -- 172.21.15.149:0/1543182643 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780094f0 con 0x7fbf7c0caec0 2023-06-22T16:23:52.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf73fff700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c0caec0 0x7fbf7c14f3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00c790 tx=0x7fbf6c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:52.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf70ff9700 1 -- 172.21.15.149:0/1543182643 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c011590 con 0x7fbf7c0caec0 2023-06-22T16:23:52.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf70ff9700 1 -- 172.21.15.149:0/1543182643 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6c011710 con 0x7fbf7c0caec0 2023-06-22T16:23:52.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf81a17700 1 -- 172.21.15.149:0/1543182643 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf7c1590d0 con 0x7fbf7c0caec0 2023-06-22T16:23:52.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf70ff9700 1 -- 172.21.15.149:0/1543182643 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c011ad0 con 0x7fbf7c0caec0 2023-06-22T16:23:52.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.077+0000 7fbf81a17700 1 -- 172.21.15.149:0/1543182643 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7c14f910 con 0x7fbf7c0caec0 2023-06-22T16:23:52.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.081+0000 7fbf81a17700 1 -- 172.21.15.149:0/1543182643 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7c069800 con 0x7fbf7c0caec0 2023-06-22T16:23:52.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.081+0000 7fbf70ff9700 1 -- 172.21.15.149:0/1543182643 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fbf6c01b3b0 con 0x7fbf7c0caec0 2023-06-22T16:23:52.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.081+0000 7fbf70ff9700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fbf680604b0 0x7fbf68062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.081+0000 7fbf70ff9700 1 -- 172.21.15.149:0/1543182643 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fbf6c07b970 con 0x7fbf7c0caec0 2023-06-22T16:23:52.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.081+0000 7fbf80a15700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fbf680604b0 0x7fbf68062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.081+0000 7fbf80a15700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fbf680604b0 0x7fbf68062960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbf780099b0 tx=0x7fbf78016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:52.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.089+0000 7fbf70ff9700 1 -- 172.21.15.149:0/1543182643 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fbf6c04c170 con 0x7fbf7c0caec0 2023-06-22T16:23:52.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.249+0000 7fbf81a17700 1 -- 172.21.15.149:0/1543182643 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf7c15b2e0 con 0x7fbf7c0caec0 2023-06-22T16:23:52.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.253+0000 7fbf70ff9700 1 -- 172.21.15.149:0/1543182643 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+13695 (secure 0 0 0) 0x7fbf6c017070 con 0x7fbf7c0caec0 2023-06-22T16:23:52.259 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:23:52.259 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":22,"fsid":"0dba7f42-2446-45e3-aae5-b3ca874cf325","created":"2023-06-22T16:23:31.621362+0000","modified":"2023-06-22T16:23:51.686152+0000","last_up_change":"2023-06-22T16:23:42.614261+0000","last_in_change":"2023-06-22T16:23:33.638142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T16:23:43.865433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T16:23:49.572200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"56ddaf00-fc77-44cf-b823-5bd377b92576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":32836},{"type":"v1","addr":"172.21.15.149:6809","nonce":32836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":32836},{"type":"v1","addr":"172.21.15.149:6811","nonce":32836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":32836},{"type":"v1","addr":"172.21.15.149:6816","nonce":32836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":32836},{"type":"v1","addr":"172.21.15.149:6813","nonce":32836}]},"public_addr":"172.21.15.149:6809/32836","cluster_addr":"172.21.15.149:6811/32836","heartbeat_back_addr":"172.21.15.149:6816/32836","heartbeat_front_addr":"172.21.15.149:6813/32836","state":["exists","up"]},{"osd":1,"uuid":"532f10bd-8b84-4a0b-9aed-28e7afb4a863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":32835},{"type":"v1","addr":"172.21.15.149:6817","nonce":32835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":32835},{"type":"v1","addr":"172.21.15.149:6819","nonce":32835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":32835},{"type":"v1","addr":"172.21.15.149:6823","nonce":32835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":32835},{"type":"v1","addr":"172.21.15.149:6821","nonce":32835}]},"public_addr":"172.21.15.149:6817/32835","cluster_addr":"172.21.15.149:6819/32835","heartbeat_back_addr":"172.21.15.149:6823/32835","heartbeat_front_addr":"172.21.15.149:6821/32835","state":["exists","up"]},{"osd":2,"uuid":"bc3c458c-c810-4c5a-b258-2de1cb3ca1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":32837},{"type":"v1","addr":"172.21.15.149:6825","nonce":32837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":32837},{"type":"v1","addr":"172.21.15.149:6827","nonce":32837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":32837},{"type":"v1","addr":"172.21.15.149:6831","nonce":32837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":32837},{"type":"v1","addr":"172.21.15.149:6829","nonce":32837}]},"public_addr":"172.21.15.149:6825/32837","cluster_addr":"172.21.15.149:6827/32837","heartbeat_back_addr":"172.21.15.149:6831/32837","heartbeat_front_addr":"172.21.15.149:6829/32837","state":["exists","up"]},{"osd":3,"uuid":"04bf7f65-1946-499c-aea9-c4caa92e8488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":32834},{"type":"v1","addr":"172.21.15.149:6801","nonce":32834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":32834},{"type":"v1","addr":"172.21.15.149:6803","nonce":32834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":32834},{"type":"v1","addr":"172.21.15.149:6807","nonce":32834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":32834},{"type":"v1","addr":"172.21.15.149:6805","nonce":32834}]},"public_addr":"172.21.15.149:6801/32834","cluster_addr":"172.21.15.149:6803/32834","heartbeat_back_addr":"172.21.15.149:6807/32834","heartbeat_front_addr":"172.21.15.149:6805/32834","state":["exists","up"]},{"osd":4,"uuid":"e49f385d-76d9-4304-8486-3e1f3cb8fd23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":33055},{"type":"v1","addr":"172.21.15.196:6809","nonce":33055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":33055},{"type":"v1","addr":"172.21.15.196:6811","nonce":33055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":33055},{"type":"v1","addr":"172.21.15.196:6815","nonce":33055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":33055},{"type":"v1","addr":"172.21.15.196:6813","nonce":33055}]},"public_addr":"172.21.15.196:6809/33055","cluster_addr":"172.21.15.196:6811/33055","heartbeat_back_addr":"172.21.15.196:6815/33055","heartbeat_front_addr":"172.21.15.196:6813/33055","state":["exists","up"]},{"osd":5,"uuid":"671a4069-7c86-4a14-825c-1179a74928c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":33057},{"type":"v1","addr":"172.21.15.196:6825","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":33057},{"type":"v1","addr":"172.21.15.196:6827","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":33057},{"type":"v1","addr":"172.21.15.196:6831","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":33057},{"type":"v1","addr":"172.21.15.196:6829","nonce":33057}]},"public_addr":"172.21.15.196:6825/33057","cluster_addr":"172.21.15.196:6827/33057","heartbeat_back_addr":"172.21.15.196:6831/33057","heartbeat_front_addr":"172.21.15.196:6829/33057","state":["exists","up"]},{"osd":6,"uuid":"7114b0c3-27fe-4816-8cc8-fb3679b8e707","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":33054},{"type":"v1","addr":"172.21.15.196:6801","nonce":33054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":33054},{"type":"v1","addr":"172.21.15.196:6803","nonce":33054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":33054},{"type":"v1","addr":"172.21.15.196:6807","nonce":33054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":33054},{"type":"v1","addr":"172.21.15.196:6805","nonce":33054}]},"public_addr":"172.21.15.196:6801/33054","cluster_addr":"172.21.15.196:6803/33054","heartbeat_back_addr":"172.21.15.196:6807/33054","heartbeat_front_addr":"172.21.15.196:6805/33054","state":["exists","up"]},{"osd":7,"uuid":"f9e6e633-0952-40bf-97e6-7c8b0bc804bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":33058},{"type":"v1","addr":"172.21.15.196:6817","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":33058},{"type":"v1","addr":"172.21.15.196:6819","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":33058},{"type":"v1","addr":"172.21.15.196:6823","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":33058},{"type":"v1","addr":"172.21.15.196:6821","nonce":33058}]},"public_addr":"172.21.15.196:6817/33058","cluster_addr":"172.21.15.196:6819/33058","heartbeat_back_addr":"172.21.15.196:6823/33058","heartbeat_front_addr":"172.21.15.196:6821/33058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.838753+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.877504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.932235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.898286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.697196+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:39.163122+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.820624+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.902436+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T16:23:52.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.253+0000 7fbf81a17700 1 -- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fbf680604b0 msgr2=0x7fbf68062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.253+0000 7fbf81a17700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fbf680604b0 0x7fbf68062960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbf780099b0 tx=0x7fbf78016000 comp rx=0 tx=0).stop 2023-06-22T16:23:52.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.253+0000 7fbf81a17700 1 -- 172.21.15.149:0/1543182643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c0caec0 msgr2=0x7fbf7c14f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.253+0000 7fbf81a17700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c0caec0 0x7fbf7c14f3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00c790 tx=0x7fbf6c007f40 comp rx=0 tx=0).stop 2023-06-22T16:23:52.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.253+0000 7fbf81a17700 1 -- 172.21.15.149:0/1543182643 shutdown_connections 2023-06-22T16:23:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.253+0000 7fbf81a17700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fbf680604b0 0x7fbf68062960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.253+0000 7fbf81a17700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf7c0cba10 0x7fbf7c16cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.253+0000 7fbf81a17700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c0caec0 0x7fbf7c14f3d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.253+0000 7fbf81a17700 1 --2- 172.21.15.149:0/1543182643 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf7c06ab80 0x7fbf7c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.253+0000 7fbf81a17700 1 -- 172.21.15.149:0/1543182643 >> 172.21.15.149:0/1543182643 conn(0x7fbf7c062990 msgr2=0x7fbf7c1559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.253+0000 7fbf81a17700 1 -- 172.21.15.149:0/1543182643 shutdown_connections 2023-06-22T16:23:52.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.253+0000 7fbf81a17700 1 -- 172.21.15.149:0/1543182643 wait complete. 2023-06-22T16:23:52.273 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T16:23:43.865433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T16:23:49.572200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-06-22T16:23:52.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T16:23:52.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.385+0000 7fe91359e700 1 Processor -- start 2023-06-22T16:23:52.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.385+0000 7fe91359e700 1 -- start start 2023-06-22T16:23:52.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.385+0000 7fe91359e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe9140cc970 0x7fe9140ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.385+0000 7fe91359e700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9140cad90 0x7fe9140cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe914158940 0x7fe914158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9140cf310 con 0x7fe9140cc970 2023-06-22T16:23:52.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe914159300 con 0x7fe914158940 2023-06-22T16:23:52.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9140ce700 con 0x7fe9140cad90 2023-06-22T16:23:52.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91259c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe9140cc970 0x7fe9140ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91259c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe9140cc970 0x7fe9140ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34036/0 (socket says 172.21.15.149:34036) 2023-06-22T16:23:52.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91259c700 1 -- 172.21.15.149:0/296211526 learned_addr learned my addr 172.21.15.149:0/296211526 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:52.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe911d9b700 1 --2- 172.21.15.149:0/296211526 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9140cad90 0x7fe9140cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe912d9d700 1 --2- 172.21.15.149:0/296211526 >> v2:172.21.15.196:3300/0 conn(0x7fe914158940 0x7fe914158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91259c700 1 -- 172.21.15.149:0/296211526 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9140cad90 msgr2=0x7fe9140cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:52.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91259c700 1 --2- 172.21.15.149:0/296211526 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9140cad90 0x7fe9140cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91259c700 1 -- 172.21.15.149:0/296211526 >> v2:172.21.15.196:3300/0 conn(0x7fe914158940 msgr2=0x7fe914158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:52.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91259c700 1 --2- 172.21.15.149:0/296211526 >> v2:172.21.15.196:3300/0 conn(0x7fe914158940 0x7fe914158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91259c700 1 -- 172.21.15.149:0/296211526 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9140ce9e0 con 0x7fe9140cc970 2023-06-22T16:23:52.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91259c700 1 --2- 172.21.15.149:0/296211526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9140cc970 0x7fe9140ccd40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe914088f50 tx=0x7fe8fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442f294e57c62715 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:52.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91159a700 1 -- 172.21.15.149:0/296211526 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00b640 con 0x7fe9140cc970 2023-06-22T16:23:52.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91159a700 1 -- 172.21.15.149:0/296211526 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc00b7a0 con 0x7fe9140cc970 2023-06-22T16:23:52.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91159a700 1 -- 172.21.15.149:0/296211526 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00bb60 con 0x7fe9140cc970 2023-06-22T16:23:52.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 -- 172.21.15.149:0/296211526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9140cc970 msgr2=0x7fe9140ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 --2- 172.21.15.149:0/296211526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9140cc970 0x7fe9140ccd40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe914088f50 tx=0x7fe8fc009250 comp rx=0 tx=0).stop 2023-06-22T16:23:52.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 -- 172.21.15.149:0/296211526 shutdown_connections 2023-06-22T16:23:52.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 --2- 172.21.15.149:0/296211526 >> v2:172.21.15.196:3300/0 conn(0x7fe914158940 0x7fe914158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 --2- 172.21.15.149:0/296211526 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9140cad90 0x7fe9140cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 --2- 172.21.15.149:0/296211526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9140cc970 0x7fe9140ccd40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 -- 172.21.15.149:0/296211526 >> 172.21.15.149:0/296211526 conn(0x7fe91406e500 msgr2=0x7fe914062990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:52.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 -- 172.21.15.149:0/296211526 shutdown_connections 2023-06-22T16:23:52.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 -- 172.21.15.149:0/296211526 wait complete. 2023-06-22T16:23:52.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 Processor -- start 2023-06-22T16:23:52.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.389+0000 7fe91359e700 1 -- start start 2023-06-22T16:23:52.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91359e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9140cad90 0x7fe914147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91359e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9140cc970 0x7fe9140cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91359e700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe914158940 0x7fe9140cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91359e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe914169600 con 0x7fe9140cad90 2023-06-22T16:23:52.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91359e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91416a160 con 0x7fe9140cc970 2023-06-22T16:23:52.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91359e700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9141698c0 con 0x7fe914158940 2023-06-22T16:23:52.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91259c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9140cad90 0x7fe914147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91259c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9140cad90 0x7fe914147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34050/0 (socket says 172.21.15.149:34050) 2023-06-22T16:23:52.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91259c700 1 -- 172.21.15.149:0/492748541 learned_addr learned my addr 172.21.15.149:0/492748541 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:52.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe911d9b700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9140cc970 0x7fe9140cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe912d9d700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe914158940 0x7fe9140cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91259c700 1 -- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe914158940 msgr2=0x7fe9140cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91259c700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe914158940 0x7fe9140cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91259c700 1 -- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9140cc970 msgr2=0x7fe9140cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91259c700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9140cc970 0x7fe9140cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91259c700 1 -- 172.21.15.149:0/492748541 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc0094f0 con 0x7fe9140cad90 2023-06-22T16:23:52.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91259c700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9140cad90 0x7fe914147600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc006fd0 tx=0x7fe8fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:52.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe90a7fc700 1 -- 172.21.15.149:0/492748541 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc000d10 con 0x7fe9140cad90 2023-06-22T16:23:52.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe90a7fc700 1 -- 172.21.15.149:0/492748541 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc00b910 con 0x7fe9140cad90 2023-06-22T16:23:52.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91359e700 1 -- 172.21.15.149:0/492748541 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe914169ba0 con 0x7fe9140cad90 2023-06-22T16:23:52.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe90a7fc700 1 -- 172.21.15.149:0/492748541 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc026430 con 0x7fe9140cad90 2023-06-22T16:23:52.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91359e700 1 -- 172.21.15.149:0/492748541 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe914169210 con 0x7fe9140cad90 2023-06-22T16:23:52.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe90a7fc700 1 -- 172.21.15.149:0/492748541 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fe8fc023030 con 0x7fe9140cad90 2023-06-22T16:23:52.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.393+0000 7fe91359e700 1 -- 172.21.15.149:0/492748541 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9141693a0 con 0x7fe9140cad90 2023-06-22T16:23:52.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.397+0000 7fe90a7fc700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fe8f40604b0 0x7fe8f4062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.397+0000 7fe90a7fc700 1 -- 172.21.15.149:0/492748541 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe8fc07dc00 con 0x7fe9140cad90 2023-06-22T16:23:52.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.397+0000 7fe911d9b700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fe8f40604b0 0x7fe8f4062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.397+0000 7fe911d9b700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fe8f40604b0 0x7fe8f4062960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe914157380 tx=0x7fe9040091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:52.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.401+0000 7fe90a7fc700 1 -- 172.21.15.149:0/492748541 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fe8fc084080 con 0x7fe9140cad90 2023-06-22T16:23:52.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.561+0000 7fe91359e700 1 -- 172.21.15.149:0/492748541 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9140cecc0 con 0x7fe9140cad90 2023-06-22T16:23:52.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.561+0000 7fe90a7fc700 1 -- 172.21.15.149:0/492748541 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8fc04e520 con 0x7fe9140cad90 2023-06-22T16:23:52.569 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-22T16:23:52.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.565+0000 7fe91359e700 1 -- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fe8f40604b0 msgr2=0x7fe8f4062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.565+0000 7fe91359e700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fe8f40604b0 0x7fe8f4062960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe914157380 tx=0x7fe9040091a0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.565+0000 7fe91359e700 1 -- 172.21.15.149:0/492748541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9140cad90 msgr2=0x7fe914147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.565+0000 7fe91359e700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9140cad90 0x7fe914147600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc006fd0 tx=0x7fe8fc017000 comp rx=0 tx=0).stop 2023-06-22T16:23:52.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.565+0000 7fe91359e700 1 -- 172.21.15.149:0/492748541 shutdown_connections 2023-06-22T16:23:52.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.565+0000 7fe91359e700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fe8f40604b0 0x7fe8f4062960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.565+0000 7fe91359e700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe914158940 0x7fe9140cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.565+0000 7fe91359e700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9140cc970 0x7fe9140cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.565+0000 7fe91359e700 1 --2- 172.21.15.149:0/492748541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9140cad90 0x7fe914147600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.565+0000 7fe91359e700 1 -- 172.21.15.149:0/492748541 >> 172.21.15.149:0/492748541 conn(0x7fe91406e500 msgr2=0x7fe914154270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:52.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.565+0000 7fe91359e700 1 -- 172.21.15.149:0/492748541 shutdown_connections 2023-06-22T16:23:52.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.565+0000 7fe91359e700 1 -- 172.21.15.149:0/492748541 wait complete. 2023-06-22T16:23:52.582 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T16:23:52.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.689+0000 7f117e72a700 1 Processor -- start 2023-06-22T16:23:52.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.689+0000 7f117e72a700 1 -- start start 2023-06-22T16:23:52.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.689+0000 7f117e72a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117806bd50 0x7f117815a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.689+0000 7f117e72a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117815b660 con 0x7f11780b1a90 2023-06-22T16:23:52.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.689+0000 7f117e72a700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1178158150 con 0x7f11780abe20 2023-06-22T16:23:52.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.689+0000 7f117e72a700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117815b0a0 con 0x7f117806bd50 2023-06-22T16:23:52.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117df29700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f11780b1a90 0x7f11780672a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57858/0 (socket says 172.21.15.149:57858) 2023-06-22T16:23:52.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117df29700 1 -- 172.21.15.149:0/1492831861 learned_addr learned my addr 172.21.15.149:0/1492831861 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-22T16:23:52.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117cf27700 1 --2- 172.21.15.149:0/1492831861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117806bd50 0x7f117815a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f116ffff700 1 -- 172.21.15.149:0/1492831861 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443627465 0 0) 0x7f117815b660 con 0x7f11780b1a90 2023-06-22T16:23:52.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f116ffff700 1 -- 172.21.15.149:0/1492831861 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1164003570 con 0x7f11780b1a90 2023-06-22T16:23:52.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f116ffff700 1 -- 172.21.15.149:0/1492831861 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308391934 0 0) 0x7f1178158150 con 0x7f11780abe20 2023-06-22T16:23:52.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117cf27700 1 -- 172.21.15.149:0/1492831861 >> v1:172.21.15.196:6789/0 conn(0x7f11780abe20 legacy=0x7f1178157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117cf27700 1 -- 172.21.15.149:0/1492831861 >> v1:172.21.15.149:6789/0 conn(0x7f11780b1a90 legacy=0x7f11780672a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117cf27700 1 -- 172.21.15.149:0/1492831861 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117815b380 con 0x7f117806bd50 2023-06-22T16:23:52.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117cf27700 1 --2- 172.21.15.149:0/1492831861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117806bd50 0x7f117815a730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1174009910 tx=0x7f11740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b8273043492f7dc server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:52.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f116ffff700 1 -- 172.21.15.149:0/1492831861 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117400b680 con 0x7f117806bd50 2023-06-22T16:23:52.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f116ffff700 1 -- 172.21.15.149:0/1492831861 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117400b7e0 con 0x7f117806bd50 2023-06-22T16:23:52.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f116ffff700 1 -- 172.21.15.149:0/1492831861 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117400bba0 con 0x7f117806bd50 2023-06-22T16:23:52.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117e72a700 1 -- 172.21.15.149:0/1492831861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117806bd50 msgr2=0x7f117815a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117e72a700 1 --2- 172.21.15.149:0/1492831861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117806bd50 0x7f117815a730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1174009910 tx=0x7f11740091a0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117e72a700 1 -- 172.21.15.149:0/1492831861 shutdown_connections 2023-06-22T16:23:52.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117e72a700 1 --2- 172.21.15.149:0/1492831861 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117806bd50 0x7f117815a730 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117e72a700 1 -- 172.21.15.149:0/1492831861 >> 172.21.15.149:0/1492831861 conn(0x7f117806df10 msgr2=0x7f117806b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:52.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117e72a700 1 -- 172.21.15.149:0/1492831861 shutdown_connections 2023-06-22T16:23:52.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.693+0000 7f117e72a700 1 -- 172.21.15.149:0/1492831861 wait complete. 2023-06-22T16:23:52.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117e72a700 1 Processor -- start 2023-06-22T16:23:52.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117e72a700 1 -- start start 2023-06-22T16:23:52.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117e72a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117806bd50 0x7f1178152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117e72a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11780abe20 0x7f11780a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117e72a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11780b1a90 0x7f11781675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117e72a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1178151f30 con 0x7f11780b1a90 2023-06-22T16:23:52.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117e72a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1178152210 con 0x7f11780abe20 2023-06-22T16:23:52.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117e72a700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11781524f0 con 0x7f117806bd50 2023-06-22T16:23:52.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117df29700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11780b1a90 0x7f11781675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117d728700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117806bd50 0x7f1178152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117df29700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11780b1a90 0x7f11781675a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34064/0 (socket says 172.21.15.149:34064) 2023-06-22T16:23:52.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117d728700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117806bd50 0x7f1178152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.149:55462/0 (socket says 172.21.15.149:55462) 2023-06-22T16:23:52.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117df29700 1 -- 172.21.15.149:0/3726832357 learned_addr learned my addr 172.21.15.149:0/3726832357 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:52.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.697+0000 7f117cf27700 1 --2- 172.21.15.149:0/3726832357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11780abe20 0x7f11780a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f117df29700 1 -- 172.21.15.149:0/3726832357 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117806bd50 msgr2=0x7f1178152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f117df29700 1 --2- 172.21.15.149:0/3726832357 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117806bd50 0x7f1178152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f117df29700 1 -- 172.21.15.149:0/3726832357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11780abe20 msgr2=0x7f11780a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f117df29700 1 --2- 172.21.15.149:0/3726832357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11780abe20 0x7f11780a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f117df29700 1 -- 172.21.15.149:0/3726832357 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1174009420 con 0x7f11780b1a90 2023-06-22T16:23:52.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f117df29700 1 --2- 172.21.15.149:0/3726832357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11780b1a90 0x7f11781675a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1170001460 tx=0x7f1170001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:52.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f116d7fa700 1 -- 172.21.15.149:0/3726832357 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000a870 con 0x7f11780b1a90 2023-06-22T16:23:52.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f116d7fa700 1 -- 172.21.15.149:0/3726832357 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117000a9d0 con 0x7f11780b1a90 2023-06-22T16:23:52.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f117e72a700 1 -- 172.21.15.149:0/3726832357 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11781527d0 con 0x7f11780b1a90 2023-06-22T16:23:52.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f116d7fa700 1 -- 172.21.15.149:0/3726832357 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000ad50 con 0x7f11780b1a90 2023-06-22T16:23:52.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f117e72a700 1 -- 172.21.15.149:0/3726832357 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11780a5270 con 0x7f11780b1a90 2023-06-22T16:23:52.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f117e72a700 1 -- 172.21.15.149:0/3726832357 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1178152cd0 con 0x7f11780b1a90 2023-06-22T16:23:52.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f116d7fa700 1 -- 172.21.15.149:0/3726832357 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f1170007300 con 0x7f11780b1a90 2023-06-22T16:23:52.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f116d7fa700 1 --2- 172.21.15.149:0/3726832357 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f115c0604b0 0x7f115c062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:52.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.701+0000 7f116d7fa700 1 -- 172.21.15.149:0/3726832357 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f117007c840 con 0x7f11780b1a90 2023-06-22T16:23:52.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.705+0000 7f117d728700 1 --2- 172.21.15.149:0/3726832357 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f115c0604b0 0x7f115c062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:52.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.705+0000 7f117d728700 1 --2- 172.21.15.149:0/3726832357 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f115c0604b0 0x7f115c062960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1168003a40 tx=0x7f1168007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:52.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.709+0000 7f116d7fa700 1 -- 172.21.15.149:0/3726832357 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f117004d0d0 con 0x7f11780b1a90 2023-06-22T16:23:52.783 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:23:52.785 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:23:52.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.865+0000 7f117e72a700 1 -- 172.21.15.149:0/3726832357 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f11780c9c80 con 0x7f11780b1a90 2023-06-22T16:23:52.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.869+0000 7f116d7fa700 1 -- 172.21.15.149:0/3726832357 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f11700506f0 con 0x7f11780b1a90 2023-06-22T16:23:52.874 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-22T16:23:52.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.869+0000 7f117e72a700 1 -- 172.21.15.149:0/3726832357 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f115c0604b0 msgr2=0x7f115c062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.869+0000 7f117e72a700 1 --2- 172.21.15.149:0/3726832357 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f115c0604b0 0x7f115c062960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1168003a40 tx=0x7f1168007ec0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.869+0000 7f117e72a700 1 -- 172.21.15.149:0/3726832357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11780b1a90 msgr2=0x7f11781675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:52.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.869+0000 7f117e72a700 1 --2- 172.21.15.149:0/3726832357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11780b1a90 0x7f11781675a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1170001460 tx=0x7f1170001a40 comp rx=0 tx=0).stop 2023-06-22T16:23:52.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.869+0000 7f117e72a700 1 -- 172.21.15.149:0/3726832357 shutdown_connections 2023-06-22T16:23:52.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.869+0000 7f117e72a700 1 --2- 172.21.15.149:0/3726832357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11780b1a90 0x7f11781675a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.869+0000 7f117e72a700 1 --2- 172.21.15.149:0/3726832357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11780abe20 0x7f11780a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.869+0000 7f117e72a700 1 --2- 172.21.15.149:0/3726832357 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f115c0604b0 0x7f115c062960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.869+0000 7f117e72a700 1 --2- 172.21.15.149:0/3726832357 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f117806bd50 0x7f1178152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:52.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.869+0000 7f117e72a700 1 -- 172.21.15.149:0/3726832357 >> 172.21.15.149:0/3726832357 conn(0x7f117806df10 msgr2=0x7f11780c93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:52.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.869+0000 7f117e72a700 1 -- 172.21.15.149:0/3726832357 shutdown_connections 2023-06-22T16:23:52.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.869+0000 7f117e72a700 1 -- 172.21.15.149:0/3726832357 wait complete. 2023-06-22T16:23:52.888 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-22T16:23:52.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb77a333700 1 Processor -- start 2023-06-22T16:23:53.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb77a333700 1 -- start start 2023-06-22T16:23:53.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb77a333700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7740cba10 0x7fb7740cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb77a333700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb77406ab80 0x7fb774156540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb77a333700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77415b650 con 0x7fb7740caec0 2023-06-22T16:23:53.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb77a333700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77415aa40 con 0x7fb77406ab80 2023-06-22T16:23:53.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb77a333700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77415ad20 con 0x7fb7740cba10 2023-06-22T16:23:53.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb779b32700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb77406ab80 0x7fb774156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb779b32700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb77406ab80 0x7fb774156540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34076/0 (socket says 172.21.15.149:34076) 2023-06-22T16:23:53.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb779b32700 1 -- 172.21.15.149:0/32169394 learned_addr learned my addr 172.21.15.149:0/32169394 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:53.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb779331700 1 --2- 172.21.15.149:0/32169394 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7740cba10 0x7fb7740cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb779b32700 1 -- 172.21.15.149:0/32169394 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7740cba10 msgr2=0x7fb7740cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb779b32700 1 --2- 172.21.15.149:0/32169394 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7740cba10 0x7fb7740cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb779b32700 1 -- 172.21.15.149:0/32169394 >> v1:172.21.15.196:6789/0 conn(0x7fb7740caec0 legacy=0x7fb77406a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb779b32700 1 -- 172.21.15.149:0/32169394 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77415b000 con 0x7fb77406ab80 2023-06-22T16:23:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb779b32700 1 --2- 172.21.15.149:0/32169394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb77406ab80 0x7fb774156540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0099b0 tx=0x7fb76c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee49cb54a464ca7c server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb773fff700 1 -- 172.21.15.149:0/32169394 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00b860 con 0x7fb77406ab80 2023-06-22T16:23:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb773fff700 1 -- 172.21.15.149:0/32169394 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c00b9c0 con 0x7fb77406ab80 2023-06-22T16:23:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.993+0000 7fb773fff700 1 -- 172.21.15.149:0/32169394 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00bd60 con 0x7fb77406ab80 2023-06-22T16:23:53.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 -- 172.21.15.149:0/32169394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb77406ab80 msgr2=0x7fb774156540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 --2- 172.21.15.149:0/32169394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb77406ab80 0x7fb774156540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0099b0 tx=0x7fb76c009250 comp rx=0 tx=0).stop 2023-06-22T16:23:53.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 -- 172.21.15.149:0/32169394 shutdown_connections 2023-06-22T16:23:53.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 --2- 172.21.15.149:0/32169394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb77406ab80 0x7fb774156540 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 --2- 172.21.15.149:0/32169394 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb7740cba10 0x7fb7740cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 -- 172.21.15.149:0/32169394 >> 172.21.15.149:0/32169394 conn(0x7fb774062990 msgr2=0x7fb774062d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:53.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 -- 172.21.15.149:0/32169394 shutdown_connections 2023-06-22T16:23:53.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 -- 172.21.15.149:0/32169394 wait complete. 2023-06-22T16:23:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 Processor -- start 2023-06-22T16:23:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 -- start start 2023-06-22T16:23:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77406ab80 0x7fb77414f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7740caec0 0x7fb77415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7740cba10 0x7fb774151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77415c9d0 con 0x7fb7740cba10 2023-06-22T16:23:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77415b930 con 0x7fb7740caec0 2023-06-22T16:23:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb77a333700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77415bc10 con 0x7fb77406ab80 2023-06-22T16:23:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb779b32700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7740cba10 0x7fb774151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb779b32700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7740cba10 0x7fb774151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34088/0 (socket says 172.21.15.149:34088) 2023-06-22T16:23:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb779b32700 1 -- 172.21.15.149:0/3307473480 learned_addr learned my addr 172.21.15.149:0/3307473480 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb779331700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77406ab80 0x7fb77414f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb778b30700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7740caec0 0x7fb77415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb779b32700 1 -- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77406ab80 msgr2=0x7fb77414f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb779b32700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77406ab80 0x7fb77414f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb779b32700 1 -- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7740caec0 msgr2=0x7fb77415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb779b32700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7740caec0 0x7fb77415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb779b32700 1 -- 172.21.15.149:0/3307473480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c0094f0 con 0x7fb7740cba10 2023-06-22T16:23:53.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb778b30700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7740caec0 0x7fb77415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T16:23:53.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:52.997+0000 7fb779b32700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7740cba10 0x7fb774151df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb7740681e0 tx=0x7fb76c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:53.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.001+0000 7fb7717fa700 1 -- 172.21.15.149:0/3307473480 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c01a630 con 0x7fb7740cba10 2023-06-22T16:23:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.001+0000 7fb7717fa700 1 -- 172.21.15.149:0/3307473480 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c01a7b0 con 0x7fb7740cba10 2023-06-22T16:23:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.001+0000 7fb7717fa700 1 -- 172.21.15.149:0/3307473480 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c01ab70 con 0x7fb7740cba10 2023-06-22T16:23:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.001+0000 7fb77a333700 1 -- 172.21.15.149:0/3307473480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77415bef0 con 0x7fb7740cba10 2023-06-22T16:23:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.001+0000 7fb77a333700 1 -- 172.21.15.149:0/3307473480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77415c4b0 con 0x7fb7740cba10 2023-06-22T16:23:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.001+0000 7fb77a333700 1 -- 172.21.15.149:0/3307473480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77415c6d0 con 0x7fb7740cba10 2023-06-22T16:23:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.001+0000 7fb7717fa700 1 -- 172.21.15.149:0/3307473480 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fb76c02d440 con 0x7fb7740cba10 2023-06-22T16:23:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.001+0000 7fb7717fa700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fb7600604b0 0x7fb760062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.001+0000 7fb7717fa700 1 -- 172.21.15.149:0/3307473480 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb76c07e0b0 con 0x7fb7740cba10 2023-06-22T16:23:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.005+0000 7fb779331700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fb7600604b0 0x7fb760062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.005+0000 7fb779331700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fb7600604b0 0x7fb760062960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb764006fd0 tx=0x7fb764008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:53.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.013+0000 7fb7717fa700 1 -- 172.21.15.149:0/3307473480 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fb76c04e8b0 con 0x7fb7740cba10 2023-06-22T16:23:53.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.177+0000 7fb77a333700 1 -- 172.21.15.149:0/3307473480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb77415b2e0 con 0x7fb7740cba10 2023-06-22T16:23:53.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.177+0000 7fb7717fa700 1 -- 172.21.15.149:0/3307473480 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v22) v1 ==== 84+0+126 (secure 0 0 0) 0x7fb76c051ed0 con 0x7fb7740cba10 2023-06-22T16:23:53.184 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:23:53.184 INFO:teuthology.orchestra.run.smithi149.stdout:[ 2023-06-22T16:23:53.184 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-22T16:23:53.184 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 1, 2023-06-22T16:23:53.184 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": ".mgr" 2023-06-22T16:23:53.185 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-22T16:23:53.185 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-22T16:23:53.185 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 2, 2023-06-22T16:23:53.185 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": "rbd" 2023-06-22T16:23:53.185 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-22T16:23:53.185 INFO:teuthology.orchestra.run.smithi149.stdout:] 2023-06-22T16:23:53.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.181+0000 7fb77a333700 1 -- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fb7600604b0 msgr2=0x7fb760062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.181+0000 7fb77a333700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fb7600604b0 0x7fb760062960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb764006fd0 tx=0x7fb764008040 comp rx=0 tx=0).stop 2023-06-22T16:23:53.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.181+0000 7fb77a333700 1 -- 172.21.15.149:0/3307473480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7740cba10 msgr2=0x7fb774151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.181+0000 7fb77a333700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7740cba10 0x7fb774151df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb7740681e0 tx=0x7fb76c017000 comp rx=0 tx=0).stop 2023-06-22T16:23:53.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.181+0000 7fb77a333700 1 -- 172.21.15.149:0/3307473480 shutdown_connections 2023-06-22T16:23:53.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.181+0000 7fb77a333700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7740cba10 0x7fb774151df0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.181+0000 7fb77a333700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb7740caec0 0x7fb77415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.181+0000 7fb77a333700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fb7600604b0 0x7fb760062960 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.181+0000 7fb77a333700 1 --2- 172.21.15.149:0/3307473480 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77406ab80 0x7fb77414f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.181+0000 7fb77a333700 1 -- 172.21.15.149:0/3307473480 >> 172.21.15.149:0/3307473480 conn(0x7fb774062990 msgr2=0x7fb7740ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:53.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.181+0000 7fb77a333700 1 -- 172.21.15.149:0/3307473480 shutdown_connections 2023-06-22T16:23:53.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.181+0000 7fb77a333700 1 -- 172.21.15.149:0/3307473480 wait complete. 2023-06-22T16:23:53.198 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-22T16:23:53.198 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-22T16:23:53.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.309+0000 7f2c9b8a1700 1 Processor -- start 2023-06-22T16:23:53.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.309+0000 7f2c9b8a1700 1 -- start start 2023-06-22T16:23:53.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.309+0000 7f2c9b8a1700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2c940cc1c0 0x7f2c940a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.309+0000 7f2c9b8a1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940c9390 con 0x7f2c9415c3c0 2023-06-22T16:23:53.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.309+0000 7f2c9b8a1700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940c9670 con 0x7f2c940cbd60 2023-06-22T16:23:53.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.309+0000 7f2c9b8a1700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c940c81c0 con 0x7f2c940cc1c0 2023-06-22T16:23:53.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.309+0000 7f2c9963d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2c9415c3c0 0x7f2c940c8990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57874/0 (socket says 172.21.15.149:57874) 2023-06-22T16:23:53.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.309+0000 7f2c9963d700 1 -- 172.21.15.149:0/635257601 learned_addr learned my addr 172.21.15.149:0/635257601 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-22T16:23:53.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c99e3e700 1 --2- 172.21.15.149:0/635257601 >> v2:172.21.15.196:3300/0 conn(0x7f2c940cc1c0 0x7f2c940a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208783996 0 0) 0x7f2c940c9390 con 0x7f2c9415c3c0 2023-06-22T16:23:53.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c80003570 con 0x7f2c9415c3c0 2023-06-22T16:23:53.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3243720585 0 0) 0x7f2c80003570 con 0x7f2c9415c3c0 2023-06-22T16:23:53.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 >> v2:172.21.15.196:3300/0 conn(0x7f2c940cc1c0 msgr2=0x7f2c940a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:53.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 --2- 172.21.15.149:0/635257601 >> v2:172.21.15.196:3300/0 conn(0x7f2c940cc1c0 0x7f2c940a9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 >> v1:172.21.15.196:6789/0 conn(0x7f2c940cbd60 legacy=0x7f2c940a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940c9950 con 0x7f2c9415c3c0 2023-06-22T16:23:53.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 882791489 0 0) 0x7f2c84004ee0 con 0x7f2c9415c3c0 2023-06-22T16:23:53.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 >> v1:172.21.15.149:6789/0 conn(0x7f2c9415c3c0 legacy=0x7f2c940c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 --2- 172.21.15.149:0/635257601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c80003a60 0x7f2c80003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 --2- 172.21.15.149:0/635257601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c80004810 0x7f2c80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 --2- 172.21.15.149:0/635257601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c800052e0 0x7f2c8000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940c81c0 con 0x7f2c80003a60 2023-06-22T16:23:53.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8000c2a0 con 0x7f2c800052e0 2023-06-22T16:23:53.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8000c460 con 0x7f2c80004810 2023-06-22T16:23:53.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c99e3e700 1 --2- 172.21.15.149:0/635257601 >> v2:172.21.15.196:3300/0 conn(0x7f2c940cc1c0 0x7f2c940a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T16:23:53.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9963d700 1 --2- 172.21.15.149:0/635257601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c80003a60 0x7f2c80003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c98e3c700 1 --2- 172.21.15.149:0/635257601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c80004810 0x7f2c80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c99e3e700 1 --2- 172.21.15.149:0/635257601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c800052e0 0x7f2c8000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9963d700 1 -- 172.21.15.149:0/635257601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c80004810 msgr2=0x7f2c80004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:53.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9963d700 1 --2- 172.21.15.149:0/635257601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c80004810 0x7f2c80004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9963d700 1 -- 172.21.15.149:0/635257601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c800052e0 msgr2=0x7f2c8000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:53.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9963d700 1 --2- 172.21.15.149:0/635257601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c800052e0 0x7f2c8000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c99e3e700 1 -- 172.21.15.149:0/635257601 reap_dead start 2023-06-22T16:23:53.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9963d700 1 -- 172.21.15.149:0/635257601 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c80003570 con 0x7f2c80003a60 2023-06-22T16:23:53.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9963d700 1 --2- 172.21.15.149:0/635257601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c80003a60 0x7f2c80003e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400c3c0 tx=0x7f2c84007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff6f2bbbb9be4fa server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:53.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8400cc10 con 0x7f2c80003a60 2023-06-22T16:23:53.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8400cd90 con 0x7f2c80003a60 2023-06-22T16:23:53.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c8bfff700 1 -- 172.21.15.149:0/635257601 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84005b70 con 0x7f2c80003a60 2023-06-22T16:23:53.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/635257601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c80003a60 msgr2=0x7f2c80003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9b8a1700 1 --2- 172.21.15.149:0/635257601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c80003a60 0x7f2c80003e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400c3c0 tx=0x7f2c84007940 comp rx=0 tx=0).stop 2023-06-22T16:23:53.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/635257601 shutdown_connections 2023-06-22T16:23:53.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9b8a1700 1 --2- 172.21.15.149:0/635257601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c80003a60 0x7f2c80003e70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/635257601 >> 172.21.15.149:0/635257601 conn(0x7f2c94095db0 msgr2=0x7f2c9406dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:53.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/635257601 shutdown_connections 2023-06-22T16:23:53.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.313+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/635257601 wait complete. 2023-06-22T16:23:53.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c9b8a1700 1 Processor -- start 2023-06-22T16:23:53.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c9b8a1700 1 -- start start 2023-06-22T16:23:53.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c9b8a1700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c80003a60 0x7f2c940a9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c9b8a1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c940c1f30 0x7f2c940ab720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c9b8a1700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c941572e0 0x7f2c940ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c9b8a1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940ca010 con 0x7f2c940c1f30 2023-06-22T16:23:53.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c9b8a1700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940abc60 con 0x7f2c941572e0 2023-06-22T16:23:53.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c9b8a1700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940ad580 con 0x7f2c80003a60 2023-06-22T16:23:53.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c98e3c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c940c1f30 0x7f2c940ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c98e3c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c940c1f30 0x7f2c940ab720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34116/0 (socket says 172.21.15.149:34116) 2023-06-22T16:23:53.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c98e3c700 1 -- 172.21.15.149:0/1555627801 learned_addr learned my addr 172.21.15.149:0/1555627801 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:53.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c9963d700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c80003a60 0x7f2c940a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c99e3e700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c941572e0 0x7f2c940ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c98e3c700 1 -- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c80003a60 msgr2=0x7f2c940a9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c98e3c700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c80003a60 0x7f2c940a9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c98e3c700 1 -- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c941572e0 msgr2=0x7f2c940ac360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c98e3c700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c941572e0 0x7f2c940ac360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c98e3c700 1 -- 172.21.15.149:0/1555627801 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940adb40 con 0x7f2c940c1f30 2023-06-22T16:23:53.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.317+0000 7f2c98e3c700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c940c1f30 0x7f2c940ab720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2c900029b0 tx=0x7f2c90007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:53.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.321+0000 7f2c897fa700 1 -- 172.21.15.149:0/1555627801 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90013600 con 0x7f2c940c1f30 2023-06-22T16:23:53.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.321+0000 7f2c897fa700 1 -- 172.21.15.149:0/1555627801 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c90013760 con 0x7f2c940c1f30 2023-06-22T16:23:53.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.321+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/1555627801 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c940c23a0 con 0x7f2c940c1f30 2023-06-22T16:23:53.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.321+0000 7f2c897fa700 1 -- 172.21.15.149:0/1555627801 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90013b00 con 0x7f2c940c1f30 2023-06-22T16:23:53.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.321+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/1555627801 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c940c28f0 con 0x7f2c940c1f30 2023-06-22T16:23:53.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.321+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/1555627801 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c940adcd0 con 0x7f2c940c1f30 2023-06-22T16:23:53.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.321+0000 7f2c897fa700 1 -- 172.21.15.149:0/1555627801 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f2c9001c400 con 0x7f2c940c1f30 2023-06-22T16:23:53.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.321+0000 7f2c897fa700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f2c780604b0 0x7f2c78062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.321+0000 7f2c897fa700 1 -- 172.21.15.149:0/1555627801 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2c9007c810 con 0x7f2c940c1f30 2023-06-22T16:23:53.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.321+0000 7f2c9963d700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f2c780604b0 0x7f2c78062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.321+0000 7f2c9963d700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f2c780604b0 0x7f2c78062960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2c84008fd0 tx=0x7f2c84015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:53.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.329+0000 7f2c897fa700 1 -- 172.21.15.149:0/1555627801 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f2c9004d0b0 con 0x7f2c940c1f30 2023-06-22T16:23:53.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.489+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/1555627801 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2c9404bc30 con 0x7f2c940c1f30 2023-06-22T16:23:53.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.729+0000 7f2c897fa700 1 -- 172.21.15.149:0/1555627801 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2c900506d0 con 0x7f2c940c1f30 2023-06-22T16:23:53.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.733+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f2c780604b0 msgr2=0x7f2c78062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.733+0000 7f2c9b8a1700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f2c780604b0 0x7f2c78062960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2c84008fd0 tx=0x7f2c84015000 comp rx=0 tx=0).stop 2023-06-22T16:23:53.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.733+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/1555627801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c940c1f30 msgr2=0x7f2c940ab720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.733+0000 7f2c9b8a1700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c940c1f30 0x7f2c940ab720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2c900029b0 tx=0x7f2c90007d30 comp rx=0 tx=0).stop 2023-06-22T16:23:53.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.733+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/1555627801 shutdown_connections 2023-06-22T16:23:53.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.733+0000 7f2c9b8a1700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c941572e0 0x7f2c940ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.733+0000 7f2c9b8a1700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c940c1f30 0x7f2c940ab720 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.733+0000 7f2c9b8a1700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f2c780604b0 0x7f2c78062960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.733+0000 7f2c9b8a1700 1 --2- 172.21.15.149:0/1555627801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c80003a60 0x7f2c940a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.733+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/1555627801 >> 172.21.15.149:0/1555627801 conn(0x7f2c94095db0 msgr2=0x7f2c94158da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:53.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.733+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/1555627801 shutdown_connections 2023-06-22T16:23:53.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.733+0000 7f2c9b8a1700 1 -- 172.21.15.149:0/1555627801 wait complete. 2023-06-22T16:23:53.746 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' created 2023-06-22T16:23:53.758 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-22T16:23:53.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.861+0000 7f8f0c970700 1 Processor -- start 2023-06-22T16:23:53.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.861+0000 7f8f0c970700 1 -- start start 2023-06-22T16:23:53.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0c970700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f080ccd40 0x7f8f08158940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0c970700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f080cf310 con 0x7f8f080cc970 2023-06-22T16:23:53.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0c970700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f08159300 con 0x7f8f08158e80 2023-06-22T16:23:53.870 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0c970700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080ce700 con 0x7f8f080ccd40 2023-06-22T16:23:53.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f06d9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8f080cc970 0x7f8f080cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57878/0 (socket says 172.21.15.149:57878) 2023-06-22T16:23:53.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f06d9d700 1 -- 172.21.15.149:0/2881881449 learned_addr learned my addr 172.21.15.149:0/2881881449 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-22T16:23:53.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0659c700 1 --2- 172.21.15.149:0/2881881449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f080ccd40 0x7f8f08158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714869709 0 0) 0x7f8f080cf310 con 0x7f8f080cc970 2023-06-22T16:23:53.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ef4003570 con 0x7f8f080cc970 2023-06-22T16:23:53.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277294958 0 0) 0x7f8f08159300 con 0x7f8f08158e80 2023-06-22T16:23:53.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f080cf310 con 0x7f8f08158e80 2023-06-22T16:23:53.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2087726805 0 0) 0x7f8ef4003570 con 0x7f8f080cc970 2023-06-22T16:23:53.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f080ccd40 msgr2=0x7f8f08158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:53.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 --2- 172.21.15.149:0/2881881449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f080ccd40 0x7f8f08158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 >> v1:172.21.15.196:6789/0 conn(0x7f8f08158e80 legacy=0x7f8f080af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.874 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080ce9e0 con 0x7f8f080cc970 2023-06-22T16:23:53.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 882791489 0 0) 0x7f8ef80017f0 con 0x7f8f080cc970 2023-06-22T16:23:53.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 >> v1:172.21.15.149:6789/0 conn(0x7f8f080cc970 legacy=0x7f8f080cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 --2- 172.21.15.149:0/2881881449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ef4003c20 0x7f8ef4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 --2- 172.21.15.149:0/2881881449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ef4004810 0x7f8ef4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 --2- 172.21.15.149:0/2881881449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef40051c0 0x7f8ef400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080ce700 con 0x7f8ef40051c0 2023-06-22T16:23:53.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef400c020 con 0x7f8ef4003c20 2023-06-22T16:23:53.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef400c1e0 con 0x7f8ef4004810 2023-06-22T16:23:53.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0659c700 1 --2- 172.21.15.149:0/2881881449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f080ccd40 0x7f8f08158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T16:23:53.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f06d9d700 1 --2- 172.21.15.149:0/2881881449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ef4003c20 0x7f8ef4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0759e700 1 --2- 172.21.15.149:0/2881881449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef40051c0 0x7f8ef400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0659c700 1 --2- 172.21.15.149:0/2881881449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ef4004810 0x7f8ef4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0759e700 1 -- 172.21.15.149:0/2881881449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ef4004810 msgr2=0x7f8ef4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:53.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0759e700 1 --2- 172.21.15.149:0/2881881449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8ef4004810 0x7f8ef4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0759e700 1 -- 172.21.15.149:0/2881881449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ef4003c20 msgr2=0x7f8ef4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:53.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0759e700 1 --2- 172.21.15.149:0/2881881449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ef4003c20 0x7f8ef4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0759e700 1 -- 172.21.15.149:0/2881881449 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef4003570 con 0x7f8ef40051c0 2023-06-22T16:23:53.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0759e700 1 --2- 172.21.15.149:0/2881881449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef40051c0 0x7f8ef400ba60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f00001a10 tx=0x7f8f00007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f181054cd50991e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:53.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0000c5d0 con 0x7f8ef40051c0 2023-06-22T16:23:53.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0000c730 con 0x7f8ef40051c0 2023-06-22T16:23:53.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f05d9b700 1 -- 172.21.15.149:0/2881881449 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0000caf0 con 0x7f8ef40051c0 2023-06-22T16:23:53.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0c970700 1 -- 172.21.15.149:0/2881881449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef40051c0 msgr2=0x7f8ef400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0c970700 1 --2- 172.21.15.149:0/2881881449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef40051c0 0x7f8ef400ba60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f00001a10 tx=0x7f8f00007d10 comp rx=0 tx=0).stop 2023-06-22T16:23:53.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0759e700 1 -- 172.21.15.149:0/2881881449 reap_dead start 2023-06-22T16:23:53.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0c970700 1 -- 172.21.15.149:0/2881881449 shutdown_connections 2023-06-22T16:23:53.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0c970700 1 -- 172.21.15.149:0/2881881449 >> 172.21.15.149:0/2881881449 conn(0x7f8f0806e500 msgr2=0x7f8f08062990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:53.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0c970700 1 -- 172.21.15.149:0/2881881449 shutdown_connections 2023-06-22T16:23:53.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.865+0000 7f8f0c970700 1 -- 172.21.15.149:0/2881881449 wait complete. 2023-06-22T16:23:53.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.869+0000 7f8f0c970700 1 Processor -- start 2023-06-22T16:23:53.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.869+0000 7f8f0c970700 1 -- start start 2023-06-22T16:23:53.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f0c970700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0814f7d0 0x7f8f080b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f0c970700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f080b46a0 0x7f8f080b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f0c970700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f0814fba0 0x7f8f080b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f0c970700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080b5730 con 0x7f8f0814f7d0 2023-06-22T16:23:53.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f0c970700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080c7d70 con 0x7f8f0814fba0 2023-06-22T16:23:53.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f0c970700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080b4b20 con 0x7f8f080b46a0 2023-06-22T16:23:53.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f06d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0814f7d0 0x7f8f080b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f0659c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f080b46a0 0x7f8f080b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f0659c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f080b46a0 0x7f8f080b2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.149:55532/0 (socket says 172.21.15.149:55532) 2023-06-22T16:23:53.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f06d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0814f7d0 0x7f8f080b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34128/0 (socket says 172.21.15.149:34128) 2023-06-22T16:23:53.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f0659c700 1 -- 172.21.15.149:0/1047705039 learned_addr learned my addr 172.21.15.149:0/1047705039 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:53.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f0759e700 1 --2- 172.21.15.149:0/1047705039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f0814fba0 0x7f8f080b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f06d9d700 1 -- 172.21.15.149:0/1047705039 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f080b46a0 msgr2=0x7f8f080b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f06d9d700 1 --2- 172.21.15.149:0/1047705039 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f080b46a0 0x7f8f080b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f06d9d700 1 -- 172.21.15.149:0/1047705039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f0814fba0 msgr2=0x7f8f080b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:53.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f06d9d700 1 --2- 172.21.15.149:0/1047705039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f0814fba0 0x7f8f080b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:53.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f06d9d700 1 -- 172.21.15.149:0/1047705039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080b4e00 con 0x7f8f0814f7d0 2023-06-22T16:23:53.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f06d9d700 1 --2- 172.21.15.149:0/1047705039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0814f7d0 0x7f8f080b4160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8004c10 tx=0x7f8ef8002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:53.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8efeffd700 1 -- 172.21.15.149:0/1047705039 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef800ad60 con 0x7f8f0814f7d0 2023-06-22T16:23:53.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8efeffd700 1 -- 172.21.15.149:0/1047705039 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef80133f0 con 0x7f8f0814f7d0 2023-06-22T16:23:53.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f0c970700 1 -- 172.21.15.149:0/1047705039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f080b50e0 con 0x7f8f0814f7d0 2023-06-22T16:23:53.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8efeffd700 1 -- 172.21.15.149:0/1047705039 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef80137b0 con 0x7f8f0814f7d0 2023-06-22T16:23:53.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f0c970700 1 -- 172.21.15.149:0/1047705039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f081698c0 con 0x7f8f0814f7d0 2023-06-22T16:23:53.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.873+0000 7f8f0c970700 1 -- 172.21.15.149:0/1047705039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f08169a80 con 0x7f8f0814f7d0 2023-06-22T16:23:53.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.877+0000 7f8efeffd700 1 -- 172.21.15.149:0/1047705039 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f8ef8013b60 con 0x7f8f0814f7d0 2023-06-22T16:23:53.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.877+0000 7f8efeffd700 1 --2- 172.21.15.149:0/1047705039 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f8ee80604b0 0x7f8ee8062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:53.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.877+0000 7f8efeffd700 1 -- 172.21.15.149:0/1047705039 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f8ef807d220 con 0x7f8f0814f7d0 2023-06-22T16:23:53.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.877+0000 7f8f0659c700 1 --2- 172.21.15.149:0/1047705039 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f8ee80604b0 0x7f8ee8062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:53.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.877+0000 7f8f0659c700 1 --2- 172.21.15.149:0/1047705039 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f8ee80604b0 0x7f8ee8062960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8f08155a70 tx=0x7f8ef00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:53.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:53.885+0000 7f8efeffd700 1 -- 172.21.15.149:0/1047705039 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f8ef804d950 con 0x7f8f0814f7d0 2023-06-22T16:23:54.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.053+0000 7f8f0c970700 1 -- 172.21.15.149:0/1047705039 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8f080cecc0 con 0x7f8f0814f7d0 2023-06-22T16:23:54.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.745+0000 7f8efeffd700 1 -- 172.21.15.149:0/1047705039 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v24) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8ef8050f70 con 0x7f8f0814f7d0 2023-06-22T16:23:54.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.765+0000 7f8f0c970700 1 -- 172.21.15.149:0/1047705039 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f8ee80604b0 msgr2=0x7f8ee8062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:54.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.765+0000 7f8f0c970700 1 --2- 172.21.15.149:0/1047705039 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f8ee80604b0 0x7f8ee8062960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8f08155a70 tx=0x7f8ef00091a0 comp rx=0 tx=0).stop 2023-06-22T16:23:54.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.765+0000 7f8f0c970700 1 -- 172.21.15.149:0/1047705039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0814f7d0 msgr2=0x7f8f080b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:54.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.765+0000 7f8f0c970700 1 --2- 172.21.15.149:0/1047705039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0814f7d0 0x7f8f080b4160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8004c10 tx=0x7f8ef8002190 comp rx=0 tx=0).stop 2023-06-22T16:23:54.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.765+0000 7f8f0c970700 1 -- 172.21.15.149:0/1047705039 shutdown_connections 2023-06-22T16:23:54.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.765+0000 7f8f0c970700 1 --2- 172.21.15.149:0/1047705039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f0814fba0 0x7f8f080b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:54.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.765+0000 7f8f0c970700 1 --2- 172.21.15.149:0/1047705039 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f8ee80604b0 0x7f8ee8062960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:54.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.765+0000 7f8f0c970700 1 --2- 172.21.15.149:0/1047705039 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f080b46a0 0x7f8f080b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:54.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.765+0000 7f8f0c970700 1 --2- 172.21.15.149:0/1047705039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f0814f7d0 0x7f8f080b4160 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:54.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.765+0000 7f8f0c970700 1 -- 172.21.15.149:0/1047705039 >> 172.21.15.149:0/1047705039 conn(0x7f8f0806e500 msgr2=0x7f8f08157430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:54.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.765+0000 7f8f0c970700 1 -- 172.21.15.149:0/1047705039 shutdown_connections 2023-06-22T16:23:54.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.765+0000 7f8f0c970700 1 -- 172.21.15.149:0/1047705039 wait complete. 2023-06-22T16:23:54.775 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' created 2023-06-22T16:23:54.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-22T16:23:54.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f1d63a700 1 Processor -- start 2023-06-22T16:23:54.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f1d63a700 1 -- start start 2023-06-22T16:23:54.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f1d63a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5f1815b4f0 0x7f5f180aad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:54.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f1d63a700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5f1806af20 0x7f5f180cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:54.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f1d63a700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1806aa90 con 0x7f5f180aa950 2023-06-22T16:23:54.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f1d63a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1806b360 con 0x7f5f1815b4f0 2023-06-22T16:23:54.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f1d63a700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1806a1a0 con 0x7f5f1806af20 2023-06-22T16:23:54.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f177fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5f1815b4f0 0x7f5f180aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:54.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f177fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5f1815b4f0 0x7f5f180aad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34140/0 (socket says 172.21.15.149:34140) 2023-06-22T16:23:54.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f177fe700 1 -- 172.21.15.149:0/2431643874 learned_addr learned my addr 172.21.15.149:0/2431643874 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:54.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f1ce39700 1 --2- 172.21.15.149:0/2431643874 >> v2:172.21.15.196:3300/0 conn(0x7f5f1806af20 0x7f5f180cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:54.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f177fe700 1 -- 172.21.15.149:0/2431643874 >> v2:172.21.15.196:3300/0 conn(0x7f5f1806af20 msgr2=0x7f5f180cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:54.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f177fe700 1 --2- 172.21.15.149:0/2431643874 >> v2:172.21.15.196:3300/0 conn(0x7f5f1806af20 0x7f5f180cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:54.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f177fe700 1 -- 172.21.15.149:0/2431643874 >> v1:172.21.15.196:6789/0 conn(0x7f5f180aa950 legacy=0x7f5f180c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:54.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f177fe700 1 -- 172.21.15.149:0/2431643874 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f180c6f50 con 0x7f5f1815b4f0 2023-06-22T16:23:54.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f1ce39700 1 --2- 172.21.15.149:0/2431643874 >> v2:172.21.15.196:3300/0 conn(0x7f5f1806af20 0x7f5f180cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T16:23:54.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f177fe700 1 --2- 172.21.15.149:0/2431643874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f1815b4f0 0x7f5f180aad20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f1806ccc0 tx=0x7f5f00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4872aa8d9ea9cd0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:54.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f16ffd700 1 -- 172.21.15.149:0/2431643874 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0000b8b0 con 0x7f5f1815b4f0 2023-06-22T16:23:54.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f16ffd700 1 -- 172.21.15.149:0/2431643874 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0000ba10 con 0x7f5f1815b4f0 2023-06-22T16:23:54.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.885+0000 7f5f16ffd700 1 -- 172.21.15.149:0/2431643874 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0000bdb0 con 0x7f5f1815b4f0 2023-06-22T16:23:54.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.889+0000 7f5f1d63a700 1 -- 172.21.15.149:0/2431643874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f1815b4f0 msgr2=0x7f5f180aad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:54.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.889+0000 7f5f1d63a700 1 --2- 172.21.15.149:0/2431643874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f1815b4f0 0x7f5f180aad20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f1806ccc0 tx=0x7f5f00009250 comp rx=0 tx=0).stop 2023-06-22T16:23:54.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.889+0000 7f5f1d63a700 1 -- 172.21.15.149:0/2431643874 shutdown_connections 2023-06-22T16:23:54.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.889+0000 7f5f1d63a700 1 --2- 172.21.15.149:0/2431643874 >> v2:172.21.15.196:3300/0 conn(0x7f5f1806af20 0x7f5f180cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:54.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.889+0000 7f5f1d63a700 1 --2- 172.21.15.149:0/2431643874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f1815b4f0 0x7f5f180aad20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:54.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.889+0000 7f5f1d63a700 1 -- 172.21.15.149:0/2431643874 >> 172.21.15.149:0/2431643874 conn(0x7f5f18067910 msgr2=0x7f5f1806c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:54.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.889+0000 7f5f1d63a700 1 -- 172.21.15.149:0/2431643874 shutdown_connections 2023-06-22T16:23:54.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.889+0000 7f5f1d63a700 1 -- 172.21.15.149:0/2431643874 wait complete. 2023-06-22T16:23:54.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.889+0000 7f5f1d63a700 1 Processor -- start 2023-06-22T16:23:54.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.889+0000 7f5f1d63a700 1 -- start start 2023-06-22T16:23:54.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f1d63a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f1806af20 0x7f5f180ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:54.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f1d63a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5f180aa950 0x7f5f181520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:54.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f1d63a700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f1815b4f0 0x7f5f180aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:54.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f1d63a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18152b30 con 0x7f5f1806af20 2023-06-22T16:23:54.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f1d63a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18152e10 con 0x7f5f180aa950 2023-06-22T16:23:54.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f1d63a700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f181530f0 con 0x7f5f1815b4f0 2023-06-22T16:23:54.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f17fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f1806af20 0x7f5f180ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:54.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f17fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f1806af20 0x7f5f180ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34152/0 (socket says 172.21.15.149:34152) 2023-06-22T16:23:54.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f17fff700 1 -- 172.21.15.149:0/3983426458 learned_addr learned my addr 172.21.15.149:0/3983426458 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:54.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f177fe700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5f180aa950 0x7f5f181520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:54.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f1ce39700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f1815b4f0 0x7f5f180aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:54.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f17fff700 1 -- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f1815b4f0 msgr2=0x7f5f180aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:54.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f17fff700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f1815b4f0 0x7f5f180aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:54.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f17fff700 1 -- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5f180aa950 msgr2=0x7f5f181520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:54.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f17fff700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5f180aa950 0x7f5f181520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:54.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f17fff700 1 -- 172.21.15.149:0/3983426458 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000094f0 con 0x7f5f1806af20 2023-06-22T16:23:54.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f17fff700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f1806af20 0x7f5f180ac590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c950 tx=0x7f5f10002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:54.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f0ffff700 1 -- 172.21.15.149:0/3983426458 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1000a7e0 con 0x7f5f1806af20 2023-06-22T16:23:54.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f0ffff700 1 -- 172.21.15.149:0/3983426458 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1000a940 con 0x7f5f1806af20 2023-06-22T16:23:54.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f1d63a700 1 -- 172.21.15.149:0/3983426458 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f180c40e0 con 0x7f5f1806af20 2023-06-22T16:23:54.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f0ffff700 1 -- 172.21.15.149:0/3983426458 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1000ad00 con 0x7f5f1806af20 2023-06-22T16:23:54.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.893+0000 7f5f1d63a700 1 -- 172.21.15.149:0/3983426458 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f180ab380 con 0x7f5f1806af20 2023-06-22T16:23:54.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.897+0000 7f5f1d63a700 1 -- 172.21.15.149:0/3983426458 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f180c3f40 con 0x7f5f1806af20 2023-06-22T16:23:54.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.897+0000 7f5f0ffff700 1 -- 172.21.15.149:0/3983426458 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f5f10012630 con 0x7f5f1806af20 2023-06-22T16:23:54.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.897+0000 7f5f0ffff700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f5efc0604b0 0x7f5efc062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:54.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.897+0000 7f5f0ffff700 1 -- 172.21.15.149:0/3983426458 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f5f1007cd00 con 0x7f5f1806af20 2023-06-22T16:23:54.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.897+0000 7f5f177fe700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f5efc0604b0 0x7f5efc062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:54.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.897+0000 7f5f177fe700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f5efc0604b0 0x7f5efc062960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f1806ccc0 tx=0x7f5f00016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:54.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:54.905+0000 7f5f0ffff700 1 -- 172.21.15.149:0/3983426458 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f5f180c3f40 con 0x7f5f1806af20 2023-06-22T16:23:55.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.097+0000 7f5f1d63a700 1 -- 172.21.15.149:0/3983426458 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5f180c3f40 con 0x7f5f1806af20 2023-06-22T16:23:55.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.109+0000 7f5f0ffff700 1 -- 172.21.15.149:0/3983426458 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5f180c3f40 con 0x7f5f1806af20 2023-06-22T16:23:55.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.117+0000 7f5f1d63a700 1 -- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f5efc0604b0 msgr2=0x7f5efc062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.117+0000 7f5f1d63a700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f5efc0604b0 0x7f5efc062960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f1806ccc0 tx=0x7f5f00016000 comp rx=0 tx=0).stop 2023-06-22T16:23:55.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.117+0000 7f5f1d63a700 1 -- 172.21.15.149:0/3983426458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f1806af20 msgr2=0x7f5f180ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.117+0000 7f5f1d63a700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f1806af20 0x7f5f180ac590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c950 tx=0x7f5f10002760 comp rx=0 tx=0).stop 2023-06-22T16:23:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.133+0000 7f5f1d63a700 1 -- 172.21.15.149:0/3983426458 shutdown_connections 2023-06-22T16:23:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.133+0000 7f5f1d63a700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f5efc0604b0 0x7f5efc062960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.133+0000 7f5f1d63a700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5f1815b4f0 0x7f5f180aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.133+0000 7f5f1d63a700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5f180aa950 0x7f5f181520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.133+0000 7f5f1d63a700 1 --2- 172.21.15.149:0/3983426458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f1806af20 0x7f5f180ac590 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.133+0000 7f5f1d63a700 1 -- 172.21.15.149:0/3983426458 >> 172.21.15.149:0/3983426458 conn(0x7f5f18067910 msgr2=0x7f5f1814ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:55.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.137+0000 7f5f1d63a700 1 -- 172.21.15.149:0/3983426458 shutdown_connections 2023-06-22T16:23:55.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.137+0000 7f5f1d63a700 1 -- 172.21.15.149:0/3983426458 wait complete. 2023-06-22T16:23:55.143 INFO:teuthology.orchestra.run.smithi149.stderr:new fs with metadata pool 3 and data pool 4 2023-06-22T16:23:55.154 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T16:23:55.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.241+0000 7fcbfa1ba700 1 Processor -- start 2023-06-22T16:23:55.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.241+0000 7fcbfa1ba700 1 -- start start 2023-06-22T16:23:55.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbfa1ba700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcbf40b2260 0x7fcbf4159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbfa1ba700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf415a580 con 0x7fcbf41597b0 2023-06-22T16:23:55.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbfa1ba700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf40cad40 con 0x7fcbf4158ea0 2023-06-22T16:23:55.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbfa1ba700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf40b0590 con 0x7fcbf40b2260 2023-06-22T16:23:55.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf99b9700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fcbf41597b0 0x7fcbf40cb1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:57880/0 (socket says 172.21.15.149:57880) 2023-06-22T16:23:55.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf99b9700 1 -- 172.21.15.149:0/2321450016 learned_addr learned my addr 172.21.15.149:0/2321450016 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-22T16:23:55.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf89b7700 1 --2- 172.21.15.149:0/2321450016 >> v2:172.21.15.196:3300/0 conn(0x7fcbf40b2260 0x7fcbf4159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423914277 0 0) 0x7fcbf415a580 con 0x7fcbf41597b0 2023-06-22T16:23:55.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbdc003570 con 0x7fcbf41597b0 2023-06-22T16:23:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3443374253 0 0) 0x7fcbdc003570 con 0x7fcbf41597b0 2023-06-22T16:23:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 >> v2:172.21.15.196:3300/0 conn(0x7fcbf40b2260 msgr2=0x7fcbf4159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 --2- 172.21.15.149:0/2321450016 >> v2:172.21.15.196:3300/0 conn(0x7fcbf40b2260 0x7fcbf4159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 >> v1:172.21.15.196:6789/0 conn(0x7fcbf4158ea0 legacy=0x7fcbf40b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf415a2a0 con 0x7fcbf41597b0 2023-06-22T16:23:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 882791489 0 0) 0x7fcbe4001470 con 0x7fcbf41597b0 2023-06-22T16:23:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 >> v1:172.21.15.149:6789/0 conn(0x7fcbf41597b0 legacy=0x7fcbf40cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 --2- 172.21.15.149:0/2321450016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbdc003a60 0x7fcbdc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 --2- 172.21.15.149:0/2321450016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcbdc004810 0x7fcbdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 --2- 172.21.15.149:0/2321450016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbdc0051c0 0x7fcbdc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc00c130 con 0x7fcbdc0051c0 2023-06-22T16:23:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc00c2a0 con 0x7fcbdc003a60 2023-06-22T16:23:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc00c460 con 0x7fcbdc004810 2023-06-22T16:23:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf99b9700 1 --2- 172.21.15.149:0/2321450016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbdc0051c0 0x7fcbdc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf91b8700 1 --2- 172.21.15.149:0/2321450016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbdc003a60 0x7fcbdc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf89b7700 1 --2- 172.21.15.149:0/2321450016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcbdc004810 0x7fcbdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf99b9700 1 -- 172.21.15.149:0/2321450016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcbdc004810 msgr2=0x7fcbdc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:55.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf99b9700 1 --2- 172.21.15.149:0/2321450016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcbdc004810 0x7fcbdc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf99b9700 1 -- 172.21.15.149:0/2321450016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbdc003a60 msgr2=0x7fcbdc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:55.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf99b9700 1 --2- 172.21.15.149:0/2321450016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbdc003a60 0x7fcbdc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf99b9700 1 -- 172.21.15.149:0/2321450016 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc003570 con 0x7fcbdc0051c0 2023-06-22T16:23:55.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf89b7700 1 --2- 172.21.15.149:0/2321450016 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcbdc004810 0x7fcbdc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T16:23:55.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf99b9700 1 -- 172.21.15.149:0/2321450016 reap_dead start 2023-06-22T16:23:55.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf99b9700 1 --2- 172.21.15.149:0/2321450016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbdc0051c0 0x7fcbdc00ba60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c390 tx=0x7fcbf40b16c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0705a8c5f09216 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:55.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe400cc60 con 0x7fcbdc0051c0 2023-06-22T16:23:55.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe400ce00 con 0x7fcbdc0051c0 2023-06-22T16:23:55.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbf3fff700 1 -- 172.21.15.149:0/2321450016 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4005b70 con 0x7fcbdc0051c0 2023-06-22T16:23:55.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.245+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/2321450016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbdc0051c0 msgr2=0x7fcbdc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 --2- 172.21.15.149:0/2321450016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbdc0051c0 0x7fcbdc00ba60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c390 tx=0x7fcbf40b16c0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/2321450016 shutdown_connections 2023-06-22T16:23:55.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 --2- 172.21.15.149:0/2321450016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbdc0051c0 0x7fcbdc00ba60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/2321450016 >> 172.21.15.149:0/2321450016 conn(0x7fcbf4062990 msgr2=0x7fcbf4062d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:55.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/2321450016 shutdown_connections 2023-06-22T16:23:55.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/2321450016 wait complete. 2023-06-22T16:23:55.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 Processor -- start 2023-06-22T16:23:55.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 -- start start 2023-06-22T16:23:55.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcbdc0051c0 0x7fcbf4156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbf40c87b0 0x7fcbf4156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbf40c5560 0x7fcbf40c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf41574c0 con 0x7fcbf40c5560 2023-06-22T16:23:55.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf40c97f0 con 0x7fcbf40c87b0 2023-06-22T16:23:55.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.249+0000 7fcbfa1ba700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf40c8c70 con 0x7fcbdc0051c0 2023-06-22T16:23:55.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf99b9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbf40c5560 0x7fcbf40c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf99b9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbf40c5560 0x7fcbf40c59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34168/0 (socket says 172.21.15.149:34168) 2023-06-22T16:23:55.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf99b9700 1 -- 172.21.15.149:0/3695541328 learned_addr learned my addr 172.21.15.149:0/3695541328 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:55.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf91b8700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcbdc0051c0 0x7fcbf4156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf89b7700 1 --2- 172.21.15.149:0/3695541328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbf40c87b0 0x7fcbf4156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf99b9700 1 -- 172.21.15.149:0/3695541328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcbdc0051c0 msgr2=0x7fcbf4156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf99b9700 1 --2- 172.21.15.149:0/3695541328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcbdc0051c0 0x7fcbf4156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf99b9700 1 -- 172.21.15.149:0/3695541328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbf40c87b0 msgr2=0x7fcbf4156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf99b9700 1 --2- 172.21.15.149:0/3695541328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbf40c87b0 0x7fcbf4156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf99b9700 1 -- 172.21.15.149:0/3695541328 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf40c8f50 con 0x7fcbf40c5560 2023-06-22T16:23:55.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf99b9700 1 --2- 172.21.15.149:0/3695541328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbf40c5560 0x7fcbf40c59e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4007cd0 tx=0x7fcbe4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:55.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf17fa700 1 -- 172.21.15.149:0/3695541328 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4021070 con 0x7fcbf40c5560 2023-06-22T16:23:55.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf17fa700 1 -- 172.21.15.149:0/3695541328 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe4001430 con 0x7fcbf40c5560 2023-06-22T16:23:55.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/3695541328 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf40c9230 con 0x7fcbf40c5560 2023-06-22T16:23:55.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf17fa700 1 -- 172.21.15.149:0/3695541328 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4007510 con 0x7fcbf40c5560 2023-06-22T16:23:55.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/3695541328 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf40cbde0 con 0x7fcbf40c5560 2023-06-22T16:23:55.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/3695541328 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf4168dc0 con 0x7fcbf40c5560 2023-06-22T16:23:55.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf17fa700 1 -- 172.21.15.149:0/3695541328 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fcbe4026410 con 0x7fcbf40c5560 2023-06-22T16:23:55.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf17fa700 1 --2- 172.21.15.149:0/3695541328 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fcbe00604b0 0x7fcbe0062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.253+0000 7fcbf17fa700 1 -- 172.21.15.149:0/3695541328 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcbe407d210 con 0x7fcbf40c5560 2023-06-22T16:23:55.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.257+0000 7fcbf91b8700 1 --2- 172.21.15.149:0/3695541328 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fcbe00604b0 0x7fcbe0062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.257+0000 7fcbf91b8700 1 --2- 172.21.15.149:0/3695541328 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fcbe00604b0 0x7fcbe0062960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcbec000f80 tx=0x7fcbec001640 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:55.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.265+0000 7fcbf17fa700 1 -- 172.21.15.149:0/3695541328 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fcbf4168dc0 con 0x7fcbf40c5560 2023-06-22T16:23:55.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.425+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/3695541328 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbf4168dc0 con 0x7fcbf40c5560 2023-06-22T16:23:55.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.425+0000 7fcbf17fa700 1 -- 172.21.15.149:0/3695541328 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16927 (secure 0 0 0) 0x7fcbf4168dc0 con 0x7fcbf40c5560 2023-06-22T16:23:55.434 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:23:55.434 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":25,"fsid":"0dba7f42-2446-45e3-aae5-b3ca874cf325","created":"2023-06-22T16:23:31.621362+0000","modified":"2023-06-22T16:23:55.102659+0000","last_up_change":"2023-06-22T16:23:42.614261+0000","last_in_change":"2023-06-22T16:23:33.638142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T16:23:43.865433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T16:23:49.572200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T16:23:53.535018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T16:23:54.096781+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"56ddaf00-fc77-44cf-b823-5bd377b92576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":32836},{"type":"v1","addr":"172.21.15.149:6809","nonce":32836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":32836},{"type":"v1","addr":"172.21.15.149:6811","nonce":32836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":32836},{"type":"v1","addr":"172.21.15.149:6816","nonce":32836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":32836},{"type":"v1","addr":"172.21.15.149:6813","nonce":32836}]},"public_addr":"172.21.15.149:6809/32836","cluster_addr":"172.21.15.149:6811/32836","heartbeat_back_addr":"172.21.15.149:6816/32836","heartbeat_front_addr":"172.21.15.149:6813/32836","state":["exists","up"]},{"osd":1,"uuid":"532f10bd-8b84-4a0b-9aed-28e7afb4a863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":32835},{"type":"v1","addr":"172.21.15.149:6817","nonce":32835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":32835},{"type":"v1","addr":"172.21.15.149:6819","nonce":32835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":32835},{"type":"v1","addr":"172.21.15.149:6823","nonce":32835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":32835},{"type":"v1","addr":"172.21.15.149:6821","nonce":32835}]},"public_addr":"172.21.15.149:6817/32835","cluster_addr":"172.21.15.149:6819/32835","heartbeat_back_addr":"172.21.15.149:6823/32835","heartbeat_front_addr":"172.21.15.149:6821/32835","state":["exists","up"]},{"osd":2,"uuid":"bc3c458c-c810-4c5a-b258-2de1cb3ca1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":32837},{"type":"v1","addr":"172.21.15.149:6825","nonce":32837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":32837},{"type":"v1","addr":"172.21.15.149:6827","nonce":32837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":32837},{"type":"v1","addr":"172.21.15.149:6831","nonce":32837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":32837},{"type":"v1","addr":"172.21.15.149:6829","nonce":32837}]},"public_addr":"172.21.15.149:6825/32837","cluster_addr":"172.21.15.149:6827/32837","heartbeat_back_addr":"172.21.15.149:6831/32837","heartbeat_front_addr":"172.21.15.149:6829/32837","state":["exists","up"]},{"osd":3,"uuid":"04bf7f65-1946-499c-aea9-c4caa92e8488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":32834},{"type":"v1","addr":"172.21.15.149:6801","nonce":32834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":32834},{"type":"v1","addr":"172.21.15.149:6803","nonce":32834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":32834},{"type":"v1","addr":"172.21.15.149:6807","nonce":32834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":32834},{"type":"v1","addr":"172.21.15.149:6805","nonce":32834}]},"public_addr":"172.21.15.149:6801/32834","cluster_addr":"172.21.15.149:6803/32834","heartbeat_back_addr":"172.21.15.149:6807/32834","heartbeat_front_addr":"172.21.15.149:6805/32834","state":["exists","up"]},{"osd":4,"uuid":"e49f385d-76d9-4304-8486-3e1f3cb8fd23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":33055},{"type":"v1","addr":"172.21.15.196:6809","nonce":33055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":33055},{"type":"v1","addr":"172.21.15.196:6811","nonce":33055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":33055},{"type":"v1","addr":"172.21.15.196:6815","nonce":33055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":33055},{"type":"v1","addr":"172.21.15.196:6813","nonce":33055}]},"public_addr":"172.21.15.196:6809/33055","cluster_addr":"172.21.15.196:6811/33055","heartbeat_back_addr":"172.21.15.196:6815/33055","heartbeat_front_addr":"172.21.15.196:6813/33055","state":["exists","up"]},{"osd":5,"uuid":"671a4069-7c86-4a14-825c-1179a74928c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":33057},{"type":"v1","addr":"172.21.15.196:6825","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":33057},{"type":"v1","addr":"172.21.15.196:6827","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":33057},{"type":"v1","addr":"172.21.15.196:6831","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":33057},{"type":"v1","addr":"172.21.15.196:6829","nonce":33057}]},"public_addr":"172.21.15.196:6825/33057","cluster_addr":"172.21.15.196:6827/33057","heartbeat_back_addr":"172.21.15.196:6831/33057","heartbeat_front_addr":"172.21.15.196:6829/33057","state":["exists","up"]},{"osd":6,"uuid":"7114b0c3-27fe-4816-8cc8-fb3679b8e707","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":33054},{"type":"v1","addr":"172.21.15.196:6801","nonce":33054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":33054},{"type":"v1","addr":"172.21.15.196:6803","nonce":33054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":33054},{"type":"v1","addr":"172.21.15.196:6807","nonce":33054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":33054},{"type":"v1","addr":"172.21.15.196:6805","nonce":33054}]},"public_addr":"172.21.15.196:6801/33054","cluster_addr":"172.21.15.196:6803/33054","heartbeat_back_addr":"172.21.15.196:6807/33054","heartbeat_front_addr":"172.21.15.196:6805/33054","state":["exists","up"]},{"osd":7,"uuid":"f9e6e633-0952-40bf-97e6-7c8b0bc804bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":33058},{"type":"v1","addr":"172.21.15.196:6817","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":33058},{"type":"v1","addr":"172.21.15.196:6819","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":33058},{"type":"v1","addr":"172.21.15.196:6823","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":33058},{"type":"v1","addr":"172.21.15.196:6821","nonce":33058}]},"public_addr":"172.21.15.196:6817/33058","cluster_addr":"172.21.15.196:6819/33058","heartbeat_back_addr":"172.21.15.196:6823/33058","heartbeat_front_addr":"172.21.15.196:6821/33058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.838753+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.877504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.932235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.898286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.697196+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:39.163122+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.820624+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.902436+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T16:23:55.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.429+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/3695541328 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fcbe00604b0 msgr2=0x7fcbe0062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.429+0000 7fcbfa1ba700 1 --2- 172.21.15.149:0/3695541328 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fcbe00604b0 0x7fcbe0062960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcbec000f80 tx=0x7fcbec001640 comp rx=0 tx=0).stop 2023-06-22T16:23:55.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.429+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/3695541328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbf40c5560 msgr2=0x7fcbf40c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.429+0000 7fcbfa1ba700 1 --2- 172.21.15.149:0/3695541328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbf40c5560 0x7fcbf40c59e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4007cd0 tx=0x7fcbe4013000 comp rx=0 tx=0).stop 2023-06-22T16:23:55.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.429+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/3695541328 shutdown_connections 2023-06-22T16:23:55.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.429+0000 7fcbfa1ba700 1 --2- 172.21.15.149:0/3695541328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbf40c5560 0x7fcbf40c59e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.429+0000 7fcbfa1ba700 1 --2- 172.21.15.149:0/3695541328 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbf40c87b0 0x7fcbf4156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.429+0000 7fcbfa1ba700 1 --2- 172.21.15.149:0/3695541328 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7fcbe00604b0 0x7fcbe0062960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.429+0000 7fcbfa1ba700 1 --2- 172.21.15.149:0/3695541328 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcbdc0051c0 0x7fcbf4156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.429+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/3695541328 >> 172.21.15.149:0/3695541328 conn(0x7fcbf4062990 msgr2=0x7fcbf40cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:55.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.429+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/3695541328 shutdown_connections 2023-06-22T16:23:55.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.429+0000 7fcbfa1ba700 1 -- 172.21.15.149:0/3695541328 wait complete. 2023-06-22T16:23:55.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T16:23:55.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771eae0700 1 Processor -- start 2023-06-22T16:23:55.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771eae0700 1 -- start start 2023-06-22T16:23:55.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771eae0700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7718156290 0x7f7718156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771eae0700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77180cb770 0x7f77180cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771eae0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f771806a190 0x7f771806a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771eae0700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771806b130 con 0x7f771806a190 2023-06-22T16:23:55.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771eae0700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7718156ba0 con 0x7f7718156290 2023-06-22T16:23:55.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771eae0700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771806ae50 con 0x7f77180cb770 2023-06-22T16:23:55.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771d07d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f771806a190 0x7f771806a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771d07d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f771806a190 0x7f771806a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34178/0 (socket says 172.21.15.149:34178) 2023-06-22T16:23:55.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771d07d700 1 -- 172.21.15.149:0/4235294758 learned_addr learned my addr 172.21.15.149:0/4235294758 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:55.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f7717fff700 1 --2- 172.21.15.149:0/4235294758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77180cb770 0x7f77180cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771c87c700 1 --2- 172.21.15.149:0/4235294758 >> v2:172.21.15.196:3300/0 conn(0x7f7718156290 0x7f7718156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771d07d700 1 -- 172.21.15.149:0/4235294758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77180cb770 msgr2=0x7f77180cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771d07d700 1 --2- 172.21.15.149:0/4235294758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77180cb770 0x7f77180cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771d07d700 1 -- 172.21.15.149:0/4235294758 >> v2:172.21.15.196:3300/0 conn(0x7f7718156290 msgr2=0x7f7718156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:55.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771d07d700 1 --2- 172.21.15.149:0/4235294758 >> v2:172.21.15.196:3300/0 conn(0x7f7718156290 0x7f7718156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771d07d700 1 -- 172.21.15.149:0/4235294758 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77180c9870 con 0x7f771806a190 2023-06-22T16:23:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f771d07d700 1 --2- 172.21.15.149:0/4235294758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f771806a190 0x7f771806a5f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7718069f90 tx=0x7f7710009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa19c7755c878423 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f77177fe700 1 -- 172.21.15.149:0/4235294758 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771000e070 con 0x7f771806a190 2023-06-22T16:23:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f77177fe700 1 -- 172.21.15.149:0/4235294758 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771000b970 con 0x7f771806a190 2023-06-22T16:23:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.545+0000 7f77177fe700 1 -- 172.21.15.149:0/4235294758 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77100092e0 con 0x7f771806a190 2023-06-22T16:23:55.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 -- 172.21.15.149:0/4235294758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f771806a190 msgr2=0x7f771806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 --2- 172.21.15.149:0/4235294758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f771806a190 0x7f771806a5f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7718069f90 tx=0x7f7710009840 comp rx=0 tx=0).stop 2023-06-22T16:23:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 -- 172.21.15.149:0/4235294758 shutdown_connections 2023-06-22T16:23:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 --2- 172.21.15.149:0/4235294758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f771806a190 0x7f771806a5f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 --2- 172.21.15.149:0/4235294758 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77180cb770 0x7f77180cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 --2- 172.21.15.149:0/4235294758 >> v2:172.21.15.196:3300/0 conn(0x7f7718156290 0x7f7718156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 -- 172.21.15.149:0/4235294758 >> 172.21.15.149:0/4235294758 conn(0x7f771806cdf0 msgr2=0x7f771806e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 -- 172.21.15.149:0/4235294758 shutdown_connections 2023-06-22T16:23:55.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 -- 172.21.15.149:0/4235294758 wait complete. 2023-06-22T16:23:55.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 Processor -- start 2023-06-22T16:23:55.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 -- start start 2023-06-22T16:23:55.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f771806a190 0x7f771813e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77180cb770 0x7f77180af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7718156290 0x7f77180c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771815bd30 con 0x7f771806a190 2023-06-22T16:23:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771813ed10 con 0x7f7718156290 2023-06-22T16:23:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771eae0700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771815b120 con 0x7f77180cb770 2023-06-22T16:23:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771c87c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f771806a190 0x7f771813e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771c87c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f771806a190 0x7f771813e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34188/0 (socket says 172.21.15.149:34188) 2023-06-22T16:23:55.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771c87c700 1 -- 172.21.15.149:0/257354715 learned_addr learned my addr 172.21.15.149:0/257354715 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:55.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f771d07d700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7718156290 0x7f77180c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.549+0000 7f7717fff700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77180cb770 0x7f77180af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f771c87c700 1 -- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77180cb770 msgr2=0x7f77180af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f771c87c700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77180cb770 0x7f77180af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f771c87c700 1 -- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7718156290 msgr2=0x7f77180c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f771c87c700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7718156290 0x7f77180c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f771c87c700 1 -- 172.21.15.149:0/257354715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7710009ae0 con 0x7f771806a190 2023-06-22T16:23:55.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f771c87c700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f771806a190 0x7f771813e7d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f770800e960 tx=0x7f77080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:55.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f7714ff9700 1 -- 172.21.15.149:0/257354715 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708013680 con 0x7f771806a190 2023-06-22T16:23:55.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f7714ff9700 1 -- 172.21.15.149:0/257354715 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77080137e0 con 0x7f771806a190 2023-06-22T16:23:55.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f7714ff9700 1 -- 172.21.15.149:0/257354715 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708013b80 con 0x7f771806a190 2023-06-22T16:23:55.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f771eae0700 1 -- 172.21.15.149:0/257354715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771815b400 con 0x7f771806a190 2023-06-22T16:23:55.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f771eae0700 1 -- 172.21.15.149:0/257354715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771815b9c0 con 0x7f771806a190 2023-06-22T16:23:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f771eae0700 1 -- 172.21.15.149:0/257354715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771804bc30 con 0x7f771806a190 2023-06-22T16:23:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f7714ff9700 1 -- 172.21.15.149:0/257354715 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f770800c470 con 0x7f771806a190 2023-06-22T16:23:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f7714ff9700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f76fc0604b0 0x7f76fc062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f7714ff9700 1 -- 172.21.15.149:0/257354715 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f770807c920 con 0x7f771806a190 2023-06-22T16:23:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.553+0000 7f7717fff700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f76fc0604b0 0x7f76fc062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.557+0000 7f7717fff700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f76fc0604b0 0x7f76fc062960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f771816c1c0 tx=0x7f77000091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:55.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.561+0000 7f7714ff9700 1 -- 172.21.15.149:0/257354715 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f770804ce70 con 0x7f771806a190 2023-06-22T16:23:55.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.725+0000 7f771eae0700 1 -- 172.21.15.149:0/257354715 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77180c9b50 con 0x7f771806a190 2023-06-22T16:23:55.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.725+0000 7f7714ff9700 1 -- 172.21.15.149:0/257354715 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16927 (secure 0 0 0) 0x7f7708050490 con 0x7f771806a190 2023-06-22T16:23:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-22T16:23:55.733 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":25,"fsid":"0dba7f42-2446-45e3-aae5-b3ca874cf325","created":"2023-06-22T16:23:31.621362+0000","modified":"2023-06-22T16:23:55.102659+0000","last_up_change":"2023-06-22T16:23:42.614261+0000","last_in_change":"2023-06-22T16:23:33.638142+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T16:23:43.865433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T16:23:49.572200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T16:23:53.535018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T16:23:54.096781+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"56ddaf00-fc77-44cf-b823-5bd377b92576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":32836},{"type":"v1","addr":"172.21.15.149:6809","nonce":32836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":32836},{"type":"v1","addr":"172.21.15.149:6811","nonce":32836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":32836},{"type":"v1","addr":"172.21.15.149:6816","nonce":32836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":32836},{"type":"v1","addr":"172.21.15.149:6813","nonce":32836}]},"public_addr":"172.21.15.149:6809/32836","cluster_addr":"172.21.15.149:6811/32836","heartbeat_back_addr":"172.21.15.149:6816/32836","heartbeat_front_addr":"172.21.15.149:6813/32836","state":["exists","up"]},{"osd":1,"uuid":"532f10bd-8b84-4a0b-9aed-28e7afb4a863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":32835},{"type":"v1","addr":"172.21.15.149:6817","nonce":32835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":32835},{"type":"v1","addr":"172.21.15.149:6819","nonce":32835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":32835},{"type":"v1","addr":"172.21.15.149:6823","nonce":32835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":32835},{"type":"v1","addr":"172.21.15.149:6821","nonce":32835}]},"public_addr":"172.21.15.149:6817/32835","cluster_addr":"172.21.15.149:6819/32835","heartbeat_back_addr":"172.21.15.149:6823/32835","heartbeat_front_addr":"172.21.15.149:6821/32835","state":["exists","up"]},{"osd":2,"uuid":"bc3c458c-c810-4c5a-b258-2de1cb3ca1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":32837},{"type":"v1","addr":"172.21.15.149:6825","nonce":32837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":32837},{"type":"v1","addr":"172.21.15.149:6827","nonce":32837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":32837},{"type":"v1","addr":"172.21.15.149:6831","nonce":32837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":32837},{"type":"v1","addr":"172.21.15.149:6829","nonce":32837}]},"public_addr":"172.21.15.149:6825/32837","cluster_addr":"172.21.15.149:6827/32837","heartbeat_back_addr":"172.21.15.149:6831/32837","heartbeat_front_addr":"172.21.15.149:6829/32837","state":["exists","up"]},{"osd":3,"uuid":"04bf7f65-1946-499c-aea9-c4caa92e8488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":32834},{"type":"v1","addr":"172.21.15.149:6801","nonce":32834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":32834},{"type":"v1","addr":"172.21.15.149:6803","nonce":32834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":32834},{"type":"v1","addr":"172.21.15.149:6807","nonce":32834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":32834},{"type":"v1","addr":"172.21.15.149:6805","nonce":32834}]},"public_addr":"172.21.15.149:6801/32834","cluster_addr":"172.21.15.149:6803/32834","heartbeat_back_addr":"172.21.15.149:6807/32834","heartbeat_front_addr":"172.21.15.149:6805/32834","state":["exists","up"]},{"osd":4,"uuid":"e49f385d-76d9-4304-8486-3e1f3cb8fd23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":33055},{"type":"v1","addr":"172.21.15.196:6809","nonce":33055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":33055},{"type":"v1","addr":"172.21.15.196:6811","nonce":33055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":33055},{"type":"v1","addr":"172.21.15.196:6815","nonce":33055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":33055},{"type":"v1","addr":"172.21.15.196:6813","nonce":33055}]},"public_addr":"172.21.15.196:6809/33055","cluster_addr":"172.21.15.196:6811/33055","heartbeat_back_addr":"172.21.15.196:6815/33055","heartbeat_front_addr":"172.21.15.196:6813/33055","state":["exists","up"]},{"osd":5,"uuid":"671a4069-7c86-4a14-825c-1179a74928c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":33057},{"type":"v1","addr":"172.21.15.196:6825","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":33057},{"type":"v1","addr":"172.21.15.196:6827","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":33057},{"type":"v1","addr":"172.21.15.196:6831","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":33057},{"type":"v1","addr":"172.21.15.196:6829","nonce":33057}]},"public_addr":"172.21.15.196:6825/33057","cluster_addr":"172.21.15.196:6827/33057","heartbeat_back_addr":"172.21.15.196:6831/33057","heartbeat_front_addr":"172.21.15.196:6829/33057","state":["exists","up"]},{"osd":6,"uuid":"7114b0c3-27fe-4816-8cc8-fb3679b8e707","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":33054},{"type":"v1","addr":"172.21.15.196:6801","nonce":33054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":33054},{"type":"v1","addr":"172.21.15.196:6803","nonce":33054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":33054},{"type":"v1","addr":"172.21.15.196:6807","nonce":33054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":33054},{"type":"v1","addr":"172.21.15.196:6805","nonce":33054}]},"public_addr":"172.21.15.196:6801/33054","cluster_addr":"172.21.15.196:6803/33054","heartbeat_back_addr":"172.21.15.196:6807/33054","heartbeat_front_addr":"172.21.15.196:6805/33054","state":["exists","up"]},{"osd":7,"uuid":"f9e6e633-0952-40bf-97e6-7c8b0bc804bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":33058},{"type":"v1","addr":"172.21.15.196:6817","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":33058},{"type":"v1","addr":"172.21.15.196:6819","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":33058},{"type":"v1","addr":"172.21.15.196:6823","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":33058},{"type":"v1","addr":"172.21.15.196:6821","nonce":33058}]},"public_addr":"172.21.15.196:6817/33058","cluster_addr":"172.21.15.196:6819/33058","heartbeat_back_addr":"172.21.15.196:6823/33058","heartbeat_front_addr":"172.21.15.196:6821/33058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.838753+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.877504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.932235+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.898286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.697196+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:39.163122+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.820624+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T16:23:38.902436+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T16:23:55.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.729+0000 7f771eae0700 1 -- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f76fc0604b0 msgr2=0x7f76fc062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.729+0000 7f771eae0700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f76fc0604b0 0x7f76fc062960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f771816c1c0 tx=0x7f77000091a0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.729+0000 7f771eae0700 1 -- 172.21.15.149:0/257354715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f771806a190 msgr2=0x7f771813e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.729+0000 7f771eae0700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f771806a190 0x7f771813e7d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f770800e960 tx=0x7f77080091a0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.729+0000 7f771eae0700 1 -- 172.21.15.149:0/257354715 shutdown_connections 2023-06-22T16:23:55.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.729+0000 7f771eae0700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7718156290 0x7f77180c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.729+0000 7f771eae0700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f76fc0604b0 0x7f76fc062960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.729+0000 7f771eae0700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77180cb770 0x7f77180af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.729+0000 7f771eae0700 1 --2- 172.21.15.149:0/257354715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f771806a190 0x7f771813e7d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.729+0000 7f771eae0700 1 -- 172.21.15.149:0/257354715 >> 172.21.15.149:0/257354715 conn(0x7f771806cdf0 msgr2=0x7f771814f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:55.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.729+0000 7f771eae0700 1 -- 172.21.15.149:0/257354715 shutdown_connections 2023-06-22T16:23:55.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.729+0000 7f771eae0700 1 -- 172.21.15.149:0/257354715 wait complete. 2023-06-22T16:23:55.748 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-22T16:23:55.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.845+0000 7f69a738c700 1 Processor -- start 2023-06-22T16:23:55.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.845+0000 7f69a738c700 1 -- start start 2023-06-22T16:23:55.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a738c700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f69a0158b90 0x7f69a006daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a738c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69a00c8140 0x7f69a00681c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a738c700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a00c91a0 con 0x7f69a0158f60 2023-06-22T16:23:55.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a738c700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a006f050 con 0x7f69a0158b90 2023-06-22T16:23:55.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a738c700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a006f4e0 con 0x7f69a00c8140 2023-06-22T16:23:55.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a5b89700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69a00c8140 0x7f69a00681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a638a700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f69a0158b90 0x7f69a006daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a5b89700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69a00c8140 0x7f69a00681c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.149:55588/0 (socket says 172.21.15.149:55588) 2023-06-22T16:23:55.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a5b89700 1 -- 172.21.15.149:0/3070399104 learned_addr learned my addr 172.21.15.149:0/3070399104 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:55.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a6b8b700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f69a0158f60 0x7f69a0069b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.149:51656/0 (socket says 172.21.15.149:51656) 2023-06-22T16:23:55.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a5388700 1 -- 172.21.15.149:0/3070399104 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272369996 0 0) 0x7f69a00c91a0 con 0x7f69a0158f60 2023-06-22T16:23:55.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a5388700 1 -- 172.21.15.149:0/3070399104 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f698c003570 con 0x7f69a0158f60 2023-06-22T16:23:55.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a5b89700 1 -- 172.21.15.149:0/3070399104 >> v2:172.21.15.196:3300/0 conn(0x7f69a0158b90 msgr2=0x7f69a006daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:55.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a5b89700 1 --2- 172.21.15.149:0/3070399104 >> v2:172.21.15.196:3300/0 conn(0x7f69a0158b90 0x7f69a006daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a5b89700 1 -- 172.21.15.149:0/3070399104 >> v1:172.21.15.196:6789/0 conn(0x7f69a0158f60 legacy=0x7f69a0069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a5b89700 1 -- 172.21.15.149:0/3070399104 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a006e440 con 0x7f69a00c8140 2023-06-22T16:23:55.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a638a700 1 --2- 172.21.15.149:0/3070399104 >> v2:172.21.15.196:3300/0 conn(0x7f69a0158b90 0x7f69a006daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T16:23:55.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a5b89700 1 --2- 172.21.15.149:0/3070399104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69a00c8140 0x7f69a00681c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f69900099b0 tx=0x7f6990009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2ea6bb52ce38608 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:55.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a5388700 1 -- 172.21.15.149:0/3070399104 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699000b680 con 0x7f69a00c8140 2023-06-22T16:23:55.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a5388700 1 -- 172.21.15.149:0/3070399104 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699000b7e0 con 0x7f69a00c8140 2023-06-22T16:23:55.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a5388700 1 -- 172.21.15.149:0/3070399104 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699000bb80 con 0x7f69a00c8140 2023-06-22T16:23:55.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a738c700 1 -- 172.21.15.149:0/3070399104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69a00c8140 msgr2=0x7f69a00681c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a738c700 1 --2- 172.21.15.149:0/3070399104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69a00c8140 0x7f69a00681c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f69900099b0 tx=0x7f6990009250 comp rx=0 tx=0).stop 2023-06-22T16:23:55.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a738c700 1 -- 172.21.15.149:0/3070399104 shutdown_connections 2023-06-22T16:23:55.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a738c700 1 --2- 172.21.15.149:0/3070399104 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69a00c8140 0x7f69a00681c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a738c700 1 --2- 172.21.15.149:0/3070399104 >> v2:172.21.15.196:3300/0 conn(0x7f69a0158b90 0x7f69a006daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.849+0000 7f69a738c700 1 -- 172.21.15.149:0/3070399104 >> 172.21.15.149:0/3070399104 conn(0x7f69a006ce50 msgr2=0x7f69a00cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:55.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a738c700 1 -- 172.21.15.149:0/3070399104 shutdown_connections 2023-06-22T16:23:55.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a738c700 1 -- 172.21.15.149:0/3070399104 wait complete. 2023-06-22T16:23:55.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a738c700 1 Processor -- start 2023-06-22T16:23:55.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a738c700 1 -- start start 2023-06-22T16:23:55.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a738c700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69a00c8140 0x7f69a0169740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a738c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69a0158b90 0x7f69a0156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a738c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69a0158f60 0x7f69a00c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a738c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a00c1180 con 0x7f69a0158f60 2023-06-22T16:23:55.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a738c700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a00c1fe0 con 0x7f69a0158b90 2023-06-22T16:23:55.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a738c700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a00c6eb0 con 0x7f69a00c8140 2023-06-22T16:23:55.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a6b8b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69a0158f60 0x7f69a00c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a6b8b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69a0158f60 0x7f69a00c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34194/0 (socket says 172.21.15.149:34194) 2023-06-22T16:23:55.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a6b8b700 1 -- 172.21.15.149:0/2053046086 learned_addr learned my addr 172.21.15.149:0/2053046086 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:55.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a5b89700 1 --2- 172.21.15.149:0/2053046086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69a0158b90 0x7f69a0156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a638a700 1 --2- 172.21.15.149:0/2053046086 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69a00c8140 0x7f69a0169740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a6b8b700 1 -- 172.21.15.149:0/2053046086 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69a00c8140 msgr2=0x7f69a0169740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a6b8b700 1 --2- 172.21.15.149:0/2053046086 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69a00c8140 0x7f69a0169740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a6b8b700 1 -- 172.21.15.149:0/2053046086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69a0158b90 msgr2=0x7f69a0156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:55.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a6b8b700 1 --2- 172.21.15.149:0/2053046086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69a0158b90 0x7f69a0156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:55.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.853+0000 7f69a6b8b700 1 -- 172.21.15.149:0/2053046086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c009420 con 0x7f69a0158f60 2023-06-22T16:23:55.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.857+0000 7f69a6b8b700 1 --2- 172.21.15.149:0/2053046086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69a0158f60 0x7f69a00c5490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f699800cd60 tx=0x7f6998001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:55.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.857+0000 7f69967fc700 1 -- 172.21.15.149:0/2053046086 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699800ce60 con 0x7f69a0158f60 2023-06-22T16:23:55.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.857+0000 7f69967fc700 1 -- 172.21.15.149:0/2053046086 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6998005df0 con 0x7f69a0158f60 2023-06-22T16:23:55.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.857+0000 7f69a738c700 1 -- 172.21.15.149:0/2053046086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69900094f0 con 0x7f69a0158f60 2023-06-22T16:23:55.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.857+0000 7f69967fc700 1 -- 172.21.15.149:0/2053046086 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699800aa80 con 0x7f69a0158f60 2023-06-22T16:23:55.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.857+0000 7f69a738c700 1 -- 172.21.15.149:0/2053046086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a00c16b0 con 0x7f69a0158f60 2023-06-22T16:23:55.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.857+0000 7f69a738c700 1 -- 172.21.15.149:0/2053046086 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a00c2170 con 0x7f69a0158f60 2023-06-22T16:23:55.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.857+0000 7f69967fc700 1 -- 172.21.15.149:0/2053046086 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f69980070f0 con 0x7f69a0158f60 2023-06-22T16:23:55.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.857+0000 7f69967fc700 1 --2- 172.21.15.149:0/2053046086 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f69840604e0 0x7f6984062990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:55.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.861+0000 7f69967fc700 1 -- 172.21.15.149:0/2053046086 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f699807c7f0 con 0x7f69a0158f60 2023-06-22T16:23:55.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.861+0000 7f69a638a700 1 --2- 172.21.15.149:0/2053046086 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f69840604e0 0x7f6984062990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:55.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.861+0000 7f69a638a700 1 --2- 172.21.15.149:0/2053046086 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f69840604e0 0x7f6984062990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f699c009f40 tx=0x7f699c0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:55.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:55.865+0000 7f69967fc700 1 -- 172.21.15.149:0/2053046086 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f699804cdc0 con 0x7f69a0158f60 2023-06-22T16:23:56.071 INFO:teuthology.orchestra.run.smithi149.stderr:no valid command found; 1 closest matches: 2023-06-22T16:23:56.071 INFO:teuthology.orchestra.run.smithi149.stderr:fs set |refuse_client_session|max_xattr_size [--yes-i-really-mean-it] [--yes-i-really-really-mean-it] 2023-06-22T16:23:56.071 INFO:teuthology.orchestra.run.smithi149.stderr:Error EINVAL: invalid command 2023-06-22T16:23:56.074 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-06-22T16:23:56.075 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-22T16:23:56.075 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-22T16:23:56.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.173+0000 7f7204c96700 1 Processor -- start 2023-06-22T16:23:56.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.173+0000 7f7204c96700 1 -- start start 2023-06-22T16:23:56.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f7204c96700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7200156780 0x7f7200156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:56.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f7204c96700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7200068fc0 0x7f720006c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:56.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f7204c96700 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720015a500 con 0x7f7200068b40 2023-06-22T16:23:56.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f7204c96700 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72001598f0 con 0x7f7200156780 2023-06-22T16:23:56.184 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f7204c96700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7200159bd0 con 0x7f7200068fc0 2023-06-22T16:23:56.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f71ff7fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7200156780 0x7f7200156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:56.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f71fffff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7200068fc0 0x7f720006c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:56.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f71f7fff700 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f7200068b40 0x7f72000c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.149:51662/0 (socket says 172.21.15.149:51662) 2023-06-22T16:23:56.185 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f71fffff700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7200068fc0 0x7f720006c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.149:55606/0 (socket says 172.21.15.149:55606) 2023-06-22T16:23:56.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f71f7fff700 1 -- 172.21.15.149:0/4255271594 learned_addr learned my addr 172.21.15.149:0/4255271594 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-22T16:23:56.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f71ff7fe700 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7200156780 0x7f7200156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.149:49352/0 (socket says 172.21.15.149:49352) 2023-06-22T16:23:56.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f71ff7fe700 1 -- 172.21.15.149:0/4255271594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7200068fc0 msgr2=0x7f720006c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T16:23:56.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f71ff7fe700 1 --2- 172.21.15.149:0/4255271594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7200068fc0 0x7f720006c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:56.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f71ff7fe700 1 -- 172.21.15.149:0/4255271594 >> v1:172.21.15.196:6789/0 conn(0x7f7200068b40 legacy=0x7f72000c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:56.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f71feffd700 1 -- 172.21.15.149:0/4255271594 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534264179 0 0) 0x7f720015a500 con 0x7f7200068b40 2023-06-22T16:23:56.186 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f71ff7fe700 1 -- 172.21.15.149:0/4255271594 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200159eb0 con 0x7f7200156780 2023-06-22T16:23:56.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.177+0000 7f71ff7fe700 1 --2- 172.21.15.149:0/4255271594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200156780 0x7f7200156b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f71f00098e0 tx=0x7f71f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f56319aca4cc7f34 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:56.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.181+0000 7f71feffd700 1 -- 172.21.15.149:0/4255271594 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f000b640 con 0x7f7200156780 2023-06-22T16:23:56.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.181+0000 7f71feffd700 1 -- 172.21.15.149:0/4255271594 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f000b7a0 con 0x7f7200156780 2023-06-22T16:23:56.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.181+0000 7f71feffd700 1 -- 172.21.15.149:0/4255271594 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f000bb40 con 0x7f7200156780 2023-06-22T16:23:56.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.181+0000 7f7204c96700 1 -- 172.21.15.149:0/4255271594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200156780 msgr2=0x7f7200156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:56.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.181+0000 7f7204c96700 1 --2- 172.21.15.149:0/4255271594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200156780 0x7f7200156b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f71f00098e0 tx=0x7f71f00091a0 comp rx=0 tx=0).stop 2023-06-22T16:23:56.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.181+0000 7f7204c96700 1 -- 172.21.15.149:0/4255271594 shutdown_connections 2023-06-22T16:23:56.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.181+0000 7f7204c96700 1 --2- 172.21.15.149:0/4255271594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7200068fc0 0x7f720006c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:56.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.181+0000 7f7204c96700 1 --2- 172.21.15.149:0/4255271594 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200156780 0x7f7200156b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:56.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.181+0000 7f7204c96700 1 -- 172.21.15.149:0/4255271594 >> 172.21.15.149:0/4255271594 conn(0x7f72000c8bb0 msgr2=0x7f72000c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T16:23:56.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.181+0000 7f7204c96700 1 -- 172.21.15.149:0/4255271594 shutdown_connections 2023-06-22T16:23:56.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.181+0000 7f7204c96700 1 -- 172.21.15.149:0/4255271594 wait complete. 2023-06-22T16:23:56.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.181+0000 7f7204c96700 1 Processor -- start 2023-06-22T16:23:56.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.181+0000 7f7204c96700 1 -- start start 2023-06-22T16:23:56.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f7204c96700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200068b40 0x7f72000b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:56.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f7204c96700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7200068fc0 0x7f7200154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:56.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f7204c96700 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7200156780 0x7f72000affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:56.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f7204c96700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72000b1520 con 0x7f7200068fc0 2023-06-22T16:23:56.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f7204c96700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72000b0910 con 0x7f7200068b40 2023-06-22T16:23:56.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f7204c96700 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72000b0bf0 con 0x7f7200156780 2023-06-22T16:23:56.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71f7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7200068fc0 0x7f7200154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:56.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71ff7fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200068b40 0x7f72000b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:56.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71f7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7200068fc0 0x7f7200154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:34198/0 (socket says 172.21.15.149:34198) 2023-06-22T16:23:56.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71f7fff700 1 -- 172.21.15.149:0/387944867 learned_addr learned my addr 172.21.15.149:0/387944867 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-22T16:23:56.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71fffff700 1 --2- 172.21.15.149:0/387944867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7200156780 0x7f72000affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:56.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71f7fff700 1 -- 172.21.15.149:0/387944867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7200156780 msgr2=0x7f72000affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:56.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71f7fff700 1 --2- 172.21.15.149:0/387944867 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7200156780 0x7f72000affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:56.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71f7fff700 1 -- 172.21.15.149:0/387944867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200068b40 msgr2=0x7f72000b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T16:23:56.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71f7fff700 1 --2- 172.21.15.149:0/387944867 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7200068b40 0x7f72000b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T16:23:56.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71f7fff700 1 -- 172.21.15.149:0/387944867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f0009420 con 0x7f7200068fc0 2023-06-22T16:23:56.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71f7fff700 1 --2- 172.21.15.149:0/387944867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7200068fc0 0x7f7200154640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c7e0 tx=0x7f71e8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:56.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71f77fe700 1 -- 172.21.15.149:0/387944867 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8005b30 con 0x7f7200068fc0 2023-06-22T16:23:56.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71f77fe700 1 -- 172.21.15.149:0/387944867 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e8005c90 con 0x7f7200068fc0 2023-06-22T16:23:56.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f7204c96700 1 -- 172.21.15.149:0/387944867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72000b0ed0 con 0x7f7200068fc0 2023-06-22T16:23:56.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f71f77fe700 1 -- 172.21.15.149:0/387944867 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8007300 con 0x7f7200068fc0 2023-06-22T16:23:56.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f7204c96700 1 -- 172.21.15.149:0/387944867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7200154b80 con 0x7f7200068fc0 2023-06-22T16:23:56.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.185+0000 7f7204c96700 1 -- 172.21.15.149:0/387944867 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72000694c0 con 0x7f7200068fc0 2023-06-22T16:23:56.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.189+0000 7f71f77fe700 1 -- 172.21.15.149:0/387944867 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f71e801b3b0 con 0x7f7200068fc0 2023-06-22T16:23:56.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.189+0000 7f71f77fe700 1 --2- 172.21.15.149:0/387944867 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f71e00604e0 0x7f71e0062990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T16:23:56.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.189+0000 7f71f77fe700 1 -- 172.21.15.149:0/387944867 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f71e807bcc0 con 0x7f7200068fc0 2023-06-22T16:23:56.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.189+0000 7f71ff7fe700 1 --2- 172.21.15.149:0/387944867 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f71e00604e0 0x7f71e0062990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T16:23:56.196 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.189+0000 7f71ff7fe700 1 --2- 172.21.15.149:0/387944867 >> [v2:172.21.15.196:6832/32718,v1:172.21.15.196:6833/32718] conn(0x7f71e00604e0 0x7f71e0062990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f71f00091e0 tx=0x7f71f0017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T16:23:56.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-22T16:23:56.193+0000 7f71f77fe700 1 -- 172.21.15.149:0/387944867 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f71e804c210 con 0x7f7200068fc0 2023-06-22T16:23:56.397 INFO:teuthology.orchestra.run.smithi149.stderr:no valid command found; 1 closest matches: 2023-06-22T16:23:56.397 INFO:teuthology.orchestra.run.smithi149.stderr:fs set |refuse_client_session|max_xattr_size [--yes-i-really-mean-it] [--yes-i-really-really-mean-it] 2023-06-22T16:23:56.397 INFO:teuthology.orchestra.run.smithi149.stderr:Error EINVAL: invalid command 2023-06-22T16:23:56.401 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-06-22T16:23:56.402 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 450, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 514, in __init__ self.create() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 717, in create self.set_allow_standby_replay(standby_replay) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 589, in set_allow_standby_replay self.set_var("allow_standby_replay", yes) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 574, in set_var self.mon_manager.raw_cluster_cmd("fs", "set", self.name, var, *a) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi149 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false' 2023-06-22T16:23:56.403 INFO:teuthology.misc:Shutting down mds daemons... 2023-06-22T16:23:56.403 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-22T16:23:56.403 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:56.415 INFO:tasks.ceph.mds.a:Stopped 2023-06-22T16:23:56.416 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-22T16:23:56.416 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:56.430 INFO:tasks.ceph.mds.c:Stopped 2023-06-22T16:23:56.430 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-22T16:23:56.430 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:56.445 INFO:tasks.ceph.mds.b:Stopped 2023-06-22T16:23:56.446 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-22T16:23:56.446 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:56.460 INFO:tasks.ceph.mds.d:Stopped 2023-06-22T16:23:56.461 INFO:teuthology.misc:Shutting down osd daemons... 2023-06-22T16:23:56.461 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-06-22T16:23:56.462 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:56.548 INFO:tasks.ceph.osd.0:Stopped 2023-06-22T16:23:56.549 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-06-22T16:23:56.549 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:56.620 INFO:tasks.ceph.osd.1:Stopped 2023-06-22T16:23:56.620 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-06-22T16:23:56.621 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:56.681 INFO:tasks.ceph.osd.2:Stopped 2023-06-22T16:23:56.682 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-06-22T16:23:56.682 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:56.751 INFO:tasks.ceph.osd.3:Stopped 2023-06-22T16:23:56.752 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-06-22T16:23:56.752 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:56.823 INFO:tasks.ceph.osd.4:Stopped 2023-06-22T16:23:56.824 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-06-22T16:23:56.824 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:56.890 INFO:tasks.ceph.osd.5:Stopped 2023-06-22T16:23:56.891 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-06-22T16:23:56.891 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:56.960 INFO:tasks.ceph.osd.6:Stopped 2023-06-22T16:23:56.960 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-06-22T16:23:56.961 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:57.041 INFO:tasks.ceph.osd.7:Stopped 2023-06-22T16:23:57.042 INFO:teuthology.misc:Shutting down mgr daemons... 2023-06-22T16:23:57.042 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-06-22T16:23:57.043 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:57.070 INFO:tasks.ceph.mgr.y:Stopped 2023-06-22T16:23:57.071 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-06-22T16:23:57.071 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:57.101 INFO:tasks.ceph.mgr.x:Stopped 2023-06-22T16:23:57.102 INFO:teuthology.misc:Shutting down mon daemons... 2023-06-22T16:23:57.102 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-06-22T16:23:57.103 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:57.134 INFO:tasks.ceph.mon.a:Stopped 2023-06-22T16:23:57.135 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-06-22T16:23:57.135 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:57.153 INFO:tasks.ceph.mon.b:Stopped 2023-06-22T16:23:57.154 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-06-22T16:23:57.154 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T16:23:57.214 INFO:tasks.ceph.mon.c:Stopped 2023-06-22T16:23:57.215 INFO:tasks.ceph:Checking cluster log for badness... 2023-06-22T16:23:57.215 DEBUG:teuthology.orchestra.run.smithi149:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-06-22T16:23:57.236 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-22T16:23:57.237 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-06-22T16:23:57.624 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-22T16:23:57.624 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-06-22T16:23:57.843 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-22T16:23:57.843 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-06-22T16:23:58.003 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-22T16:23:58.004 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-06-22T16:23:58.193 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi196.front.sepia.ceph.com 2023-06-22T16:23:58.193 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-06-22T16:23:58.587 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi196.front.sepia.ceph.com 2023-06-22T16:23:58.587 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-06-22T16:23:58.830 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi196.front.sepia.ceph.com 2023-06-22T16:23:58.831 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-06-22T16:23:59.033 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi196.front.sepia.ceph.com 2023-06-22T16:23:59.033 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-06-22T16:23:59.223 INFO:tasks.ceph:Archiving mon data... 2023-06-22T16:23:59.225 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787/data/mon.a.tgz 2023-06-22T16:23:59.225 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2023-06-22T16:23:59.232 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.eEJPGUdYpB 2023-06-22T16:23:59.232 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.eEJPGUdYpB 2023-06-22T16:23:59.330 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.eEJPGUdYpB 2023-06-22T16:23:59.357 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.eEJPGUdYpB is 203KB 2023-06-22T16:23:59.371 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.eEJPGUdYpB 2023-06-22T16:23:59.378 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787/data/mon.b.tgz 2023-06-22T16:23:59.378 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2023-06-22T16:23:59.385 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.sMWSHHXGgY 2023-06-22T16:23:59.385 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.sMWSHHXGgY 2023-06-22T16:23:59.500 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.sMWSHHXGgY 2023-06-22T16:23:59.525 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.sMWSHHXGgY is 279KB 2023-06-22T16:23:59.582 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.sMWSHHXGgY 2023-06-22T16:23:59.589 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787/data/mon.c.tgz 2023-06-22T16:23:59.589 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2023-06-22T16:23:59.595 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.CGmRULFyGu 2023-06-22T16:23:59.596 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.CGmRULFyGu 2023-06-22T16:23:59.664 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.CGmRULFyGu 2023-06-22T16:23:59.688 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.CGmRULFyGu is 282KB 2023-06-22T16:23:59.750 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.CGmRULFyGu 2023-06-22T16:23:59.757 INFO:tasks.ceph:Cleaning ceph cluster... 2023-06-22T16:23:59.757 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-22T16:23:59.760 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-22T16:23:59.775 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-06-22T16:23:59.776 DEBUG:teuthology.orchestra.run.smithi149:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-22T16:23:59.778 DEBUG:teuthology.orchestra.run.smithi196:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-22T16:23:59.814 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-22T16:23:59.842 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-22T16:23:59.848 INFO:tasks.ceph:Archiving crash dumps... 2023-06-22T16:23:59.850 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787/remote/smithi149/crash 2023-06-22T16:23:59.852 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-22T16:23:59.871 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787/remote/smithi196/crash 2023-06-22T16:23:59.872 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-22T16:23:59.887 INFO:tasks.ceph:Shutting down logrotate 2023-06-22T16:23:59.888 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:23:59.919 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:23:59.968 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-22T16:23:59.982 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-22T16:23:59.998 INFO:tasks.ceph:Compressing logs... 2023-06-22T16:23:59.999 DEBUG:teuthology.orchestra.run.smithi149:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-22T16:24:00.027 DEBUG:teuthology.orchestra.run.smithi196:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-22T16:24:00.297 INFO:tasks.ceph:Archiving logs... 2023-06-22T16:24:00.298 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787/remote/smithi149/log 2023-06-22T16:24:00.299 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-22T16:24:00.360 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787/remote/smithi196/log 2023-06-22T16:24:00.362 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-22T16:24:00.416 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 1893, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 450, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 514, in __init__ self.create() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 717, in create self.set_allow_standby_replay(standby_replay) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 589, in set_allow_standby_replay self.set_var("allow_standby_replay", yes) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 574, in set_var self.mon_manager.raw_cluster_cmd("fs", "set", self.name, var, *a) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi149 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false' 2023-06-22T16:24:00.497 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=083d6916174140d9ac9fe2b97eb2daf2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 1893, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 450, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 514, in __init__ self.create() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 717, in create self.set_allow_standby_replay(standby_replay) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 589, in set_allow_standby_replay self.set_var("allow_standby_replay", yes) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 574, in set_var self.mon_manager.raw_cluster_cmd("fs", "set", self.name, var, *a) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi149 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false' 2023-06-22T16:24:00.503 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-06-22T16:24:00.520 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-06-22T16:24:00.536 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-06-22T16:24:00.537 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-22T16:24:00.549 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-22T16:24:00.627 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-06-22T16:24:00.637 INFO:teuthology.task.clock:Checking final clock skew... 2023-06-22T16:24:00.637 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-22T16:24:00.640 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-22T16:24:00.660 INFO:teuthology.orchestra.run.smithi149.stdout: remote refid st t when poll reach delay offset jitter 2023-06-22T16:24:00.660 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================== 2023-06-22T16:24:00.660 INFO:teuthology.orchestra.run.smithi149.stdout:*hv01.front.sepi 44.4.53.2 2 u 38 64 17 0.090 1.372 0.357 2023-06-22T16:24:00.661 INFO:teuthology.orchestra.run.smithi149.stdout:+hv02.front.sepi 63.231.80.2 3 u 39 64 17 0.080 3.967 0.357 2023-06-22T16:24:00.661 INFO:teuthology.orchestra.run.smithi149.stdout: hv03.front.sepi 74.6.168.72 3 u 35 64 17 0.090 0.193 0.149 2023-06-22T16:24:00.661 INFO:teuthology.orchestra.run.smithi149.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-22T16:24:00.662 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2023-06-22T16:24:00.662 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2023-06-22T16:24:00.663 INFO:teuthology.orchestra.run.smithi196.stdout:*hv01.front.sepi 44.4.53.2 2 u 39 64 17 0.135 1.082 0.431 2023-06-22T16:24:00.663 INFO:teuthology.orchestra.run.smithi196.stdout: hv02.front.sepi 63.231.80.2 3 u 35 64 17 0.119 3.640 0.119 2023-06-22T16:24:00.663 INFO:teuthology.orchestra.run.smithi196.stdout: hv03.front.sepi 74.6.168.72 3 u 36 64 17 0.135 0.102 0.068 2023-06-22T16:24:00.663 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-22T16:24:00.664 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-06-22T16:24:00.677 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-06-22T16:24:00.678 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-06-22T16:24:00.690 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-06-22T16:24:00.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-06-22T16:24:00.724 INFO:teuthology.task.internal:Duration was 597.155017 seconds 2023-06-22T16:24:00.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-06-22T16:24:00.738 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-06-22T16:24:00.738 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-22T16:24:00.741 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-22T16:24:00.791 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-06-22T16:24:00.792 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2023-06-22T16:24:00.792 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-22T16:24:00.802 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2023-06-22T16:24:00.802 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-22T16:24:00.814 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-06-22T16:24:00.814 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-22T16:24:00.817 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-22T16:24:00.885 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-06-22T16:24:00.886 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-22T16:24:00.889 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-22T16:24:00.952 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-06-22T16:24:00.968 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-06-22T16:24:00.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-22T16:24:00.986 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-22T16:24:01.002 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-06-22T16:24:01.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-22T16:24:01.016 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-22T16:24:01.028 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2023-06-22T16:24:01.059 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2023-06-22T16:24:01.089 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-22T16:24:01.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T16:24:01.108 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-22T16:24:01.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T16:24:01.114 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-06-22T16:24:01.123 INFO:teuthology.task.internal:Transferring archived files... 2023-06-22T16:24:01.124 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787/remote/smithi149 2023-06-22T16:24:01.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-22T16:24:01.153 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787/remote/smithi196 2023-06-22T16:24:01.153 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-22T16:24:01.184 INFO:teuthology.task.internal:Removing archive directory... 2023-06-22T16:24:01.184 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-22T16:24:01.186 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-22T16:24:01.234 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-06-22T16:24:01.245 INFO:teuthology.task.internal:Not uploading archives. 2023-06-22T16:24:01.246 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-06-22T16:24:01.255 INFO:teuthology.task.internal:Tidying up after the test... 2023-06-22T16:24:01.256 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-22T16:24:01.259 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-22T16:24:01.264 INFO:teuthology.orchestra.run.smithi149.stdout: 924113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 22 16:24 /home/ubuntu/cephtest 2023-06-22T16:24:01.267 INFO:teuthology.orchestra.run.smithi196.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 22 16:24 /home/ubuntu/cephtest 2023-06-22T16:24:01.269 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-06-22T16:24:01.280 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-06-22T16:24:01.306 INFO:teuthology.nuke:Checking targets against current locks 2023-06-22T16:24:01.335 DEBUG:teuthology.nuke:shortname: smithi149 2023-06-22T16:24:01.336 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T16:24:01.361 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 16:02:27.303590', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-22T16:24:01.364 DEBUG:teuthology.nuke:shortname: smithi196 2023-06-22T16:24:01.365 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T16:24:01.392 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311787', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 16:02:27.305836', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-22T16:24:01.420 INFO:teuthology.orchestra.console:Power off smithi149 2023-06-22T16:24:01.421 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T16:24:01.444 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T16:24:01.465 INFO:teuthology.orchestra.console:Power off smithi196 2023-06-22T16:24:01.466 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T16:24:01.490 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T16:24:05.478 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T16:24:05.514 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T16:24:09.593 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T16:24:09.627 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T16:24:09.806 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-06-22T16:24:13.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T16:24:13.957 INFO:teuthology.orchestra.console:Power off for smithi196 completed 2023-06-22T16:24:14.062 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} duration: 597.1550168991089 failure_reason: 'Command failed on smithi149 with status 22: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=083d6916174140d9ac9fe2b97eb2daf2 status: fail success: false 2023-06-22T16:24:14.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T16:24:14.142 INFO:teuthology.run:FAIL