2021-10-17T15:27:26.930 INFO:root:teuthology version: 1.1.0-b35344e8 2021-10-17T15:27:26.932 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2021-10-17_15:08:49-fs-wip-yuri2-testing-2021-10-15-1332-pacific-distro-basic-smithi --verbose --archive /home/teuthworker/archive/yuriw-2021-10-17_15:08:49-fs-wip-yuri2-testing-2021-10-15-1332-pacific-distro-basic-smithi/6447604 --description fs/bugs/client_trim_caps/{begin centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/trim-i24137} -- /home/teuthworker/archive/yuriw-2021-10-17_15:08:49-fs-wip-yuri2-testing-2021-10-15-1332-pacific-distro-basic-smithi/6447604/orig.config.yaml 2021-10-17T15:27:26.980 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-10-17T15:27:27.039 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-10-17_15:08:49-fs-wip-yuri2-testing-2021-10-15-1332-pacific-distro-basic-smithi/6447604 branch: wip-yuri2-testing-2021-10-15-1332-pacific description: fs/bugs/client_trim_caps/{begin centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/trim-i24137} email: ceph-qa@ceph.io first_in_suite: false job_id: '6447604' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2021-10-17_15:08:49-fs-wip-yuri2-testing-2021-10-15-1332-pacific-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 2 size: 10 - machine: disk: 100 os_type: centos os_version: '8.2' overrides: admin_socket: branch: wip-yuri2-testing-2021-10-15-1332-pacific ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 15f9519d2bb8c31d5d6afe04bfbd467cba5da03f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 15f9519d2bb8c31d5d6afe04bfbd467cba5da03f selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2021-10-15-1332-pacific sha1: 15f9519d2bb8c31d5d6afe04bfbd467cba5da03f owner: scheduled_yuriw@teuthology priority: 79 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - mds.a - mds.b - client.0 sha1: 15f9519d2bb8c31d5d6afe04bfbd467cba5da03f sleep_before_teardown: 0 suite: fs suite_branch: wip-yuri2-testing-2021-10-15-1332-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_15f9519d2bb8c31d5d6afe04bfbd467cba5da03f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 15f9519d2bb8c31d5d6afe04bfbd467cba5da03f targets: smithi119.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv3ShYNoksgtWGMqh1sW2GQycS4KeMmwM2MDjIdwScsYH2HAL+TQOeeSNMYP2kO5sA8oUe6cAywtDvNvurwNRvqq0YdYV04sxVj8baCKSFmI7UeXLsJjZnljmA+U6SXKPckrpWpfDmSzdRjVRt/OK4DVLMShqxODdKnOJITiFvIA8Wf1KSj570ZG1eU3kSiqYG+DIMwmnIwds39uCzYOnP0VWloEtydl3G4XkCyk0TKcyxtpevUQ1I1KVj0FlqCVNXhdbtZsfDuymN02OREvwGGZDh6WN2qk0Pffnvb7VxYaIdlFhuI6H6O4AUnUwrwK/A/W+hcGQSRBzo+Ynq3rRbJ/Yu4i5GcNSqieFOOhehVVEkr0Io8HlQNoH1i3quSt6M1ESpaazNyUFpLzEtgxypBo6evVWclE7k9kv5u37vI/1lq6cjh1otaB6tHk1HWIA+V6uRk3Y7EYevb98bomGtz4wOlvJ5+Ki+ibL9MuEx0oKDzbOhzevUcPwx3T/T6tc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - exec: mon.a: - ceph config set mds mds_min_caps_per_client 1 - background_exec: mon.a: - sleep 30 && ceph config set mds mds_max_caps_per_client 1 - exec: client.0: - ceph_test_trim_caps teuthology_branch: master teuthology_sha1: b35344e81ac507b6cad7c1cae575ce08b9c766f2 timestamp: 2021-10-17_15:08:49 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.10511 2021-10-17T15:27:27.040 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_15f9519d2bb8c31d5d6afe04bfbd467cba5da03f/qa; will attempt to use it 2021-10-17T15:27:27.041 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_15f9519d2bb8c31d5d6afe04bfbd467cba5da03f/qa/tasks 2021-10-17T15:27:27.041 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-10-17T15:27:27.043 INFO:teuthology.task.internal:Checking packages... 2021-10-17T15:27:27.065 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '15f9519d2bb8c31d5d6afe04bfbd467cba5da03f' 2021-10-17T15:27:27.065 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-10-17T15:27:27.066 INFO:teuthology.packaging:ref: None 2021-10-17T15:27:27.066 INFO:teuthology.packaging:tag: None 2021-10-17T15:27:27.067 INFO:teuthology.packaging:branch: wip-yuri2-testing-2021-10-15-1332-pacific 2021-10-17T15:27:27.067 INFO:teuthology.packaging:sha1: 15f9519d2bb8c31d5d6afe04bfbd467cba5da03f 2021-10-17T15:27:27.067 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2021-10-15-1332-pacific 2021-10-17T15:27:27.230 INFO:teuthology.task.internal:Found packages for ceph version 16.2.6-252.g15f9519d 2021-10-17T15:27:27.231 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-10-17T15:27:27.241 INFO:teuthology.task.internal:no buildpackages task found 2021-10-17T15:27:27.241 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-10-17T15:27:27.279 INFO:teuthology.task.internal:Saving configuration 2021-10-17T15:27:27.296 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-10-17T15:27:27.306 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-17T15:27:27.327 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2021-10-17_15:11:50-rados-wip-yuri2-testing-2021-10-15-1332-pacific-distro-basic-smithi/6447671', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-10-17 15:17:40.714013', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDCVX5uvDaNCRzxhFJA9amwhy3EjE2T9kpwWn9SRDRfQ1d1dNRkXA4tLA7DdBrqksdGdMaIKfA9S7NeXiUMZ19A='} 2021-10-17T15:27:27.327 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-10-17T15:27:27.341 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'mds.a', 'mds.b', 'client.0'] 2021-10-17T15:27:27.341 INFO:teuthology.run_tasks:Running task console_log... 2021-10-17T15:27:27.389 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f30f6ba1d08>, signals=[15]) 2021-10-17T15:27:27.391 INFO:teuthology.run_tasks:Running task internal.connect... 2021-10-17T15:27:27.401 INFO:teuthology.task.internal:Opening connections... 2021-10-17T15:27:27.402 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:27:27.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:27:27.472 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-10-17T15:27:27.483 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2021-10-17T15:27:27.560 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2021-10-17T15:27:27.561 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2021-10-17T15:27:27.615 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Linux" 2021-10-17T15:27:27.616 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8" 2021-10-17T15:27:27.616 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2021-10-17T15:27:27.616 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2021-10-17T15:27:27.616 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8" 2021-10-17T15:27:27.617 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2021-10-17T15:27:27.617 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Linux 8" 2021-10-17T15:27:27.617 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2021-10-17T15:27:27.617 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-10-17T15:27:27.618 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2021-10-17T15:27:27.618 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-10-17T15:27:27.618 INFO:teuthology.orchestra.run.smithi119.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-10-17T15:27:27.618 INFO:teuthology.orchestra.run.smithi119.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-10-17T15:27:27.619 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2021-10-17T15:27:27.637 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-10-17T15:27:27.656 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-10-17T15:27:27.686 INFO:teuthology.task.internal:Checking for old test directory... 2021-10-17T15:27:27.686 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2021-10-17T15:27:27.701 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-10-17T15:27:27.715 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-10-17T15:27:27.716 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2021-10-17T15:27:27.761 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-10-17T15:27:27.798 INFO:teuthology.run_tasks:Running task kernel... 2021-10-17T15:27:27.817 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-10-17T15:27:27.818 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-10-17T15:27:27.818 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2021-10-17T15:27:27.833 INFO:teuthology.orchestra.run.smithi119.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-10-17T15:27:27.834 INFO:teuthology.task.kernel:Running kernel on smithi119: 4.18.0-305.10.2.el8_4.x86_64 2021-10-17T15:27:27.834 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum install -y kernel 2021-10-17T15:27:30.055 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS-8 - AppStream 48 MB/s | 9.3 MB 00:00 2021-10-17T15:27:31.645 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS-8 - Base 51 MB/s | 7.5 MB 00:00 2021-10-17T15:27:32.735 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS-8 - Extras 163 kB/s | 10 kB 00:00 2021-10-17T15:27:33.501 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Linux 8 - AppStream 13 MB/s | 9.3 MB 00:00 2021-10-17T15:27:35.751 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Linux 8 - BaseOS 9.4 MB/s | 7.5 MB 00:00 2021-10-17T15:27:37.037 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Linux 8 - Extras 42 kB/s | 10 kB 00:00 2021-10-17T15:27:37.182 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS-8 - PowerTools 26 MB/s | 2.4 MB 00:00 2021-10-17T15:27:39.754 INFO:teuthology.orchestra.run.smithi119.stdout:Copr repo for python3-asyncssh owned by ceph 1.6 kB/s | 3.5 kB 00:02 2021-10-17T15:27:40.801 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 11 MB/s | 10 MB 00:00 2021-10-17T15:27:43.028 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 1.2 MB/s | 24 kB 00:00 2021-10-17T15:27:45.298 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-4.18.0-305.10.2.el8_4.x86_64 is already installed. 2021-10-17T15:27:45.298 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-10-17T15:27:45.614 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2021-10-17T15:27:45.615 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2021-10-17T15:27:45.615 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2021-10-17T15:27:45.616 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2021-10-17T15:27:45.616 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2021-10-17T15:27:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: kernel x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 5.9 M 2021-10-17T15:27:45.616 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2021-10-17T15:27:45.616 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 36 M 2021-10-17T15:27:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules x86_64 4.18.0-305.19.1.el8_4 CentOS-Base 28 M 2021-10-17T15:27:45.617 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-17T15:27:45.617 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2021-10-17T15:27:45.617 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2021-10-17T15:27:45.618 INFO:teuthology.orchestra.run.smithi119.stdout:Install 3 Packages 2021-10-17T15:27:45.618 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-17T15:27:45.618 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 70 M 2021-10-17T15:27:45.618 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 88 M 2021-10-17T15:27:45.618 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2021-10-17T15:27:45.904 INFO:teuthology.orchestra.run.smithi119.stdout:(1/3): kernel-4.18.0-305.19.1.el8_4.x86_64.rpm 21 MB/s | 5.9 MB 00:00 2021-10-17T15:27:46.237 INFO:teuthology.orchestra.run.smithi119.stdout:(2/3): kernel-core-4.18.0-305.19.1.el8_4.x86_64 58 MB/s | 36 MB 00:00 2021-10-17T15:27:46.492 INFO:teuthology.orchestra.run.smithi119.stdout:(3/3): kernel-modules-4.18.0-305.19.1.el8_4.x86 32 MB/s | 28 MB 00:00 2021-10-17T15:27:46.495 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2021-10-17T15:27:46.496 INFO:teuthology.orchestra.run.smithi119.stdout:Total 79 MB/s | 70 MB 00:00 2021-10-17T15:27:46.606 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2021-10-17T15:27:46.936 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2021-10-17T15:27:46.936 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2021-10-17T15:27:48.133 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2021-10-17T15:27:48.144 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2021-10-17T15:27:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2021-10-17T15:27:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-17T15:27:54.198 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-17T15:27:54.564 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-17T15:27:57.540 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-17T15:27:57.725 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-17T15:28:18.566 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-17T15:28:18.862 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-17T15:28:18.863 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-4.18.0-305.19.1.el8_4.x86_64 1/3 2021-10-17T15:28:18.863 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-core-4.18.0-305.19.1.el8_4.x86_64 2/3 2021-10-17T15:28:19.293 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-4.18.0-305.19.1.el8_4.x86_64 3/3 2021-10-17T15:28:19.293 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-17T15:28:19.293 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2021-10-17T15:28:19.294 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-4.18.0-305.19.1.el8_4.x86_64 2021-10-17T15:28:19.294 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core-4.18.0-305.19.1.el8_4.x86_64 2021-10-17T15:28:19.294 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-4.18.0-305.19.1.el8_4.x86_64 2021-10-17T15:28:19.294 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-17T15:28:19.295 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2021-10-17T15:28:19.339 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel --last | head -n 1 2021-10-17T15:28:19.492 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Sun 17 Oct 2021 03:27:57 PM UTC 2021-10-17T15:28:19.494 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-17T15:28:19.494 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.10.2.el8_4.x86_64 Expected: 4.18.0-305.19.1.el8_4.x86_64 2021-10-17T15:28:19.495 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-10-17T15:28:19.495 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-10-17T15:28:19.495 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-10-17T15:28:19.495 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=None, version=distro) 2021-10-17T15:28:19.496 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel --last | head -n 1 2021-10-17T15:28:19.631 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-4.18.0-305.19.1.el8_4.x86_64 Sun 17 Oct 2021 03:27:57 PM UTC 2021-10-17T15:28:19.633 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.19.1.el8_4.x86_64 2021-10-17T15:28:19.634 DEBUG:teuthology.orchestra.run.smithi119:> sudo rpm -qi grub2-tools 2021-10-17T15:28:19.664 INFO:teuthology.orchestra.run.smithi119.stdout:Name : grub2-tools 2021-10-17T15:28:19.665 INFO:teuthology.orchestra.run.smithi119.stdout:Epoch : 1 2021-10-17T15:28:19.665 INFO:teuthology.orchestra.run.smithi119.stdout:Version : 2.02 2021-10-17T15:28:19.666 INFO:teuthology.orchestra.run.smithi119.stdout:Release : 90.el8 2021-10-17T15:28:19.666 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: x86_64 2021-10-17T15:28:19.666 INFO:teuthology.orchestra.run.smithi119.stdout:Install Date: Wed 11 Aug 2021 06:38:04 PM UTC 2021-10-17T15:28:19.667 INFO:teuthology.orchestra.run.smithi119.stdout:Group : System Environment/Base 2021-10-17T15:28:19.667 INFO:teuthology.orchestra.run.smithi119.stdout:Size : 9197207 2021-10-17T15:28:19.667 INFO:teuthology.orchestra.run.smithi119.stdout:License : GPLv3+ 2021-10-17T15:28:19.668 INFO:teuthology.orchestra.run.smithi119.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-10-17T15:28:19.668 INFO:teuthology.orchestra.run.smithi119.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-10-17T15:28:19.668 INFO:teuthology.orchestra.run.smithi119.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-10-17T15:28:19.669 INFO:teuthology.orchestra.run.smithi119.stdout:Build Host : kbuilder.bsys.centos.org 2021-10-17T15:28:19.669 INFO:teuthology.orchestra.run.smithi119.stdout:Relocations : (not relocatable) 2021-10-17T15:28:19.669 INFO:teuthology.orchestra.run.smithi119.stdout:Packager : CentOS BuildSystem 2021-10-17T15:28:19.669 INFO:teuthology.orchestra.run.smithi119.stdout:Vendor : CentOS 2021-10-17T15:28:19.670 INFO:teuthology.orchestra.run.smithi119.stdout:URL : http://www.gnu.org/software/grub/ 2021-10-17T15:28:19.670 INFO:teuthology.orchestra.run.smithi119.stdout:Summary : Support tools for GRUB. 2021-10-17T15:28:19.670 INFO:teuthology.orchestra.run.smithi119.stdout:Description : 2021-10-17T15:28:19.670 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-17T15:28:19.671 INFO:teuthology.orchestra.run.smithi119.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-10-17T15:28:19.671 INFO:teuthology.orchestra.run.smithi119.stdout:customizable bootloader with modular architecture. It supports a rich 2021-10-17T15:28:19.671 INFO:teuthology.orchestra.run.smithi119.stdout:variety of kernel formats, file systems, computer architectures and 2021-10-17T15:28:19.671 INFO:teuthology.orchestra.run.smithi119.stdout:hardware devices. 2021-10-17T15:28:19.671 INFO:teuthology.orchestra.run.smithi119.stdout: 2021-10-17T15:28:19.672 INFO:teuthology.orchestra.run.smithi119.stdout:This subpackage provides tools for support of all platforms. 2021-10-17T15:28:19.673 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-10-17T15:28:19.673 INFO:teuthology.task.kernel:Updating grub on smithi119 to boot 4.18.0-305.19.1.el8_4.x86_64 2021-10-17T15:28:19.674 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-10-17T15:28:21.262 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2021-10-17T15:28:23.745 INFO:teuthology.orchestra.run.smithi119.stderr:done 2021-10-17T15:28:23.746 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2021-10-17T15:28:23.773 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.TJ4Nh9hI7w 2021-10-17T15:28:23.774 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TJ4Nh9hI7w 2021-10-17T15:28:23.843 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.TJ4Nh9hI7w 2021-10-17T15:28:23.998 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.TJ4Nh9hI7w is 6KB 2021-10-17T15:28:24.049 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.TJ4Nh9hI7w 2021-10-17T15:28:24.063 DEBUG:teuthology.orchestra.run.smithi119:> sudo /bin/ls /boot/loader/entries || true 2021-10-17T15:28:24.131 INFO:teuthology.orchestra.run.smithi119.stdout:ecc66dffcd264e5181894e69c53ff13c-0-rescue.conf 2021-10-17T15:28:24.131 INFO:teuthology.orchestra.run.smithi119.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-240.el8.x86_64.conf 2021-10-17T15:28:24.132 INFO:teuthology.orchestra.run.smithi119.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.10.2.el8_4.x86_64.conf 2021-10-17T15:28:24.132 INFO:teuthology.orchestra.run.smithi119.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.19.1.el8_4.x86_64.conf 2021-10-17T15:28:24.134 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-set-default ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.19.1.el8_4.x86_64 2021-10-17T15:28:24.293 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2021-10-17T15:28:54.326 INFO:teuthology.misc:Re-opening connections... 2021-10-17T15:28:54.327 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:28:54.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:28:54.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:00.427 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:00.428 DEBUG:teuthology.misc:waited 6.100450754165649 2021-10-17T15:29:01.429 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:01.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:01.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:03.499 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:03.499 DEBUG:teuthology.misc:waited 9.172240257263184 2021-10-17T15:29:04.501 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:04.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:04.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:06.570 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:06.571 DEBUG:teuthology.misc:waited 12.244004011154175 2021-10-17T15:29:07.573 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:07.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:07.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:09.643 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:09.643 DEBUG:teuthology.misc:waited 15.316096782684326 2021-10-17T15:29:10.645 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:10.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:10.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:12.714 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:12.715 DEBUG:teuthology.misc:waited 18.388013124465942 2021-10-17T15:29:13.717 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:13.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:13.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:15.787 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:15.787 DEBUG:teuthology.misc:waited 21.460111379623413 2021-10-17T15:29:16.788 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:16.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:16.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:18.859 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:18.859 DEBUG:teuthology.misc:waited 24.532058238983154 2021-10-17T15:29:19.861 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:19.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:19.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:21.935 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:21.935 DEBUG:teuthology.misc:waited 27.608152627944946 2021-10-17T15:29:22.937 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:22.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:22.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:25.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:25.003 DEBUG:teuthology.misc:waited 30.675973176956177 2021-10-17T15:29:26.004 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:26.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:26.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:28.075 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:28.075 DEBUG:teuthology.misc:waited 33.748085498809814 2021-10-17T15:29:29.077 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:29.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:29.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:31.147 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:31.147 DEBUG:teuthology.misc:waited 36.820088386535645 2021-10-17T15:29:32.149 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:32.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:32.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:34.219 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:34.219 DEBUG:teuthology.misc:waited 39.89205718040466 2021-10-17T15:29:35.221 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:35.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:35.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:37.291 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:37.291 DEBUG:teuthology.misc:waited 42.96434926986694 2021-10-17T15:29:38.293 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:38.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:38.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:40.363 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:40.363 DEBUG:teuthology.misc:waited 46.036258935928345 2021-10-17T15:29:41.365 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:41.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:41.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:43.435 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:43.436 DEBUG:teuthology.misc:waited 49.10853314399719 2021-10-17T15:29:44.437 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:44.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:44.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:46.507 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:46.507 DEBUG:teuthology.misc:waited 52.18017792701721 2021-10-17T15:29:47.509 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:47.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:47.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:49.579 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:49.579 DEBUG:teuthology.misc:waited 55.252280712127686 2021-10-17T15:29:50.581 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:50.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:50.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:52.651 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:52.651 DEBUG:teuthology.misc:waited 58.32434368133545 2021-10-17T15:29:53.653 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:53.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:53.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:55.723 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:55.723 DEBUG:teuthology.misc:waited 61.396132469177246 2021-10-17T15:29:56.725 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:56.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:56.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:29:58.795 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:29:58.795 DEBUG:teuthology.misc:waited 64.46816897392273 2021-10-17T15:29:59.797 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:29:59.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:29:59.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:01.870 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:01.871 DEBUG:teuthology.misc:waited 67.54422998428345 2021-10-17T15:30:02.873 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:02.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:02.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:04.938 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:04.939 DEBUG:teuthology.misc:waited 70.61199617385864 2021-10-17T15:30:05.941 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:05.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:05.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:08.011 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:08.011 DEBUG:teuthology.misc:waited 73.6841881275177 2021-10-17T15:30:09.013 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:09.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:09.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:11.083 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:11.084 DEBUG:teuthology.misc:waited 76.75679850578308 2021-10-17T15:30:12.085 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:12.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:12.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:14.155 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:14.155 DEBUG:teuthology.misc:waited 79.82812786102295 2021-10-17T15:30:15.157 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:15.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:15.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:17.227 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:17.227 DEBUG:teuthology.misc:waited 82.90021085739136 2021-10-17T15:30:18.229 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:18.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:18.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:20.303 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:20.303 DEBUG:teuthology.misc:waited 85.97625613212585 2021-10-17T15:30:21.305 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:21.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:21.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:23.371 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:23.372 DEBUG:teuthology.misc:waited 89.04498362541199 2021-10-17T15:30:24.374 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:24.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:24.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:26.443 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:26.443 DEBUG:teuthology.misc:waited 92.11613440513611 2021-10-17T15:30:27.445 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:27.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:27.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:29.515 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:29.515 DEBUG:teuthology.misc:waited 95.1881992816925 2021-10-17T15:30:30.516 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:30.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:30.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:32.587 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:32.587 DEBUG:teuthology.misc:waited 98.26013898849487 2021-10-17T15:30:33.589 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:33.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:33.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:35.659 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:35.659 DEBUG:teuthology.misc:waited 101.33220863342285 2021-10-17T15:30:36.661 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:36.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:36.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:38.731 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:38.731 DEBUG:teuthology.misc:waited 104.40412831306458 2021-10-17T15:30:39.733 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:39.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:39.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:41.803 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:41.803 DEBUG:teuthology.misc:waited 107.47621846199036 2021-10-17T15:30:42.805 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:42.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:42.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:44.875 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:44.875 DEBUG:teuthology.misc:waited 110.54817986488342 2021-10-17T15:30:45.877 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:45.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:45.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:47.947 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:47.947 DEBUG:teuthology.misc:waited 113.62024641036987 2021-10-17T15:30:48.949 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:48.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:48.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:51.019 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:51.019 DEBUG:teuthology.misc:waited 116.6921648979187 2021-10-17T15:30:52.021 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:52.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:52.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:54.091 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:54.091 DEBUG:teuthology.misc:waited 119.76406359672546 2021-10-17T15:30:55.093 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:55.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:55.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:30:57.163 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:30:57.163 DEBUG:teuthology.misc:waited 122.83618378639221 2021-10-17T15:30:58.165 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:30:58.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:30:58.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:00.235 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:00.235 DEBUG:teuthology.misc:waited 125.90820670127869 2021-10-17T15:31:01.236 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:01.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:01.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:03.307 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:03.307 DEBUG:teuthology.misc:waited 128.98023962974548 2021-10-17T15:31:04.309 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:04.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:04.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:06.379 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:06.379 DEBUG:teuthology.misc:waited 132.0520465373993 2021-10-17T15:31:07.381 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:07.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:07.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:09.451 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:09.452 DEBUG:teuthology.misc:waited 135.124858379364 2021-10-17T15:31:10.453 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:10.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:10.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:12.523 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:12.523 DEBUG:teuthology.misc:waited 138.19616651535034 2021-10-17T15:31:13.525 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:13.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:13.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:15.594 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:15.595 DEBUG:teuthology.misc:waited 141.26804518699646 2021-10-17T15:31:16.597 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:16.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:16.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:18.667 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:18.667 DEBUG:teuthology.misc:waited 144.34012722969055 2021-10-17T15:31:19.669 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:19.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:19.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:21.739 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:21.739 DEBUG:teuthology.misc:waited 147.4121129512787 2021-10-17T15:31:22.741 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:22.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:22.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:24.810 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:24.811 DEBUG:teuthology.misc:waited 150.48390674591064 2021-10-17T15:31:25.812 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:25.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:25.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:27.883 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:27.883 DEBUG:teuthology.misc:waited 153.55607271194458 2021-10-17T15:31:28.885 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:28.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:28.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:30.955 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:30.955 DEBUG:teuthology.misc:waited 156.62809944152832 2021-10-17T15:31:31.957 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:31.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:31.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:34.027 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:34.027 DEBUG:teuthology.misc:waited 159.7001667022705 2021-10-17T15:31:35.029 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:35.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:35.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:37.099 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:37.099 DEBUG:teuthology.misc:waited 162.77212023735046 2021-10-17T15:31:38.101 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:38.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:38.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:40.171 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:40.208 DEBUG:teuthology.misc:waited 165.8813238143921 2021-10-17T15:31:41.212 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:41.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:41.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:43.243 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:43.243 DEBUG:teuthology.misc:waited 168.91600608825684 2021-10-17T15:31:44.245 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:44.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:44.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:46.315 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:46.315 DEBUG:teuthology.misc:waited 171.98813605308533 2021-10-17T15:31:47.317 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:47.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:47.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:49.387 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:49.387 DEBUG:teuthology.misc:waited 175.06012105941772 2021-10-17T15:31:50.389 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:50.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:50.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:52.459 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:52.459 DEBUG:teuthology.misc:waited 178.1320960521698 2021-10-17T15:31:53.461 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:53.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:53.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:55.531 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:55.531 DEBUG:teuthology.misc:waited 181.20409488677979 2021-10-17T15:31:56.533 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:56.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:56.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:31:58.603 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:31:58.603 DEBUG:teuthology.misc:waited 184.27601218223572 2021-10-17T15:31:59.605 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:31:59.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:31:59.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:01.675 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:01.675 DEBUG:teuthology.misc:waited 187.34803915023804 2021-10-17T15:32:02.677 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:02.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:02.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:04.747 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:04.747 DEBUG:teuthology.misc:waited 190.42012190818787 2021-10-17T15:32:05.749 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:05.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:05.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:07.819 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:07.820 DEBUG:teuthology.misc:waited 193.4928297996521 2021-10-17T15:32:08.821 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:08.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:08.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:10.891 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:10.891 DEBUG:teuthology.misc:waited 196.56402826309204 2021-10-17T15:32:11.893 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:11.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:11.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:13.963 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:13.963 DEBUG:teuthology.misc:waited 199.63605523109436 2021-10-17T15:32:14.965 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:14.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:14.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:17.034 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:17.035 DEBUG:teuthology.misc:waited 202.7079780101776 2021-10-17T15:32:18.037 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:18.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:18.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:20.107 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:20.107 DEBUG:teuthology.misc:waited 205.78001832962036 2021-10-17T15:32:21.109 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:21.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:21.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:23.179 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:23.179 DEBUG:teuthology.misc:waited 208.85200214385986 2021-10-17T15:32:24.181 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:24.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:24.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:26.251 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:26.251 DEBUG:teuthology.misc:waited 211.92413878440857 2021-10-17T15:32:27.253 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:27.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:27.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:29.323 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:29.323 DEBUG:teuthology.misc:waited 214.99599480628967 2021-10-17T15:32:30.325 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:30.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:30.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:32.395 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:32.395 DEBUG:teuthology.misc:waited 218.06816720962524 2021-10-17T15:32:33.397 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:33.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:33.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:35.470 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:35.471 DEBUG:teuthology.misc:waited 221.14392066001892 2021-10-17T15:32:36.472 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:36.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:36.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:38.539 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:38.539 DEBUG:teuthology.misc:waited 224.2122757434845 2021-10-17T15:32:39.541 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:39.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:39.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:41.611 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:41.611 DEBUG:teuthology.misc:waited 227.28403425216675 2021-10-17T15:32:42.613 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:42.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:42.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:44.683 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:44.683 DEBUG:teuthology.misc:waited 230.35615015029907 2021-10-17T15:32:45.685 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:45.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:45.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:47.755 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:47.755 DEBUG:teuthology.misc:waited 233.4281361103058 2021-10-17T15:32:48.757 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:48.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:48.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:50.827 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:50.827 DEBUG:teuthology.misc:waited 236.50004076957703 2021-10-17T15:32:51.829 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:51.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:51.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:53.899 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:53.899 DEBUG:teuthology.misc:waited 239.57213020324707 2021-10-17T15:32:54.901 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:54.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:54.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:32:56.971 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:32:56.971 DEBUG:teuthology.misc:waited 242.64412569999695 2021-10-17T15:32:57.973 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:32:57.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:32:57.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:00.043 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:00.043 DEBUG:teuthology.misc:waited 245.71622824668884 2021-10-17T15:33:01.045 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:01.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:01.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:03.115 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:03.115 DEBUG:teuthology.misc:waited 248.7881679534912 2021-10-17T15:33:04.117 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:04.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:04.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:06.186 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:06.188 DEBUG:teuthology.misc:waited 251.86077213287354 2021-10-17T15:33:07.189 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:07.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:07.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:09.258 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:09.259 DEBUG:teuthology.misc:waited 254.93200039863586 2021-10-17T15:33:10.261 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:10.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:10.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:12.331 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:12.331 DEBUG:teuthology.misc:waited 258.0041718482971 2021-10-17T15:33:13.333 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:13.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:13.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:15.403 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:15.404 DEBUG:teuthology.misc:waited 261.07642006874084 2021-10-17T15:33:16.405 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:16.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:16.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:18.475 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:18.475 DEBUG:teuthology.misc:waited 264.1482379436493 2021-10-17T15:33:19.477 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:19.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:19.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:21.547 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:21.547 DEBUG:teuthology.misc:waited 267.2201898097992 2021-10-17T15:33:22.549 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:22.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:22.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:24.619 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:24.619 DEBUG:teuthology.misc:waited 270.29219365119934 2021-10-17T15:33:25.621 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:25.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:25.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:27.691 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:27.691 DEBUG:teuthology.misc:waited 273.3640875816345 2021-10-17T15:33:28.693 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:28.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:28.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:30.763 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:30.763 DEBUG:teuthology.misc:waited 276.43606400489807 2021-10-17T15:33:31.765 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:31.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:31.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:33.835 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:33.835 DEBUG:teuthology.misc:waited 279.5082104206085 2021-10-17T15:33:34.837 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:34.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:34.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:36.907 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:36.907 DEBUG:teuthology.misc:waited 282.5801854133606 2021-10-17T15:33:37.909 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:37.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:37.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:39.979 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:39.979 DEBUG:teuthology.misc:waited 285.6521646976471 2021-10-17T15:33:40.981 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:40.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:40.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:43.051 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:43.051 DEBUG:teuthology.misc:waited 288.724112033844 2021-10-17T15:33:44.053 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:44.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:44.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:46.122 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:46.123 DEBUG:teuthology.misc:waited 291.7960159778595 2021-10-17T15:33:47.124 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:47.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:47.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:49.195 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:49.195 DEBUG:teuthology.misc:waited 294.86807012557983 2021-10-17T15:33:50.197 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:50.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:50.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:52.267 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:52.267 DEBUG:teuthology.misc:waited 297.9401321411133 2021-10-17T15:33:53.269 INFO:teuthology.misc:trying to connect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:53.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2021-10-17T15:33:53.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-10-17T15:33:55.338 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2021-10-17T15:33:55.339 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/task/kernel.py", line 1332, in task wait_for_reboot(ctx, need_version, timeout, config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/task/kernel.py", line 697, in wait_for_reboot teuthology.reconnect(ctx, timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/misc.py", line 934, in reconnect remote.name) RuntimeError: Could not reconnect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:55.438 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8a358d43edfc489b935029c476f83bc6 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/task/kernel.py", line 1332, in task wait_for_reboot(ctx, need_version, timeout, config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/task/kernel.py", line 697, in wait_for_reboot teuthology.reconnect(ctx, timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/misc.py", line 934, in reconnect remote.name) RuntimeError: Could not reconnect to ubuntu@smithi119.front.sepia.ceph.com 2021-10-17T15:33:55.441 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2021-10-17T15:33:55.491 INFO:teuthology.nuke:Checking targets against current locks 2021-10-17T15:33:55.612 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/virtualenv/bin/teuthology", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/scripts/run.py", line 38, in main teuthology.run.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run.py", line 414, in main report_outcome(config, archive, fake_ctx.summary, fake_ctx) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/run.py", line 271, in report_outcome nuke(fake_ctx, fake_ctx.lock) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b35344e81ac507b6cad7c1cae575ce08b9c766f2/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable