2020-12-26T01:42:25.992 INFO:root:teuthology version: 1.0.0-8e49dda4 2020-12-26T01:42:25.994 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_teuthology@teuthology --lock --archive /home/teuthworker/archive/teuthology-2020-12-19_05:07:02-powercycle-nautilus-distro-basic-smithi/5719378 --name teuthology-2020-12-19_05:07:02-powercycle-nautilus-distro-basic-smithi --description powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-few-objects thrashosds-health whitelist_health} --block -- /tmp/teuthology-worker.8fvzh_gv.tmp 2020-12-26T01:42:26.023 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-12-26T01:42:26.081 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2020-12-19_05:07:02-powercycle-nautilus-distro-basic-smithi/5719378 branch: nautilus description: powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-few-objects thrashosds-health whitelist_health} email: ceph-qa@ceph.io first_in_suite: false job_id: '5719378' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2020-12-19_05:07:02-powercycle-nautilus-distro-basic-smithi nuke-on-error: true os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: nautilus ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming sha1: 74f48adff35db6f86e9231614da019ef946277a3 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 74f48adff35db6f86e9231614da019ef946277a3 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: nautilus sha1: 74f48adff35db6f86e9231614da019ef946277a3 owner: scheduled_teuthology@teuthology priority: 1000 repo: git://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 sha1: 74f48adff35db6f86e9231614da019ef946277a3 sleep_before_teardown: 0 suite: powercycle suite_branch: nautilus suite_path: /home/teuthworker/src/git.ceph.com_ceph_nautilus/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph.git suite_sha1: 74f48adff35db6f86e9231614da019ef946277a3 tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - rados: clients: - client.0 objects: 50 op_weights: copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology_branch: master timestamp: 2020-12-19_05:07:02 tube: smithi user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.15469 2020-12-26T01:42:26.081 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_nautilus/qa; will attempt to use it 2020-12-26T01:42:26.082 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_nautilus/qa/tasks 2020-12-26T01:42:26.082 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-12-26T01:42:26.084 INFO:teuthology.task.internal:Checking packages... 2020-12-26T01:42:26.103 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '74f48adff35db6f86e9231614da019ef946277a3' 2020-12-26T01:42:26.103 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-12-26T01:42:26.104 INFO:teuthology.packaging:ref: None 2020-12-26T01:42:26.104 INFO:teuthology.packaging:tag: None 2020-12-26T01:42:26.105 INFO:teuthology.packaging:branch: nautilus 2020-12-26T01:42:26.105 INFO:teuthology.packaging:sha1: 74f48adff35db6f86e9231614da019ef946277a3 2020-12-26T01:42:26.105 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=nautilus 2020-12-26T01:42:26.362 INFO:teuthology.task.internal:Found packages for ceph version 14.2.16-114-g74f48adf-1bionic 2020-12-26T01:42:26.362 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-12-26T01:42:26.371 INFO:teuthology.task.internal:no buildpackages task found 2020-12-26T01:42:26.371 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-12-26T01:42:26.458 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-12-26T01:42:26.459 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-12-26T01:42:26.512 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:42:36.529 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:42:46.547 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:42:56.564 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:43:06.580 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:43:16.602 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:43:26.619 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:43:36.634 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:43:46.654 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:43:56.672 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:44:06.692 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:44:16.714 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:44:26.732 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:44:36.748 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:44:46.776 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:44:56.795 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:45:06.811 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:45:16.832 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:45:26.846 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:45:36.864 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:45:46.890 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:45:56.908 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:46:06.922 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:46:16.933 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:46:26.952 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:46:36.966 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:46:46.983 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:46:57.001 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:47:07.022 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:47:17.037 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:47:27.055 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:47:37.073 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:47:47.090 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:47:57.106 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:48:07.124 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:48:17.138 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:48:27.154 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:48:37.171 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:48:47.189 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:48:57.207 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:49:07.221 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:49:17.239 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:49:27.254 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:49:37.271 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:49:47.310 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:49:57.327 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:50:07.344 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:50:17.357 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2020-12-26T01:50:27.375 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2020-12-26T01:50:37.390 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_teuthology@teuthology', 'count': 4, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/teuthology-2020-12-19_05:07:02-powercycle-nautilus-distro-basic-smithi/5719378'} 2020-12-26T01:50:37.412 DEBUG:teuthology.lock.ops:locked ubuntu@smithi168.front.sepia.ceph.com, ubuntu@smithi195.front.sepia.ceph.com, ubuntu@smithi156.front.sepia.ceph.com, ubuntu@smithi171.front.sepia.ceph.com 2020-12-26T01:50:37.520 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f561b0a8400>, signals=[15]) 2020-12-26T01:50:37.756 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of ubuntu 18.04 2020-12-26T01:50:37.767 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of ubuntu 18.04 2020-12-26T01:50:37.769 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of ubuntu 18.04 2020-12-26T01:50:37.808 INFO:teuthology.provision.fog.smithi168:Scheduling deploy of ubuntu 18.04 2020-12-26T01:50:38.217 INFO:teuthology.orchestra.console:Power off smithi168 2020-12-26T01:50:38.218 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-12-26T01:50:38.239 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:38.255 INFO:teuthology.orchestra.console:Power off smithi171 2020-12-26T01:50:38.255 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-12-26T01:50:38.267 INFO:teuthology.orchestra.console:Power off smithi156 2020-12-26T01:50:38.268 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-12-26T01:50:38.277 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:38.287 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:38.299 INFO:teuthology.orchestra.console:Power off smithi195 2020-12-26T01:50:38.299 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-12-26T01:50:38.318 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:38.376 INFO:teuthology.orchestra.console:Power off for smithi168 completed 2020-12-26T01:50:38.406 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2020-12-26T01:50:38.407 INFO:teuthology.orchestra.console:Power off for smithi171 completed 2020-12-26T01:50:38.438 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2020-12-26T01:50:38.477 INFO:teuthology.orchestra.console:Power on smithi168 2020-12-26T01:50:38.478 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-12-26T01:50:38.497 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:38.507 INFO:teuthology.orchestra.console:Power on smithi156 2020-12-26T01:50:38.508 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-12-26T01:50:38.515 INFO:teuthology.orchestra.console:Power on smithi171 2020-12-26T01:50:38.516 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-12-26T01:50:38.529 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:38.537 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:38.544 INFO:teuthology.orchestra.console:Power on smithi195 2020-12-26T01:50:38.545 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-12-26T01:50:38.563 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:42.526 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:42.553 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:42.561 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:42.582 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:42.762 INFO:teuthology.orchestra.console:Power on for smithi156 completed 2020-12-26T01:50:42.864 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2020-12-26T01:50:46.638 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:46.671 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:46.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-12-26T01:50:46.849 INFO:teuthology.orchestra.console:Power on for smithi168 completed 2020-12-26T01:50:46.882 INFO:teuthology.orchestra.console:Power on for smithi171 completed 2020-12-26T01:50:46.902 INFO:teuthology.orchestra.console:Power on for smithi195 completed 2020-12-26T01:50:46.950 INFO:teuthology.provision.fog.smithi168:Waiting for deploy to finish 2020-12-26T01:50:46.983 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish 2020-12-26T01:50:47.003 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2020-12-26T01:53:33.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:53:33.694 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2020-12-26T01:53:33.695 ERROR:paramiko.transport:Traceback (most recent call last): 2020-12-26T01:53:33.696 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2020-12-26T01:53:33.696 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2020-12-26T01:53:33.696 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2020-12-26T01:53:33.697 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2020-12-26T01:53:33.697 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2020-12-26T01:53:33.697 ERROR:paramiko.transport: raise EOFError() 2020-12-26T01:53:33.698 ERROR:paramiko.transport:EOFError 2020-12-26T01:53:33.698 ERROR:paramiko.transport: 2020-12-26T01:53:33.700 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2020-12-26T01:53:33.700 ERROR:paramiko.transport: 2020-12-26T01:53:33.700 ERROR:paramiko.transport:Traceback (most recent call last): 2020-12-26T01:53:33.701 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2020-12-26T01:53:33.701 ERROR:paramiko.transport: self._check_banner() 2020-12-26T01:53:33.701 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2020-12-26T01:53:33.702 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2020-12-26T01:53:33.702 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2020-12-26T01:53:33.702 ERROR:paramiko.transport: 2020-12-26T01:53:39.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:53:44.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:53:48.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:53:48.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:53:57.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:54:06.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:54:15.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:54:24.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:54:34.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:54:43.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:54:45.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:54:50.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:54:52.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:54:53.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:54:54.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:54:59.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:55:02.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:55:11.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:55:16.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:55:20.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:55:25.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:55:29.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:55:34.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:55:35.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:55:36.081 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-12-26T01:55:36.083 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-12-26T01:55:36.435 INFO:teuthology.provision.fog.smithi195:Node is ready 2020-12-26T01:55:36.436 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2020-12-26T01:55:36.481 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2020-12-26T01:55:36.482 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2020-12-26T01:55:36.530 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2020-12-26T01:55:36.531 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2020-12-26T01:55:36.642 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2020-12-26T01:55:36.657 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2020-12-26T01:55:36.714 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2020-12-26T01:55:36.771 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2020-12-26T01:55:36.824 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2020-12-26T01:55:36.825 DEBUG:teuthology.parallel:result is None 2020-12-26T01:55:43.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:55:51.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:55:52.075 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-12-26T01:55:52.075 DEBUG:teuthology.orchestra.run.smithi168:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-12-26T01:55:52.411 INFO:teuthology.provision.fog.smithi168:Node is ready 2020-12-26T01:55:52.412 DEBUG:teuthology.orchestra.run.smithi168:> hostname 2020-12-26T01:55:52.460 INFO:teuthology.orchestra.run.smithi168.stdout:smithi168.front.sepia.ceph.com 2020-12-26T01:55:52.461 DEBUG:teuthology.orchestra.run.smithi168:> grep smithi168.front.sepia.ceph.com /etc/hosts 2020-12-26T01:55:52.509 INFO:teuthology.orchestra.run.smithi168.stdout:172.21.15.168 smithi168.front.sepia.ceph.com smithi168 2020-12-26T01:55:52.510 DEBUG:teuthology.orchestra.run.smithi168:> sudo hostname smithi168 2020-12-26T01:55:52.591 DEBUG:teuthology.orchestra.run.smithi168:> sudo sed -i -e 's/smithi168.front.sepia.ceph.com/smithi168/g' /etc/hosts 2020-12-26T01:55:52.651 DEBUG:teuthology.orchestra.run.smithi168:> sudo sed -i -e 's/172.21.15.168/172.21.15.168/g' /etc/hosts 2020-12-26T01:55:52.707 DEBUG:teuthology.orchestra.run.smithi168:> sudo sed -i -e 's/smithi168.front.sepia.ceph.com/smithi168/g' /etc/hostname 2020-12-26T01:55:52.763 DEBUG:teuthology.orchestra.run.smithi168:> sudo hostname smithi168 2020-12-26T01:55:52.817 INFO:teuthology.provision.fog.smithi168:Deploy complete! 2020-12-26T01:55:52.817 DEBUG:teuthology.parallel:result is None 2020-12-26T01:56:00.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:56:00.673 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-12-26T01:56:00.674 DEBUG:teuthology.orchestra.run.smithi171:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-12-26T01:56:01.031 INFO:teuthology.provision.fog.smithi171:Node is ready 2020-12-26T01:56:01.032 DEBUG:teuthology.orchestra.run.smithi171:> hostname 2020-12-26T01:56:01.078 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com 2020-12-26T01:56:01.079 DEBUG:teuthology.orchestra.run.smithi171:> grep smithi171.front.sepia.ceph.com /etc/hosts 2020-12-26T01:56:01.126 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171 2020-12-26T01:56:01.126 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171 2020-12-26T01:56:01.202 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hosts 2020-12-26T01:56:01.260 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/172.21.15.171/172.21.15.171/g' /etc/hosts 2020-12-26T01:56:01.317 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hostname 2020-12-26T01:56:01.374 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171 2020-12-26T01:56:01.430 INFO:teuthology.provision.fog.smithi171:Deploy complete! 2020-12-26T01:56:01.430 DEBUG:teuthology.parallel:result is None 2020-12-26T01:56:05.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:56:05.834 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-12-26T01:56:05.834 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-12-26T01:56:06.154 INFO:teuthology.provision.fog.smithi156:Node is ready 2020-12-26T01:56:06.155 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2020-12-26T01:56:06.202 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2020-12-26T01:56:06.202 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2020-12-26T01:56:06.251 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2020-12-26T01:56:06.251 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2020-12-26T01:56:06.318 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2020-12-26T01:56:06.375 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2020-12-26T01:56:06.448 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2020-12-26T01:56:06.500 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2020-12-26T01:56:06.555 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2020-12-26T01:56:06.555 DEBUG:teuthology.parallel:result is None 2020-12-26T01:56:06.741 INFO:teuthology.lock.ops:Checking smithi168.front.sepia.ceph.com 2020-12-26T01:56:06.742 INFO:teuthology.lock.ops:New key found. Updating... 2020-12-26T01:56:06.758 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2020-12-26T01:56:06.758 INFO:teuthology.lock.ops:New key found. Updating... 2020-12-26T01:56:06.773 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2020-12-26T01:56:06.773 INFO:teuthology.lock.ops:New key found. Updating... 2020-12-26T01:56:06.788 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com 2020-12-26T01:56:06.788 INFO:teuthology.lock.ops:New key found. Updating... 2020-12-26T01:56:06.804 INFO:teuthology.lock.ops:Updating [smithi168.front.sepia.ceph.com]: set os type and version on server 2020-12-26T01:56:06.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-12-26T01:56:06.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:56:06.924 DEBUG:teuthology.orchestra.run.smithi168:> true 2020-12-26T01:56:07.171 DEBUG:teuthology.orchestra.run.smithi168:> uname -m 2020-12-26T01:56:07.220 INFO:teuthology.orchestra.run.smithi168.stdout:x86_64 2020-12-26T01:56:07.220 DEBUG:teuthology.orchestra.run.smithi168:> cat /etc/os-release 2020-12-26T01:56:07.268 INFO:teuthology.orchestra.run.smithi168.stdout:NAME="Ubuntu" 2020-12-26T01:56:07.268 INFO:teuthology.orchestra.run.smithi168.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-12-26T01:56:07.269 INFO:teuthology.orchestra.run.smithi168.stdout:ID=ubuntu 2020-12-26T01:56:07.269 INFO:teuthology.orchestra.run.smithi168.stdout:ID_LIKE=debian 2020-12-26T01:56:07.269 INFO:teuthology.orchestra.run.smithi168.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-12-26T01:56:07.269 INFO:teuthology.orchestra.run.smithi168.stdout:VERSION_ID="18.04" 2020-12-26T01:56:07.269 INFO:teuthology.orchestra.run.smithi168.stdout:HOME_URL="https://www.ubuntu.com/" 2020-12-26T01:56:07.270 INFO:teuthology.orchestra.run.smithi168.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-12-26T01:56:07.270 INFO:teuthology.orchestra.run.smithi168.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-12-26T01:56:07.270 INFO:teuthology.orchestra.run.smithi168.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-12-26T01:56:07.270 INFO:teuthology.orchestra.run.smithi168.stdout:VERSION_CODENAME=bionic 2020-12-26T01:56:07.271 INFO:teuthology.orchestra.run.smithi168.stdout:UBUNTU_CODENAME=bionic 2020-12-26T01:56:07.272 INFO:teuthology.lock.ops:Updating smithi168.front.sepia.ceph.com on lock server 2020-12-26T01:56:07.286 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2020-12-26T01:56:07.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-12-26T01:56:07.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:56:07.361 DEBUG:teuthology.orchestra.run.smithi195:> true 2020-12-26T01:56:07.559 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2020-12-26T01:56:07.608 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2020-12-26T01:56:07.609 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2020-12-26T01:56:07.656 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu" 2020-12-26T01:56:07.657 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-12-26T01:56:07.657 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu 2020-12-26T01:56:07.657 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian 2020-12-26T01:56:07.658 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-12-26T01:56:07.658 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="18.04" 2020-12-26T01:56:07.658 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/" 2020-12-26T01:56:07.658 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-12-26T01:56:07.658 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-12-26T01:56:07.659 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-12-26T01:56:07.659 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=bionic 2020-12-26T01:56:07.659 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=bionic 2020-12-26T01:56:07.660 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2020-12-26T01:56:07.674 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2020-12-26T01:56:07.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-12-26T01:56:07.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:56:07.754 DEBUG:teuthology.orchestra.run.smithi156:> true 2020-12-26T01:56:07.979 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2020-12-26T01:56:08.025 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2020-12-26T01:56:08.026 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2020-12-26T01:56:08.073 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu" 2020-12-26T01:56:08.074 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-12-26T01:56:08.074 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu 2020-12-26T01:56:08.074 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian 2020-12-26T01:56:08.075 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-12-26T01:56:08.075 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="18.04" 2020-12-26T01:56:08.075 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/" 2020-12-26T01:56:08.075 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-12-26T01:56:08.075 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-12-26T01:56:08.076 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-12-26T01:56:08.076 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=bionic 2020-12-26T01:56:08.076 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=bionic 2020-12-26T01:56:08.077 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2020-12-26T01:56:08.091 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server 2020-12-26T01:56:08.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-12-26T01:56:08.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-12-26T01:56:08.167 DEBUG:teuthology.orchestra.run.smithi171:> true 2020-12-26T01:56:08.408 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2020-12-26T01:56:08.457 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2020-12-26T01:56:08.457 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2020-12-26T01:56:08.506 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Ubuntu" 2020-12-26T01:56:08.506 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-12-26T01:56:08.506 INFO:teuthology.orchestra.run.smithi171.stdout:ID=ubuntu 2020-12-26T01:56:08.507 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE=debian 2020-12-26T01:56:08.507 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-12-26T01:56:08.507 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="18.04" 2020-12-26T01:56:08.507 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.ubuntu.com/" 2020-12-26T01:56:08.507 INFO:teuthology.orchestra.run.smithi171.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-12-26T01:56:08.508 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-12-26T01:56:08.508 INFO:teuthology.orchestra.run.smithi171.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-12-26T01:56:08.508 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_CODENAME=bionic 2020-12-26T01:56:08.508 INFO:teuthology.orchestra.run.smithi171.stdout:UBUNTU_CODENAME=bionic 2020-12-26T01:56:08.509 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2020-12-26T01:56:08.523 INFO:teuthology.task.internal.lock_machines:4 smithi machines locked this try, 4/4 locked so far 2020-12-26T01:56:08.589 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJBoPjK0JeMIJRoKw3TevJWqgg/2R8qZbAFlx0DLtes2m2f5IGm9L1FcknIiEbnj6TXL/mhT38bAbzSAqK7EZ9hmz5MMr7C1qw7bT4B7FKydwaLdnZ7okpA9D3yP8OJsBObnZKr+ib+QWiNw4qXjIcHyReEdkE6+iI+qpDQiO4wgM3F6Aor68tHc0GngxyqQ6ezHB0OstzWNTox6709+2VcTY4i/P1KqPuOI3nbsyOF01g43ey4Fp41o5EDzCR8x4dOenZKbDkaCFm3B/dr6n3vy3Yfs7goMl9PnTyegAiyWVM4h5wMF2+/2c8RAu9L3iWlbJsWTKw1BMKaXcE9eBt smithi168.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQyS9dgzEAhxhrCUOs/js3YDb08+7EKrR3KCy4OWyn/i4g34V8yozDYVR24fl5AyrUWZtHuWEqR7Vz+XuOxnp/OVaQjYfO32iwG3EhIXFriacyJ5cpEb+KHJa2aUCmvtc/0RjP/c7++Er996pjy+jREo03mwwX56UQV4cKoPMajktnWhmzsDD8H/k4zG/wf/mv5l8vsvUfE84U4wvFUyoRxVxzQkXE3I5J2hz5iPVLBX5FnwOpySXY4qDQBsau5nydc6BqfdZ+mAqkBCu3aNxce84xKvxP1Yt8Q8SRz57IVMIlZtR6A3/nfqrcA3YHlluciyT49Oi7Ug1IWI60FPab smithi171.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDfQIzPu1TiV1zQW/wWOv4pGCJUtXyCv7uWnieb98UXRFrMoxjwoGl3zCPlqPm6pYqjUvqrJDSD3xUa4fZ/rGP/NY8EUwmP3lgJ3ZStrgf3lsBEH8MJla0QjdTPfe6+oz0Xjgs3Ay/vX7adiKD7y1oZPPPrNio9j2oubpIzG8GJ3AaMtgAsm3O/umOG4tQMKAGXxsajgAIWKlYY3Q+Z7XgEVumcb9kDjgwpqQ0KFE7re9DC3R+1/xwyWF1o6HM2CC7bl3YsoKdfDwHjWQTmqENTsjRS7pW5YHNZeuJJlbNcX40NWOXh5ydRdwgg7IZbTVJlANlQux124Ad/5/adpxp5 smithi195.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDWXIMgb04d6eo6e3cyP/pPcQ9j6jzW4+ZmWZMShVD1q/ZULMulJjAeF+xHYTaEBz/kptBTFvAVZpGAn28pBfyh8ODARNwtGHyhiOlhpjX+utSZdnoHP1d9i8usUhwNM4cugQCvEv4koIZwCiuMswlJDuZNsN8PiQBEVvOe/y7jjJBruwWLfG65SjIwz+Zy6GAoPhhbqbv14f2LS7CCot3ON2Kh5a4UTkthHIPyyHTCuQp862WoH32CEv9fD7h5vyJKqVZtoySLG+mj5ihsKd9Ny1rEPetcpiRu19kmjDTTNR+CfoGCMNaFnyhwPGI/lhnVRawBb4v4Xhk/iwlht3NR 2020-12-26T01:56:08.589 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-12-26T01:56:08.655 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-12-26T01:56:08.664 INFO:teuthology.task.internal:Saving configuration 2020-12-26T01:56:08.679 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-12-26T01:56:08.686 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-12-26T01:56:08.706 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': False, 'locked_since': None, 'description': None, 'locked_by': None, 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIL1g6HsD6jUKg+RD89ZOQRMB6dC2XB1QL7w8CeKlI6yq', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi168.front.sepia.ceph.com'} 2020-12-26T01:56:08.707 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/check_lock.py", line 29, in check_lock 'machine {name} is not locked'.format(name=machine) AssertionError: machine smithi168.front.sepia.ceph.com is not locked 2020-12-26T01:56:08.729 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=739f3e0145014541afd6afd4683b7818 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 91, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 70, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/check_lock.py", line 29, in check_lock 'machine {name} is not locked'.format(name=machine) AssertionError: machine smithi168.front.sepia.ceph.com is not locked 2020-12-26T01:56:08.729 DEBUG:teuthology.run_tasks:Unwinding manager internal.lock_machines 2020-12-26T01:56:08.754 INFO:teuthology.nuke:Checking targets against current locks 2020-12-26T01:56:08.873 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/scripts/run.py", line 38, in main teuthology.run.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run.py", line 411, in main report_outcome(config, archive, fake_ctx.summary, fake_ctx) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run.py", line 268, in report_outcome nuke(fake_ctx, fake_ctx.lock) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable