2021-07-29T04:42:40.867 INFO:root:teuthology version: 1.1.0-73aa7e3b 2021-07-29T04:42:40.967 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging 2021-07-29T04:42:40.968 INFO:teuthology.lock.ops:Updating [ubuntu@smithi022.front.sepia.ceph.com]: reset os type and version on server 2021-07-29T04:42:40.968 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2021-07-29T04:42:40.985 INFO:teuthology.lock.ops:Node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging is complete 2021-07-29T04:42:40.985 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging 2021-07-29T04:42:40.986 INFO:teuthology.lock.ops:Updating [ubuntu@smithi060.front.sepia.ceph.com]: reset os type and version on server 2021-07-29T04:42:40.986 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2021-07-29T04:42:41.003 INFO:teuthology.lock.ops:Node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging is complete 2021-07-29T04:42:41.192 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of ubuntu 20.04 2021-07-29T04:42:41.203 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of ubuntu 20.04 2021-07-29T04:42:41.506 INFO:teuthology.orchestra.console:Power off smithi022 2021-07-29T04:42:41.543 INFO:teuthology.orchestra.console:Power off smithi060 2021-07-29T04:42:41.653 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2021-07-29T04:42:41.688 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2021-07-29T04:42:41.756 INFO:teuthology.orchestra.console:Power on smithi022 2021-07-29T04:42:41.790 INFO:teuthology.orchestra.console:Power on smithi060 2021-07-29T04:42:46.044 INFO:teuthology.orchestra.console:Power on for smithi060 completed 2021-07-29T04:42:46.145 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2021-07-29T04:42:50.125 INFO:teuthology.orchestra.console:Power on for smithi022 completed 2021-07-29T04:42:50.226 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2021-07-29T04:47:24.259 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-29T04:47:24.734 INFO:teuthology.provision.fog.smithi060:Node is ready 2021-07-29T04:47:24.741 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com 2021-07-29T04:47:24.795 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060 2021-07-29T04:47:24.999 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2021-07-29T04:48:59.108 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-29T04:48:59.589 INFO:teuthology.provision.fog.smithi022:Node is ready 2021-07-29T04:48:59.596 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2021-07-29T04:48:59.644 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2021-07-29T04:48:59.834 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2021-07-29T04:49:00.008 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2021-07-29T04:49:00.009 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-29T04:49:00.024 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2021-07-29T04:49:00.025 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-29T04:49:00.043 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2021-07-29T04:49:00.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-29T04:49:00.230 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2021-07-29T04:49:00.238 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Ubuntu" 2021-07-29T04:49:00.238 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-07-29T04:49:00.239 INFO:teuthology.orchestra.run.smithi022.stdout:ID=ubuntu 2021-07-29T04:49:00.239 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE=debian 2021-07-29T04:49:00.240 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-07-29T04:49:00.240 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="20.04" 2021-07-29T04:49:00.241 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.ubuntu.com/" 2021-07-29T04:49:00.241 INFO:teuthology.orchestra.run.smithi022.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-07-29T04:49:00.241 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-07-29T04:49:00.242 INFO:teuthology.orchestra.run.smithi022.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-07-29T04:49:00.242 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_CODENAME=focal 2021-07-29T04:49:00.243 INFO:teuthology.orchestra.run.smithi022.stdout:UBUNTU_CODENAME=focal 2021-07-29T04:49:00.245 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2021-07-29T04:49:00.260 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2021-07-29T04:49:00.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-29T04:49:00.555 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2021-07-29T04:49:00.562 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Ubuntu" 2021-07-29T04:49:00.563 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-07-29T04:49:00.563 INFO:teuthology.orchestra.run.smithi060.stdout:ID=ubuntu 2021-07-29T04:49:00.563 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE=debian 2021-07-29T04:49:00.563 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-07-29T04:49:00.564 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="20.04" 2021-07-29T04:49:00.564 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.ubuntu.com/" 2021-07-29T04:49:00.564 INFO:teuthology.orchestra.run.smithi060.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-07-29T04:49:00.564 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-07-29T04:49:00.564 INFO:teuthology.orchestra.run.smithi060.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-07-29T04:49:00.565 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_CODENAME=focal 2021-07-29T04:49:00.565 INFO:teuthology.orchestra.run.smithi060.stdout:UBUNTU_CODENAME=focal 2021-07-29T04:49:00.565 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2021-07-29T04:49:00.643 INFO:teuthology.dispatcher.supervisor:Running job 6300138 2021-07-29T04:49:00.643 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology -v --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-07-29_03:28:08-rados-wip-kefu-testing-2021-07-29-0930-distro-basic-smithi/6300138 --name kchai-2021-07-29_03:28:08-rados-wip-kefu-testing-2021-07-29-0930-distro-basic-smithi --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /home/teuthworker/archive/kchai-2021-07-29_03:28:08-rados-wip-kefu-testing-2021-07-29-0930-distro-basic-smithi/6300138/orig.config.yaml 2021-07-29T04:49:00.647 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kchai-2021-07-29_03:28:08-rados-wip-kefu-testing-2021-07-29-0930-distro-basic-smithi/6300138 2021-07-29T04:49:00.648 INFO:teuthology.dispatcher.supervisor:Job PID: 15060 2021-07-29T04:49:00.649 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-07-29T05:01:01.335 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-07-29T05:01:01.422 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-07-29T05:01:01.423 INFO:teuthology.nuke:Checking targets against current locks 2021-07-29T05:01:01.497 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 59, in main verbose File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 152, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets nuke(fake_ctx, True) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable