2021-06-29T21:44:22.570 INFO:root:teuthology version: 1.1.0-26631ede
2021-06-29T21:44:22.668 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging
2021-06-29T21:44:22.669 INFO:teuthology.lock.ops:Updating [ubuntu@smithi163.front.sepia.ceph.com]: reset os type and version on server
2021-06-29T21:44:22.669 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2021-06-29T21:44:22.686 INFO:teuthology.lock.ops:Node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging is complete
2021-06-29T21:44:22.686 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi201.front.sepia.ceph.com' reimaging
2021-06-29T21:44:22.687 INFO:teuthology.lock.ops:Updating [ubuntu@smithi201.front.sepia.ceph.com]: reset os type and version on server
2021-06-29T21:44:22.687 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server
2021-06-29T21:44:22.703 INFO:teuthology.lock.ops:Node 'ubuntu@smithi201.front.sepia.ceph.com' reimaging is complete
2021-06-29T21:44:22.901 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of ubuntu 20.04
2021-06-29T21:44:22.908 INFO:teuthology.provision.fog.smithi201:Scheduling deploy of ubuntu 20.04
2021-06-29T21:44:23.224 INFO:teuthology.orchestra.console:Power off smithi201
2021-06-29T21:44:23.241 INFO:teuthology.orchestra.console:Power off smithi163
2021-06-29T21:44:31.612 INFO:teuthology.orchestra.console:Power off for smithi201 completed
2021-06-29T21:44:31.713 INFO:teuthology.orchestra.console:Power on smithi201
2021-06-29T21:44:35.734 INFO:teuthology.orchestra.console:Power off for smithi163 completed
2021-06-29T21:44:35.836 INFO:teuthology.orchestra.console:Power on smithi163
2021-06-29T21:44:40.086 INFO:teuthology.orchestra.console:Power on for smithi201 completed
2021-06-29T21:44:40.094 INFO:teuthology.orchestra.console:Power on for smithi163 completed
2021-06-29T21:44:40.188 INFO:teuthology.provision.fog.smithi201:Waiting for deploy to finish
2021-06-29T21:44:40.195 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2021-06-29T21:49:34.646 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-06-29T21:49:35.123 INFO:teuthology.provision.fog.smithi201:Node is ready
2021-06-29T21:49:35.130 INFO:teuthology.orchestra.run.smithi201.stdout:smithi201.front.sepia.ceph.com
2021-06-29T21:49:35.136 INFO:teuthology.orchestra.run.smithi201.stdout:172.21.15.201 smithi201.front.sepia.ceph.com smithi201
2021-06-29T21:49:35.327 INFO:teuthology.provision.fog.smithi201:Deploy complete!
2021-06-29T21:50:34.947 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-06-29T21:50:35.375 INFO:teuthology.provision.fog.smithi163:Node is ready
2021-06-29T21:50:35.382 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2021-06-29T21:50:35.431 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2021-06-29T21:50:35.625 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2021-06-29T21:50:35.804 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com
2021-06-29T21:50:35.805 INFO:teuthology.lock.ops:New key found. Updating...
2021-06-29T21:50:35.830 INFO:teuthology.lock.ops:Checking smithi201.front.sepia.ceph.com
2021-06-29T21:50:35.831 INFO:teuthology.lock.ops:New key found. Updating...
2021-06-29T21:50:35.856 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server
2021-06-29T21:50:35.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-06-29T21:50:36.034 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64
2021-06-29T21:50:36.040 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu"
2021-06-29T21:50:36.041 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-06-29T21:50:36.041 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu
2021-06-29T21:50:36.041 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian
2021-06-29T21:50:36.041 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-06-29T21:50:36.042 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="20.04"
2021-06-29T21:50:36.042 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/"
2021-06-29T21:50:36.042 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-06-29T21:50:36.042 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-06-29T21:50:36.043 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-06-29T21:50:36.043 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=focal
2021-06-29T21:50:36.043 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=focal
2021-06-29T21:50:36.044 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2021-06-29T21:50:36.060 INFO:teuthology.lock.ops:Updating [smithi201.front.sepia.ceph.com]: set os type and version on server
2021-06-29T21:50:36.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-06-29T21:50:36.239 INFO:teuthology.orchestra.run.smithi201.stdout:x86_64
2021-06-29T21:50:36.286 INFO:teuthology.orchestra.run.smithi201.stdout:NAME="Ubuntu"
2021-06-29T21:50:36.286 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-06-29T21:50:36.287 INFO:teuthology.orchestra.run.smithi201.stdout:ID=ubuntu
2021-06-29T21:50:36.287 INFO:teuthology.orchestra.run.smithi201.stdout:ID_LIKE=debian
2021-06-29T21:50:36.287 INFO:teuthology.orchestra.run.smithi201.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-06-29T21:50:36.287 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION_ID="20.04"
2021-06-29T21:50:36.288 INFO:teuthology.orchestra.run.smithi201.stdout:HOME_URL="https://www.ubuntu.com/"
2021-06-29T21:50:36.288 INFO:teuthology.orchestra.run.smithi201.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-06-29T21:50:36.288 INFO:teuthology.orchestra.run.smithi201.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-06-29T21:50:36.288 INFO:teuthology.orchestra.run.smithi201.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-06-29T21:50:36.288 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION_CODENAME=focal
2021-06-29T21:50:36.289 INFO:teuthology.orchestra.run.smithi201.stdout:UBUNTU_CODENAME=focal
2021-06-29T21:50:36.289 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server
2021-06-29T21:50:36.381 INFO:teuthology.dispatcher.supervisor:Running job 6243750
2021-06-29T21:50:36.381 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2021-06-29_20:27:56-fs-wip-pdonnell-testing-20210629.182657-distro-basic-smithi/6243750 --name pdonnell-2021-06-29_20:27:56-fs-wip-pdonnell-testing-20210629.182657-distro-basic-smithi --description fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} -- /home/teuthworker/archive/pdonnell-2021-06-29_20:27:56-fs-wip-pdonnell-testing-20210629.182657-distro-basic-smithi/6243750/orig.config.yaml
2021-06-29T21:50:36.385 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2021-06-29_20:27:56-fs-wip-pdonnell-testing-20210629.182657-distro-basic-smithi/6243750
2021-06-29T21:50:36.386 INFO:teuthology.dispatcher.supervisor:Job PID: 11903
2021-06-29T21:50:36.386 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-06-29T22:42:40.013 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/pdonnell-2021-06-29_20:27:56-fs-wip-pdonnell-testing-20210629.182657-distro-basic-smithi/jobs/ failed with status 500:
Internal Server Error
Internal Server Error
2021-06-29T22:58:42.223 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-06-29T22:58:42.416 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-06-29T22:58:42.417 INFO:teuthology.nuke:Checking targets against current locks
2021-06-29T22:58:42.492 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology-dispatcher", line 33, in
sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/scripts/dispatcher.py", line 33, in main
teuthology.dispatcher.main(args)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/__init__.py", line 61, in main
return supervisor.main(args)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/supervisor.py", line 59, in main
verbose
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/supervisor.py", line 152, in run_job
unlock_targets(job_config)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets
nuke(fake_ctx, True)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/nuke/__init__.py", line 250, in nuke
if ctx.name not in lock['description']:
TypeError: argument of type 'NoneType' is not iterable