2021-06-29T21:04:52.018 INFO:root:teuthology version: 1.1.0-26631ede 2021-06-29T21:04:52.117 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi075.front.sepia.ceph.com' reimaging 2021-06-29T21:04:52.118 INFO:teuthology.lock.ops:Updating [ubuntu@smithi075.front.sepia.ceph.com]: reset os type and version on server 2021-06-29T21:04:52.118 INFO:teuthology.lock.ops:Updating smithi075.front.sepia.ceph.com on lock server 2021-06-29T21:04:52.135 INFO:teuthology.lock.ops:Node 'ubuntu@smithi075.front.sepia.ceph.com' reimaging is complete 2021-06-29T21:04:52.135 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi121.front.sepia.ceph.com' reimaging 2021-06-29T21:04:52.136 INFO:teuthology.lock.ops:Updating [ubuntu@smithi121.front.sepia.ceph.com]: reset os type and version on server 2021-06-29T21:04:52.136 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2021-06-29T21:04:52.152 INFO:teuthology.lock.ops:Node 'ubuntu@smithi121.front.sepia.ceph.com' reimaging is complete 2021-06-29T21:04:52.359 INFO:teuthology.provision.fog.smithi075:Scheduling deploy of rhel 8.4 2021-06-29T21:04:52.366 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of rhel 8.4 2021-06-29T21:04:52.715 INFO:teuthology.orchestra.console:Power off smithi121 2021-06-29T21:04:52.754 INFO:teuthology.orchestra.console:Power off smithi075 2021-06-29T21:05:01.097 INFO:teuthology.orchestra.console:Power off for smithi121 completed 2021-06-29T21:05:01.198 INFO:teuthology.orchestra.console:Power on smithi121 2021-06-29T21:05:05.238 INFO:teuthology.orchestra.console:Power off for smithi075 completed 2021-06-29T21:05:05.341 INFO:teuthology.orchestra.console:Power on smithi075 2021-06-29T21:05:09.577 INFO:teuthology.orchestra.console:Power on for smithi121 completed 2021-06-29T21:05:09.608 INFO:teuthology.orchestra.console:Power on for smithi075 completed 2021-06-29T21:05:09.680 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2021-06-29T21:05:09.709 INFO:teuthology.provision.fog.smithi075:Waiting for deploy to finish 2021-06-29T21:07:41.038 ERROR:teuthology.orchestra.connection:Error authenticating with smithi075.front.sepia.ceph.com: Authentication failed. 2021-06-29T21:09:50.633 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-29T21:09:50.842 INFO:teuthology.provision.fog.smithi121:Node is ready 2021-06-29T21:09:50.898 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2021-06-29T21:09:50.959 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2021-06-29T21:09:51.291 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2021-06-29T21:09:54.364 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-29T21:09:54.580 INFO:teuthology.provision.fog.smithi075:Node is ready 2021-06-29T21:09:54.599 INFO:teuthology.orchestra.run.smithi075.stdout:smithi075.front.sepia.ceph.com 2021-06-29T21:09:54.656 INFO:teuthology.orchestra.run.smithi075.stdout:172.21.15.75 smithi075.front.sepia.ceph.com smithi075 2021-06-29T21:09:54.989 INFO:teuthology.provision.fog.smithi075:Deploy complete! 2021-06-29T21:09:55.110 INFO:teuthology.lock.ops:Checking smithi075.front.sepia.ceph.com 2021-06-29T21:09:55.111 INFO:teuthology.lock.ops:New key found. Updating... 2021-06-29T21:09:55.132 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2021-06-29T21:09:55.132 INFO:teuthology.lock.ops:New key found. Updating... 2021-06-29T21:09:55.148 INFO:teuthology.lock.ops:Updating [smithi075.front.sepia.ceph.com]: set os type and version on server 2021-06-29T21:09:55.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-29T21:09:55.375 INFO:teuthology.orchestra.run.smithi075.stdout:x86_64 2021-06-29T21:09:55.430 INFO:teuthology.orchestra.run.smithi075.stdout:NAME="Red Hat Enterprise Linux" 2021-06-29T21:09:55.430 INFO:teuthology.orchestra.run.smithi075.stdout:VERSION="8.4 (Ootpa)" 2021-06-29T21:09:55.431 INFO:teuthology.orchestra.run.smithi075.stdout:ID="rhel" 2021-06-29T21:09:55.431 INFO:teuthology.orchestra.run.smithi075.stdout:ID_LIKE="fedora" 2021-06-29T21:09:55.431 INFO:teuthology.orchestra.run.smithi075.stdout:VERSION_ID="8.4" 2021-06-29T21:09:55.432 INFO:teuthology.orchestra.run.smithi075.stdout:PLATFORM_ID="platform:el8" 2021-06-29T21:09:55.432 INFO:teuthology.orchestra.run.smithi075.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-06-29T21:09:55.432 INFO:teuthology.orchestra.run.smithi075.stdout:ANSI_COLOR="0;31" 2021-06-29T21:09:55.432 INFO:teuthology.orchestra.run.smithi075.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-06-29T21:09:55.433 INFO:teuthology.orchestra.run.smithi075.stdout:HOME_URL="https://www.redhat.com/" 2021-06-29T21:09:55.433 INFO:teuthology.orchestra.run.smithi075.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-06-29T21:09:55.433 INFO:teuthology.orchestra.run.smithi075.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-06-29T21:09:55.433 INFO:teuthology.orchestra.run.smithi075.stdout: 2021-06-29T21:09:55.433 INFO:teuthology.orchestra.run.smithi075.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-06-29T21:09:55.434 INFO:teuthology.orchestra.run.smithi075.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-06-29T21:09:55.434 INFO:teuthology.orchestra.run.smithi075.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-06-29T21:09:55.434 INFO:teuthology.orchestra.run.smithi075.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-06-29T21:09:55.436 INFO:teuthology.lock.ops:Updating smithi075.front.sepia.ceph.com on lock server 2021-06-29T21:09:55.453 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2021-06-29T21:09:55.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-29T21:09:55.656 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2021-06-29T21:09:55.721 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Red Hat Enterprise Linux" 2021-06-29T21:09:55.722 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8.4 (Ootpa)" 2021-06-29T21:09:55.722 INFO:teuthology.orchestra.run.smithi121.stdout:ID="rhel" 2021-06-29T21:09:55.722 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="fedora" 2021-06-29T21:09:55.723 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8.4" 2021-06-29T21:09:55.723 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2021-06-29T21:09:55.723 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-06-29T21:09:55.723 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2021-06-29T21:09:55.724 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-06-29T21:09:55.724 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.redhat.com/" 2021-06-29T21:09:55.724 INFO:teuthology.orchestra.run.smithi121.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-06-29T21:09:55.724 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-06-29T21:09:55.725 INFO:teuthology.orchestra.run.smithi121.stdout: 2021-06-29T21:09:55.725 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-06-29T21:09:55.725 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-06-29T21:09:55.725 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-06-29T21:09:55.726 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-06-29T21:09:55.726 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2021-06-29T21:09:55.839 INFO:teuthology.dispatcher.supervisor:Running job 6243717 2021-06-29T21:09:55.840 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2021-06-29_20:27:56-fs-wip-pdonnell-testing-20210629.182657-distro-basic-smithi/6243717 --name pdonnell-2021-06-29_20:27:56-fs-wip-pdonnell-testing-20210629.182657-distro-basic-smithi --description fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/pdonnell-2021-06-29_20:27:56-fs-wip-pdonnell-testing-20210629.182657-distro-basic-smithi/6243717/orig.config.yaml 2021-06-29T21:09:55.843 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2021-06-29_20:27:56-fs-wip-pdonnell-testing-20210629.182657-distro-basic-smithi/6243717 2021-06-29T21:09:55.844 INFO:teuthology.dispatcher.supervisor:Job PID: 17146 2021-06-29T21:09:55.844 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-06-29T22:57:58.281 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-06-29T22:57:58.444 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-06-29T22:57:58.445 INFO:teuthology.nuke:Checking targets against current locks 2021-06-29T22:57:58.509 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/supervisor.py", line 59, in main verbose File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/supervisor.py", line 152, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets nuke(fake_ctx, True) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable