2021-03-13T22:00:44.916 INFO:root:teuthology version: 1.1.0-b9656917 2021-03-13T22:00:45.218 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi041.front.sepia.ceph.com' reimaging 2021-03-13T22:00:45.219 INFO:teuthology.lock.ops:Updating [ubuntu@smithi041.front.sepia.ceph.com]: reset os type and version on server 2021-03-13T22:00:45.219 INFO:teuthology.lock.ops:Updating smithi041.front.sepia.ceph.com on lock server 2021-03-13T22:00:45.240 INFO:teuthology.lock.ops:Node 'ubuntu@smithi041.front.sepia.ceph.com' reimaging is complete 2021-03-13T22:00:45.241 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi083.front.sepia.ceph.com' reimaging 2021-03-13T22:00:45.241 INFO:teuthology.lock.ops:Updating [ubuntu@smithi083.front.sepia.ceph.com]: reset os type and version on server 2021-03-13T22:00:45.242 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2021-03-13T22:00:45.262 INFO:teuthology.lock.ops:Node 'ubuntu@smithi083.front.sepia.ceph.com' reimaging is complete 2021-03-13T22:00:45.262 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi195.front.sepia.ceph.com' reimaging 2021-03-13T22:00:45.263 INFO:teuthology.lock.ops:Updating [ubuntu@smithi195.front.sepia.ceph.com]: reset os type and version on server 2021-03-13T22:00:45.263 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2021-03-13T22:00:45.286 INFO:teuthology.lock.ops:Node 'ubuntu@smithi195.front.sepia.ceph.com' reimaging is complete 2021-03-13T22:00:45.450 INFO:teuthology.provision.fog.smithi041:Scheduling deploy of centos 8.3 2021-03-13T22:00:45.481 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of centos 8.3 2021-03-13T22:00:45.519 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 8.3 2021-03-13T22:00:45.843 INFO:teuthology.orchestra.console:Power off smithi041 2021-03-13T22:00:45.947 INFO:teuthology.orchestra.console:Power off smithi083 2021-03-13T22:00:46.013 INFO:teuthology.orchestra.console:Power off smithi195 2021-03-13T22:00:46.254 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2021-03-13T22:00:46.306 INFO:teuthology.orchestra.console:Power off for smithi041 completed 2021-03-13T22:00:46.314 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2021-03-13T22:00:46.356 INFO:teuthology.orchestra.console:Power on smithi083 2021-03-13T22:00:46.408 INFO:teuthology.orchestra.console:Power on smithi041 2021-03-13T22:00:46.431 INFO:teuthology.orchestra.console:Power on smithi195 2021-03-13T22:00:50.801 INFO:teuthology.orchestra.console:Power on for smithi083 completed 2021-03-13T22:00:50.823 INFO:teuthology.orchestra.console:Power on for smithi195 completed 2021-03-13T22:00:50.904 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2021-03-13T22:00:50.924 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2021-03-13T22:00:55.018 INFO:teuthology.orchestra.console:Power on for smithi041 completed 2021-03-13T22:00:55.120 INFO:teuthology.provision.fog.smithi041:Waiting for deploy to finish 2021-03-13T22:05:11.668 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-13T22:05:12.048 INFO:teuthology.provision.fog.smithi041:Node is ready 2021-03-13T22:05:12.068 INFO:teuthology.orchestra.run.smithi041.stdout:smithi041.front.sepia.ceph.com 2021-03-13T22:05:12.125 INFO:teuthology.orchestra.run.smithi041.stdout:172.21.15.41 smithi041.front.sepia.ceph.com smithi041 2021-03-13T22:05:12.473 INFO:teuthology.provision.fog.smithi041:Deploy complete! 2021-03-13T22:05:22.574 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-13T22:05:22.891 INFO:teuthology.provision.fog.smithi195:Node is ready 2021-03-13T22:05:22.906 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2021-03-13T22:05:22.961 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2021-03-13T22:05:23.279 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2021-03-13T22:05:37.597 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-13T22:05:37.930 INFO:teuthology.provision.fog.smithi083:Node is ready 2021-03-13T22:05:37.944 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2021-03-13T22:05:37.999 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2021-03-13T22:05:38.318 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2021-03-13T22:05:38.530 INFO:teuthology.lock.ops:Checking smithi041.front.sepia.ceph.com 2021-03-13T22:05:38.531 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-13T22:05:38.547 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2021-03-13T22:05:38.547 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-13T22:05:38.559 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2021-03-13T22:05:38.560 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-13T22:05:38.573 INFO:teuthology.lock.ops:Updating [smithi041.front.sepia.ceph.com]: set os type and version on server 2021-03-13T22:05:38.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-13T22:05:38.868 INFO:teuthology.orchestra.run.smithi041.stdout:x86_64 2021-03-13T22:05:38.924 INFO:teuthology.orchestra.run.smithi041.stdout:NAME="CentOS Linux" 2021-03-13T22:05:38.924 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION="8" 2021-03-13T22:05:38.924 INFO:teuthology.orchestra.run.smithi041.stdout:ID="centos" 2021-03-13T22:05:38.924 INFO:teuthology.orchestra.run.smithi041.stdout:ID_LIKE="rhel fedora" 2021-03-13T22:05:38.925 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION_ID="8" 2021-03-13T22:05:38.925 INFO:teuthology.orchestra.run.smithi041.stdout:PLATFORM_ID="platform:el8" 2021-03-13T22:05:38.925 INFO:teuthology.orchestra.run.smithi041.stdout:PRETTY_NAME="CentOS Linux 8" 2021-03-13T22:05:38.925 INFO:teuthology.orchestra.run.smithi041.stdout:ANSI_COLOR="0;31" 2021-03-13T22:05:38.925 INFO:teuthology.orchestra.run.smithi041.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-03-13T22:05:38.926 INFO:teuthology.orchestra.run.smithi041.stdout:HOME_URL="https://centos.org/" 2021-03-13T22:05:38.926 INFO:teuthology.orchestra.run.smithi041.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-03-13T22:05:38.926 INFO:teuthology.orchestra.run.smithi041.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-03-13T22:05:38.926 INFO:teuthology.orchestra.run.smithi041.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-03-13T22:05:38.928 INFO:teuthology.lock.ops:Updating smithi041.front.sepia.ceph.com on lock server 2021-03-13T22:05:38.944 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2021-03-13T22:05:38.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-13T22:05:39.156 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2021-03-13T22:05:39.210 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Linux" 2021-03-13T22:05:39.210 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8" 2021-03-13T22:05:39.211 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2021-03-13T22:05:39.211 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2021-03-13T22:05:39.211 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8" 2021-03-13T22:05:39.211 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2021-03-13T22:05:39.212 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Linux 8" 2021-03-13T22:05:39.212 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2021-03-13T22:05:39.212 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-03-13T22:05:39.212 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2021-03-13T22:05:39.212 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-03-13T22:05:39.213 INFO:teuthology.orchestra.run.smithi083.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-03-13T22:05:39.213 INFO:teuthology.orchestra.run.smithi083.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-03-13T22:05:39.213 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2021-03-13T22:05:39.231 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2021-03-13T22:05:39.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-13T22:05:39.569 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2021-03-13T22:05:39.625 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Linux" 2021-03-13T22:05:39.626 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8" 2021-03-13T22:05:39.626 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2021-03-13T22:05:39.626 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2021-03-13T22:05:39.627 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8" 2021-03-13T22:05:39.627 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2021-03-13T22:05:39.627 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Linux 8" 2021-03-13T22:05:39.628 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2021-03-13T22:05:39.628 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-03-13T22:05:39.628 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2021-03-13T22:05:39.628 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-03-13T22:05:39.629 INFO:teuthology.orchestra.run.smithi195.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-03-13T22:05:39.629 INFO:teuthology.orchestra.run.smithi195.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-03-13T22:05:39.630 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2021-03-13T22:05:39.743 INFO:teuthology.dispatcher.supervisor:Running job 5961260 2021-03-13T22:05:39.747 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/virtualenv/bin/teuthology -v --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-03-13_08:16:32-rados-wip-kefu-testing-2021-03-13-1449-distro-basic-smithi/5961260 --name kchai-2021-03-13_08:16:32-rados-wip-kefu-testing-2021-03-13-1449-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/kchai-2021-03-13_08:16:32-rados-wip-kefu-testing-2021-03-13-1449-distro-basic-smithi/5961260/orig.config.yaml 2021-03-13T22:05:39.768 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kchai-2021-03-13_08:16:32-rados-wip-kefu-testing-2021-03-13-1449-distro-basic-smithi/5961260 2021-03-13T22:05:39.772 INFO:teuthology.dispatcher.supervisor:Job PID: 19724 2021-03-13T22:05:39.772 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-03-13T22:31:41.581 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-03-13T22:31:41.764 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-03-13T22:31:41.765 INFO:teuthology.nuke:Checking targets against current locks 2021-03-13T22:31:41.836 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/dispatcher/supervisor.py", line 59, in main verbose File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/dispatcher/supervisor.py", line 152, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets nuke(fake_ctx, True) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable