2021-07-29T09:03:42.834 INFO:root:teuthology version: 1.1.0-73aa7e3b 2021-07-29T09:03:42.986 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi007.front.sepia.ceph.com' reimaging 2021-07-29T09:03:42.987 INFO:teuthology.lock.ops:Updating [ubuntu@smithi007.front.sepia.ceph.com]: reset os type and version on server 2021-07-29T09:03:42.987 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2021-07-29T09:03:43.002 INFO:teuthology.lock.ops:Node 'ubuntu@smithi007.front.sepia.ceph.com' reimaging is complete 2021-07-29T09:03:43.002 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging 2021-07-29T09:03:43.003 INFO:teuthology.lock.ops:Updating [ubuntu@smithi017.front.sepia.ceph.com]: reset os type and version on server 2021-07-29T09:03:43.003 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2021-07-29T09:03:43.020 INFO:teuthology.lock.ops:Node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging is complete 2021-07-29T09:03:43.020 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi144.front.sepia.ceph.com' reimaging 2021-07-29T09:03:43.021 INFO:teuthology.lock.ops:Updating [ubuntu@smithi144.front.sepia.ceph.com]: reset os type and version on server 2021-07-29T09:03:43.021 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2021-07-29T09:03:43.036 INFO:teuthology.lock.ops:Node 'ubuntu@smithi144.front.sepia.ceph.com' reimaging is complete 2021-07-29T09:03:43.037 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging 2021-07-29T09:03:43.037 INFO:teuthology.lock.ops:Updating [ubuntu@smithi155.front.sepia.ceph.com]: reset os type and version on server 2021-07-29T09:03:43.037 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2021-07-29T09:03:43.053 INFO:teuthology.lock.ops:Node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging is complete 2021-07-29T09:03:43.218 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of centos 8.3 2021-07-29T09:03:43.251 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of centos 8.3 2021-07-29T09:03:43.260 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 8.3 2021-07-29T09:03:43.261 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 8.3 2021-07-29T09:03:43.559 INFO:teuthology.orchestra.console:Power off smithi007 2021-07-29T09:03:43.624 INFO:teuthology.orchestra.console:Power off smithi017 2021-07-29T09:03:43.642 INFO:teuthology.orchestra.console:Power off smithi144 2021-07-29T09:03:43.654 INFO:teuthology.orchestra.console:Power off smithi155 2021-07-29T09:03:51.934 INFO:teuthology.orchestra.console:Power off for smithi007 completed 2021-07-29T09:03:52.012 INFO:teuthology.orchestra.console:Power off for smithi144 completed 2021-07-29T09:03:52.019 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2021-07-29T09:03:52.026 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2021-07-29T09:03:52.036 INFO:teuthology.orchestra.console:Power on smithi007 2021-07-29T09:03:52.114 INFO:teuthology.orchestra.console:Power on smithi144 2021-07-29T09:03:52.122 INFO:teuthology.orchestra.console:Power on smithi155 2021-07-29T09:03:52.130 INFO:teuthology.orchestra.console:Power on smithi017 2021-07-29T09:03:56.383 INFO:teuthology.orchestra.console:Power on for smithi155 completed 2021-07-29T09:03:56.485 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2021-07-29T09:04:00.412 INFO:teuthology.orchestra.console:Power on for smithi007 completed 2021-07-29T09:04:00.488 INFO:teuthology.orchestra.console:Power on for smithi144 completed 2021-07-29T09:04:00.502 INFO:teuthology.orchestra.console:Power on for smithi017 completed 2021-07-29T09:04:00.513 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2021-07-29T09:04:00.589 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2021-07-29T09:04:00.604 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2021-07-29T09:08:08.203 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-29T09:08:08.584 INFO:teuthology.provision.fog.smithi007:Node is ready 2021-07-29T09:08:08.600 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2021-07-29T09:08:08.656 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2021-07-29T09:08:08.992 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2021-07-29T09:08:17.242 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-29T09:08:17.557 INFO:teuthology.provision.fog.smithi017:Node is ready 2021-07-29T09:08:17.573 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2021-07-29T09:08:17.628 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2021-07-29T09:08:17.960 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2021-07-29T09:08:22.654 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-29T09:08:32.368 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-29T09:08:32.717 INFO:teuthology.provision.fog.smithi144:Node is ready 2021-07-29T09:08:32.732 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com 2021-07-29T09:08:32.787 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2021-07-29T09:08:33.107 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2021-07-29T09:08:43.345 INFO:teuthology.provision.fog.smithi155:Node is ready 2021-07-29T09:08:43.363 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2021-07-29T09:08:43.420 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2021-07-29T09:08:43.770 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2021-07-29T09:08:43.968 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com 2021-07-29T09:08:43.969 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-29T09:08:43.985 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2021-07-29T09:08:43.986 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-29T09:08:44.001 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2021-07-29T09:08:44.002 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-29T09:08:44.017 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2021-07-29T09:08:44.017 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-29T09:08:44.034 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server 2021-07-29T09:08:44.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-29T09:08:44.335 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2021-07-29T09:08:44.391 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Linux" 2021-07-29T09:08:44.391 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8" 2021-07-29T09:08:44.391 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2021-07-29T09:08:44.392 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2021-07-29T09:08:44.392 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8" 2021-07-29T09:08:44.392 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8" 2021-07-29T09:08:44.396 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Linux 8" 2021-07-29T09:08:44.396 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2021-07-29T09:08:44.396 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-07-29T09:08:44.397 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2021-07-29T09:08:44.397 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-07-29T09:08:44.397 INFO:teuthology.orchestra.run.smithi007.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-07-29T09:08:44.397 INFO:teuthology.orchestra.run.smithi007.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-07-29T09:08:44.399 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2021-07-29T09:08:44.415 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2021-07-29T09:08:44.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-29T09:08:44.709 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2021-07-29T09:08:44.765 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Linux" 2021-07-29T09:08:44.766 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8" 2021-07-29T09:08:44.766 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2021-07-29T09:08:44.766 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2021-07-29T09:08:44.766 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8" 2021-07-29T09:08:44.767 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2021-07-29T09:08:44.767 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Linux 8" 2021-07-29T09:08:44.767 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2021-07-29T09:08:44.767 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-07-29T09:08:44.767 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2021-07-29T09:08:44.768 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-07-29T09:08:44.768 INFO:teuthology.orchestra.run.smithi017.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-07-29T09:08:44.768 INFO:teuthology.orchestra.run.smithi017.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-07-29T09:08:44.769 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2021-07-29T09:08:44.784 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2021-07-29T09:08:44.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-29T09:08:45.007 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2021-07-29T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Linux" 2021-07-29T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8" 2021-07-29T09:08:45.063 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2021-07-29T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2021-07-29T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8" 2021-07-29T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2021-07-29T09:08:45.064 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Linux 8" 2021-07-29T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2021-07-29T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-07-29T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2021-07-29T09:08:45.065 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-07-29T09:08:45.066 INFO:teuthology.orchestra.run.smithi144.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-07-29T09:08:45.066 INFO:teuthology.orchestra.run.smithi144.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-07-29T09:08:45.066 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2021-07-29T09:08:45.084 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2021-07-29T09:08:45.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-29T09:08:45.306 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2021-07-29T09:08:45.362 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Linux" 2021-07-29T09:08:45.362 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8" 2021-07-29T09:08:45.362 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2021-07-29T09:08:45.363 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2021-07-29T09:08:45.363 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8" 2021-07-29T09:08:45.364 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2021-07-29T09:08:45.364 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Linux 8" 2021-07-29T09:08:45.364 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2021-07-29T09:08:45.364 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-07-29T09:08:45.365 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2021-07-29T09:08:45.365 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-07-29T09:08:45.365 INFO:teuthology.orchestra.run.smithi155.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-07-29T09:08:45.365 INFO:teuthology.orchestra.run.smithi155.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-07-29T09:08:45.366 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2021-07-29T09:08:45.443 INFO:teuthology.dispatcher.supervisor:Running job 6300942 2021-07-29T09:08:45.443 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology -v --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-07-29_08:05:42-rados-wip-kefu-testing-2021-07-29-1336-distro-basic-smithi/6300942 --name kchai-2021-07-29_08:05:42-rados-wip-kefu-testing-2021-07-29-1336-distro-basic-smithi --description rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} -- /home/teuthworker/archive/kchai-2021-07-29_08:05:42-rados-wip-kefu-testing-2021-07-29-1336-distro-basic-smithi/6300942/orig.config.yaml 2021-07-29T09:08:45.447 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kchai-2021-07-29_08:05:42-rados-wip-kefu-testing-2021-07-29-1336-distro-basic-smithi/6300942 2021-07-29T09:08:45.447 INFO:teuthology.dispatcher.supervisor:Job PID: 1497 2021-07-29T09:08:45.448 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-07-29T16:35:16.084 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-07-29T16:35:16.313 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-07-29T16:35:16.314 INFO:teuthology.nuke:Checking targets against current locks 2021-07-29T16:35:16.415 INFO:teuthology.nuke:Not nuking smithi144.front.sepia.ceph.com because description doesn't match 2021-07-29T16:35:16.416 INFO:teuthology.nuke:Not nuking smithi155.front.sepia.ceph.com because description doesn't match 2021-07-29T16:35:16.416 INFO:teuthology.nuke:Not nuking smithi007.front.sepia.ceph.com because description doesn't match 2021-07-29T16:35:16.417 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 59, in main verbose File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 152, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets nuke(fake_ctx, True) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable