2023-02-05T16:32:16.129 INFO:root:teuthology version: 0.0.1.dev37+g00690ec 2023-02-05T16:32:16.281 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2023-02-05T16:32:16.282 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2023-02-05T16:32:16.282 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-02-05T16:32:16.296 INFO:teuthology.lock.ops:Node 'smithi029.front.sepia.ceph.com' reimaging is complete 2023-02-05T16:32:16.296 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2023-02-05T16:32:16.296 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2023-02-05T16:32:16.297 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-02-05T16:32:16.312 INFO:teuthology.lock.ops:Node 'smithi045.front.sepia.ceph.com' reimaging is complete 2023-02-05T16:32:16.312 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-02-05T16:32:16.313 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-02-05T16:32:16.313 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-02-05T16:32:16.327 INFO:teuthology.lock.ops:Node 'smithi187.front.sepia.ceph.com' reimaging is complete 2023-02-05T16:32:16.440 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of ubuntu 18.04 2023-02-05T16:32:16.451 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of ubuntu 18.04 2023-02-05T16:32:16.460 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of ubuntu 18.04 2023-02-05T16:32:16.655 INFO:teuthology.orchestra.console:Power off smithi029 2023-02-05T16:32:16.668 INFO:teuthology.orchestra.console:Power off smithi045 2023-02-05T16:32:16.708 INFO:teuthology.orchestra.console:Power off smithi187 2023-02-05T16:32:16.793 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2023-02-05T16:32:16.815 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2023-02-05T16:32:16.845 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2023-02-05T16:32:16.895 INFO:teuthology.orchestra.console:Power on smithi029 2023-02-05T16:32:16.923 INFO:teuthology.orchestra.console:Power on smithi045 2023-02-05T16:32:16.949 INFO:teuthology.orchestra.console:Power on smithi187 2023-02-05T16:32:25.259 INFO:teuthology.orchestra.console:Power on for smithi029 completed 2023-02-05T16:32:25.276 INFO:teuthology.orchestra.console:Power on for smithi045 completed 2023-02-05T16:32:25.304 INFO:teuthology.orchestra.console:Power on for smithi187 completed 2023-02-05T16:32:25.360 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2023-02-05T16:32:25.377 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2023-02-05T16:32:25.405 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-02-05T16:35:45.936 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-02-05T16:35:55.024 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-02-05T16:36:04.080 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-02-05T16:36:46.608 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-02-05T16:36:55.696 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-02-05T16:37:04.752 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-02-05T16:37:10.093 WARNING:teuthology.provision.fog:timed out 2023-02-05T16:37:16.177 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-02-05T16:37:16.475 INFO:teuthology.provision.fog.smithi045:Node is ready 2023-02-05T16:37:16.524 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2023-02-05T16:37:16.573 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2023-02-05T16:37:16.867 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2023-02-05T16:37:43.346 WARNING:teuthology.provision.fog:timed out 2023-02-05T16:37:59.568 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-02-05T16:38:06.576 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-02-05T16:38:10.759 WARNING:teuthology.provision.fog:timed out 2023-02-05T16:38:12.679 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-02-05T16:38:16.846 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-02-05T16:38:17.293 INFO:teuthology.provision.fog.smithi029:Node is ready 2023-02-05T16:38:17.341 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2023-02-05T16:38:17.390 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2023-02-05T16:38:17.757 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2023-02-05T16:38:32.960 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-02-05T16:38:32.967 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2023-02-05T16:38:33.016 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2023-02-05T16:38:33.304 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-02-05T16:38:33.554 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2023-02-05T16:38:33.555 INFO:teuthology.lock.ops:New key found. Updating... 2023-02-05T16:38:33.572 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com 2023-02-05T16:38:33.572 INFO:teuthology.lock.ops:New key found. Updating... 2023-02-05T16:38:33.585 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-02-05T16:38:33.585 INFO:teuthology.lock.ops:New key found. Updating... 2023-02-05T16:38:33.599 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2023-02-05T16:38:33.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-02-05T16:38:33.889 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-02-05T16:38:33.937 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu" 2023-02-05T16:38:33.937 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2023-02-05T16:38:33.938 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu 2023-02-05T16:38:33.938 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian 2023-02-05T16:38:33.938 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2023-02-05T16:38:33.938 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="18.04" 2023-02-05T16:38:33.938 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/" 2023-02-05T16:38:33.938 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-02-05T16:38:33.939 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-02-05T16:38:33.939 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-02-05T16:38:33.939 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=bionic 2023-02-05T16:38:33.939 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=bionic 2023-02-05T16:38:33.940 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-02-05T16:38:33.959 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server 2023-02-05T16:38:33.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-02-05T16:38:34.240 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-02-05T16:38:34.289 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Ubuntu" 2023-02-05T16:38:34.289 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2023-02-05T16:38:34.289 INFO:teuthology.orchestra.run.smithi045.stdout:ID=ubuntu 2023-02-05T16:38:34.289 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE=debian 2023-02-05T16:38:34.289 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2023-02-05T16:38:34.290 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="18.04" 2023-02-05T16:38:34.290 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.ubuntu.com/" 2023-02-05T16:38:34.290 INFO:teuthology.orchestra.run.smithi045.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-02-05T16:38:34.290 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-02-05T16:38:34.290 INFO:teuthology.orchestra.run.smithi045.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-02-05T16:38:34.291 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_CODENAME=bionic 2023-02-05T16:38:34.291 INFO:teuthology.orchestra.run.smithi045.stdout:UBUNTU_CODENAME=bionic 2023-02-05T16:38:34.291 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-02-05T16:38:34.305 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-02-05T16:38:34.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-02-05T16:38:34.539 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-02-05T16:38:34.588 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2023-02-05T16:38:34.588 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2023-02-05T16:38:34.588 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2023-02-05T16:38:34.588 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2023-02-05T16:38:34.589 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2023-02-05T16:38:34.589 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="18.04" 2023-02-05T16:38:34.589 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2023-02-05T16:38:34.589 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-02-05T16:38:34.589 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-02-05T16:38:34.589 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-02-05T16:38:34.590 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=bionic 2023-02-05T16:38:34.590 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=bionic 2023-02-05T16:38:34.590 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-02-05T16:38:34.675 INFO:teuthology.dispatcher.supervisor:Running job 7149187 2023-02-05T16:38:34.675 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-02-05_16:31:25-orch:cephadm-wip-adk2-testing-2023-02-04-1257-pacific-distro-default-smithi/7149187 --name adking-2023-02-05_16:31:25-orch:cephadm-wip-adk2-testing-2023-02-04-1257-pacific-distro-default-smithi --description orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps} -- /home/teuthworker/archive/adking-2023-02-05_16:31:25-orch:cephadm-wip-adk2-testing-2023-02-04-1257-pacific-distro-default-smithi/7149187/orig.config.yaml 2023-02-05T16:38:34.678 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-02-05_16:31:25-orch:cephadm-wip-adk2-testing-2023-02-04-1257-pacific-distro-default-smithi/7149187 2023-02-05T16:38:34.679 INFO:teuthology.dispatcher.supervisor:Job PID: 30123 2023-02-05T16:38:34.679 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-02-05T16:46:35.209 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-02-05T16:46:35.340 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-02-05T16:46:35.341 INFO:teuthology.nuke:Checking targets against current locks 2023-02-05T16:46:35.398 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-02-05T16:46:35.417 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/__init__.py", line 63, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 57, in main return run_job( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 156, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 255, in unlock_targets nuke(fake_ctx, True) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/nuke/__init__.py", line 246, in nuke if ctx.name and ctx.name not in status.get('description', ""): TypeError: argument of type 'NoneType' is not iterable