2021-03-23T01:41:39.434 INFO:root:teuthology version: 1.1.0-6b3150e9 2021-03-23T01:41:39.574 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi075.front.sepia.ceph.com' reimaging 2021-03-23T01:41:39.575 INFO:teuthology.lock.ops:Updating [ubuntu@smithi075.front.sepia.ceph.com]: reset os type and version on server 2021-03-23T01:41:39.575 INFO:teuthology.lock.ops:Updating smithi075.front.sepia.ceph.com on lock server 2021-03-23T01:41:39.590 INFO:teuthology.lock.ops:Node 'ubuntu@smithi075.front.sepia.ceph.com' reimaging is complete 2021-03-23T01:41:39.591 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi084.front.sepia.ceph.com' reimaging 2021-03-23T01:41:39.591 INFO:teuthology.lock.ops:Updating [ubuntu@smithi084.front.sepia.ceph.com]: reset os type and version on server 2021-03-23T01:41:39.591 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2021-03-23T01:41:39.606 INFO:teuthology.lock.ops:Node 'ubuntu@smithi084.front.sepia.ceph.com' reimaging is complete 2021-03-23T01:41:39.606 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi205.front.sepia.ceph.com' reimaging 2021-03-23T01:41:39.607 INFO:teuthology.lock.ops:Updating [ubuntu@smithi205.front.sepia.ceph.com]: reset os type and version on server 2021-03-23T01:41:39.607 INFO:teuthology.lock.ops:Updating smithi205.front.sepia.ceph.com on lock server 2021-03-23T01:41:39.623 INFO:teuthology.lock.ops:Node 'ubuntu@smithi205.front.sepia.ceph.com' reimaging is complete 2021-03-23T01:41:39.796 INFO:teuthology.provision.fog.smithi075:Scheduling deploy of ubuntu 18.04 2021-03-23T01:41:39.811 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of ubuntu 18.04 2021-03-23T01:41:39.835 INFO:teuthology.provision.fog.smithi205:Scheduling deploy of ubuntu 18.04 2021-03-23T01:41:40.135 INFO:teuthology.orchestra.console:Power off smithi075 2021-03-23T01:41:40.160 INFO:teuthology.orchestra.console:Power off smithi084 2021-03-23T01:41:40.206 INFO:teuthology.orchestra.console:Power off smithi205 2021-03-23T01:41:40.316 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2021-03-23T01:41:40.356 INFO:teuthology.orchestra.console:Power off for smithi205 completed 2021-03-23T01:41:40.418 INFO:teuthology.orchestra.console:Power on smithi084 2021-03-23T01:41:40.457 INFO:teuthology.orchestra.console:Power on smithi205 2021-03-23T01:41:44.679 INFO:teuthology.orchestra.console:Power on for smithi084 completed 2021-03-23T01:41:44.781 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2021-03-23T01:41:48.520 INFO:teuthology.orchestra.console:Power off for smithi075 completed 2021-03-23T01:41:48.622 INFO:teuthology.orchestra.console:Power on smithi075 2021-03-23T01:41:48.824 INFO:teuthology.orchestra.console:Power on for smithi205 completed 2021-03-23T01:41:48.925 INFO:teuthology.provision.fog.smithi205:Waiting for deploy to finish 2021-03-23T01:41:56.995 INFO:teuthology.orchestra.console:Power on for smithi075 completed 2021-03-23T01:41:57.096 INFO:teuthology.provision.fog.smithi075:Waiting for deploy to finish 2021-03-23T01:46:47.013 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-23T01:46:47.335 INFO:teuthology.provision.fog.smithi084:Node is ready 2021-03-23T01:46:47.384 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2021-03-23T01:46:47.433 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2021-03-23T01:46:47.743 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2021-03-23T01:46:48.948 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-23T01:46:49.335 INFO:teuthology.provision.fog.smithi205:Node is ready 2021-03-23T01:46:49.382 INFO:teuthology.orchestra.run.smithi205.stdout:smithi205.front.sepia.ceph.com 2021-03-23T01:46:49.432 INFO:teuthology.orchestra.run.smithi205.stdout:172.21.15.205 smithi205.front.sepia.ceph.com smithi205 2021-03-23T01:46:49.740 INFO:teuthology.provision.fog.smithi205:Deploy complete! 2021-03-23T01:46:53.205 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-23T01:46:53.531 INFO:teuthology.provision.fog.smithi075:Node is ready 2021-03-23T01:46:53.577 INFO:teuthology.orchestra.run.smithi075.stdout:smithi075.front.sepia.ceph.com 2021-03-23T01:46:53.626 INFO:teuthology.orchestra.run.smithi075.stdout:172.21.15.75 smithi075.front.sepia.ceph.com smithi075 2021-03-23T01:46:53.992 INFO:teuthology.provision.fog.smithi075:Deploy complete! 2021-03-23T01:46:54.184 INFO:teuthology.lock.ops:Checking smithi075.front.sepia.ceph.com 2021-03-23T01:46:54.185 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-23T01:46:54.201 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2021-03-23T01:46:54.201 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-23T01:46:54.214 INFO:teuthology.lock.ops:Checking smithi205.front.sepia.ceph.com 2021-03-23T01:46:54.214 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-23T01:46:54.228 INFO:teuthology.lock.ops:Updating [smithi075.front.sepia.ceph.com]: set os type and version on server 2021-03-23T01:46:54.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-23T01:46:54.525 INFO:teuthology.orchestra.run.smithi075.stdout:x86_64 2021-03-23T01:46:54.573 INFO:teuthology.orchestra.run.smithi075.stdout:NAME="Ubuntu" 2021-03-23T01:46:54.573 INFO:teuthology.orchestra.run.smithi075.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-03-23T01:46:54.573 INFO:teuthology.orchestra.run.smithi075.stdout:ID=ubuntu 2021-03-23T01:46:54.574 INFO:teuthology.orchestra.run.smithi075.stdout:ID_LIKE=debian 2021-03-23T01:46:54.574 INFO:teuthology.orchestra.run.smithi075.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-03-23T01:46:54.574 INFO:teuthology.orchestra.run.smithi075.stdout:VERSION_ID="18.04" 2021-03-23T01:46:54.574 INFO:teuthology.orchestra.run.smithi075.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-23T01:46:54.574 INFO:teuthology.orchestra.run.smithi075.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-23T01:46:54.575 INFO:teuthology.orchestra.run.smithi075.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-23T01:46:54.575 INFO:teuthology.orchestra.run.smithi075.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-23T01:46:54.575 INFO:teuthology.orchestra.run.smithi075.stdout:VERSION_CODENAME=bionic 2021-03-23T01:46:54.575 INFO:teuthology.orchestra.run.smithi075.stdout:UBUNTU_CODENAME=bionic 2021-03-23T01:46:54.577 INFO:teuthology.lock.ops:Updating smithi075.front.sepia.ceph.com on lock server 2021-03-23T01:46:54.591 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2021-03-23T01:46:54.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-23T01:46:54.920 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2021-03-23T01:46:54.968 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2021-03-23T01:46:54.969 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-03-23T01:46:54.969 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2021-03-23T01:46:54.969 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2021-03-23T01:46:54.969 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-03-23T01:46:54.970 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="18.04" 2021-03-23T01:46:54.970 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-23T01:46:54.970 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-23T01:46:54.970 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-23T01:46:54.971 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-23T01:46:54.971 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=bionic 2021-03-23T01:46:54.971 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=bionic 2021-03-23T01:46:54.971 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2021-03-23T01:46:54.987 INFO:teuthology.lock.ops:Updating [smithi205.front.sepia.ceph.com]: set os type and version on server 2021-03-23T01:46:54.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-23T01:46:55.338 INFO:teuthology.orchestra.run.smithi205.stdout:x86_64 2021-03-23T01:46:55.390 INFO:teuthology.orchestra.run.smithi205.stdout:NAME="Ubuntu" 2021-03-23T01:46:55.391 INFO:teuthology.orchestra.run.smithi205.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-03-23T01:46:55.391 INFO:teuthology.orchestra.run.smithi205.stdout:ID=ubuntu 2021-03-23T01:46:55.391 INFO:teuthology.orchestra.run.smithi205.stdout:ID_LIKE=debian 2021-03-23T01:46:55.391 INFO:teuthology.orchestra.run.smithi205.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-03-23T01:46:55.392 INFO:teuthology.orchestra.run.smithi205.stdout:VERSION_ID="18.04" 2021-03-23T01:46:55.392 INFO:teuthology.orchestra.run.smithi205.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-23T01:46:55.392 INFO:teuthology.orchestra.run.smithi205.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-23T01:46:55.392 INFO:teuthology.orchestra.run.smithi205.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-23T01:46:55.393 INFO:teuthology.orchestra.run.smithi205.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-23T01:46:55.393 INFO:teuthology.orchestra.run.smithi205.stdout:VERSION_CODENAME=bionic 2021-03-23T01:46:55.393 INFO:teuthology.orchestra.run.smithi205.stdout:UBUNTU_CODENAME=bionic 2021-03-23T01:46:55.393 INFO:teuthology.lock.ops:Updating smithi205.front.sepia.ceph.com on lock server 2021-03-23T01:46:55.467 INFO:teuthology.dispatcher.supervisor:Running job 5988044 2021-03-23T01:46:55.468 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology -v --owner scheduled_akupczyk@teuthology --archive /home/teuthworker/archive/akupczyk-2021-03-22_13:47:05-rados-wip-paranoid-split-cache-distro-basic-smithi/5988044 --name akupczyk-2021-03-22_13:47:05-rados-wip-paranoid-split-cache-distro-basic-smithi --description rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/akupczyk-2021-03-22_13:47:05-rados-wip-paranoid-split-cache-distro-basic-smithi/5988044/orig.config.yaml 2021-03-23T01:46:55.472 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/akupczyk-2021-03-22_13:47:05-rados-wip-paranoid-split-cache-distro-basic-smithi/5988044 2021-03-23T01:46:55.473 INFO:teuthology.dispatcher.supervisor:Job PID: 19604 2021-03-23T01:46:55.473 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-03-23T05:17:10.418 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/akupczyk-2021-03-22_13:47:05-rados-wip-paranoid-split-cache-distro-basic-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2021-03-23T05:17:10.487 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/ Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 498, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 463, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 320, in report_job response.raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/akupczyk-2021-03-22_13:47:05-rados-wip-paranoid-split-cache-distro-basic-smithi/jobs/ 2021-03-23T13:47:45.731 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-03-23T13:47:45.918 INFO:teuthology.kill:Killing Pids: {19604} 2021-03-23T13:47:47.770 INFO:teuthology.kill:Nuking machines: ['smithi075', 'smithi084', 'smithi205'] 2021-03-23T13:47:49.496 INFO:teuthology.kill:2021-03-23 13:47:49,495.495 INFO:teuthology.nuke:targets: 2021-03-23T13:47:49.498 INFO:teuthology.kill: smithi075.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeZIEq4OmHlk5fWjm91/FxHvOp7zUNNyIskLlOa1M6ccRn/7eixRybwCJ6aH82rerRSzM4x43LNw1CGeEqHCef2P5xiFxS40Au2Kd1dDtFtCbTF18dDHNbBnzRdcxIwtwe/zoJw1Q3c1qnZcjDzchTPOAJtWt/rPljGlutayybwZEZ7Zpal+9mZdDQCzA/GflVywro2T4VdBm5zeKn6u0fA5V6lr2tZ5Tw316f0oluBwlNg+/AyQIRnDyyRSVqSBO6TFwggbkXsqiX4KoYUumif4NaDs+ly49UuMwXthGFrOW8vhFlrJAxfR/NKGP4HSe+O7jKauxjE87gFjlrtJXr 2021-03-23T13:47:49.499 INFO:teuthology.kill: smithi084.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHRSzIeZDHtuvqt/oDY6SjdKRCOnI7Wi6fi7P5ypo7k1UBae1atsyXL8vpXjV2qCcSEygYh6TQQmfURMCtlIJ2BnVEEy8Ch46dUegNo7EfxYVqSJKCTVJVS1afDEGQCS0aErbbLpU1gwxcMhh/NKF7gVjZ3bT2qEM6KrE5mQbaYpVLuyELluL9Zl2p2ZPL4XLP1ei2+h8RWG6WbCk3qVBOLUB9rrMRJ+X8XziyBFDL+uOfQB9QY0xSmcZyoGM8/QzuA8mugUihT1yVCr4ACRU/JMFbA1rMn4VJUxn990ToQTcwwdiau+HHP5FDojd0rKEipVh339Mk/SBDLClCPfCn 2021-03-23T13:47:49.499 INFO:teuthology.kill: smithi205.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDsOA2TY1XPlXiIxKnuehCI9BtqHXNC1TBUMcq4hRCiTLVlQwaaVKCx9E7D1L719I+o0Hh5MnX8CDISYZ3YUoDzUC96mYLwMTOgb6hGuiEuFCPZFeB0xRB5hDyxvLYfCMg7a8L8FlBhN39qXkIwnJp7yC59mb7AVoi6GWABrIfPv5yqakNVZ/2ZzRpjxFR3mEic69nUqhowbeq27/89xs0zTXL+NlIeVELLIQ/ly51GuScIe9fznwc2Vs2HtCrUQJHSvYS5HJPsBtCaSa4u+/mbBt8HURY9HOFHiKgFyIcZL1/mMXY64ZnrNArr1VhH2gukNA8Rpj5gJOR8hQTuQG+9 2021-03-23T13:47:49.499 INFO:teuthology.kill:2021-03-23 13:47:49,496.496 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-23T13:47:49.501 INFO:teuthology.kill:2021-03-23 13:47:49,501.501 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-23T13:47:49.502 INFO:teuthology.kill:2021-03-23 13:47:49,502.502 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-23T13:47:49.575 INFO:teuthology.kill:2021-03-23 13:47:49,574.574 INFO:teuthology.orchestra.console:Power off smithi084 2021-03-23T13:47:49.612 INFO:teuthology.kill:2021-03-23 13:47:49,612.612 INFO:teuthology.orchestra.console:Power off smithi075 2021-03-23T13:47:49.623 INFO:teuthology.kill:2021-03-23 13:47:49,623.623 INFO:teuthology.orchestra.console:Power off smithi205 2021-03-23T13:47:58.139 INFO:teuthology.kill:2021-03-23 13:47:58,138.138 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2021-03-23T13:47:58.145 INFO:teuthology.kill:2021-03-23 13:47:58,145.145 INFO:teuthology.orchestra.console:Power off for smithi075 completed 2021-03-23T13:48:02.243 INFO:teuthology.kill:2021-03-23 13:48:02,243.243 INFO:teuthology.orchestra.console:Power off for smithi205 completed 2021-03-23T13:48:02.486 INFO:teuthology.task.internal:roles: ubuntu@smithi075.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2021-03-23T13:48:02.491 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2021-03-23T13:48:02.491 INFO:teuthology.task.internal:roles: ubuntu@smithi205.front.sepia.ceph.com - ['mon.c', 'osd.8', 'osd.9', 'osd.10', 'osd.11', 'client.2'] 2021-03-23T13:48:02.492 INFO:teuthology.misc:Compressing logs... 2021-03-23T13:48:02.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-23T13:48:21.059 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/misc.py", line 1374, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-03-23T13:48:21.117 INFO:teuthology.kill:No teuthology processes running 2021-03-23T13:48:22.935 INFO:teuthology.kill:Nuking machines: ['smithi075', 'smithi084', 'smithi205'] 2021-03-23T13:48:24.424 INFO:teuthology.kill:2021-03-23 13:48:24,424.424 INFO:teuthology.nuke:targets: 2021-03-23T13:48:24.425 INFO:teuthology.kill: smithi075.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeZIEq4OmHlk5fWjm91/FxHvOp7zUNNyIskLlOa1M6ccRn/7eixRybwCJ6aH82rerRSzM4x43LNw1CGeEqHCef2P5xiFxS40Au2Kd1dDtFtCbTF18dDHNbBnzRdcxIwtwe/zoJw1Q3c1qnZcjDzchTPOAJtWt/rPljGlutayybwZEZ7Zpal+9mZdDQCzA/GflVywro2T4VdBm5zeKn6u0fA5V6lr2tZ5Tw316f0oluBwlNg+/AyQIRnDyyRSVqSBO6TFwggbkXsqiX4KoYUumif4NaDs+ly49UuMwXthGFrOW8vhFlrJAxfR/NKGP4HSe+O7jKauxjE87gFjlrtJXr 2021-03-23T13:48:24.425 INFO:teuthology.kill: smithi084.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHRSzIeZDHtuvqt/oDY6SjdKRCOnI7Wi6fi7P5ypo7k1UBae1atsyXL8vpXjV2qCcSEygYh6TQQmfURMCtlIJ2BnVEEy8Ch46dUegNo7EfxYVqSJKCTVJVS1afDEGQCS0aErbbLpU1gwxcMhh/NKF7gVjZ3bT2qEM6KrE5mQbaYpVLuyELluL9Zl2p2ZPL4XLP1ei2+h8RWG6WbCk3qVBOLUB9rrMRJ+X8XziyBFDL+uOfQB9QY0xSmcZyoGM8/QzuA8mugUihT1yVCr4ACRU/JMFbA1rMn4VJUxn990ToQTcwwdiau+HHP5FDojd0rKEipVh339Mk/SBDLClCPfCn 2021-03-23T13:48:24.426 INFO:teuthology.kill: smithi205.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDsOA2TY1XPlXiIxKnuehCI9BtqHXNC1TBUMcq4hRCiTLVlQwaaVKCx9E7D1L719I+o0Hh5MnX8CDISYZ3YUoDzUC96mYLwMTOgb6hGuiEuFCPZFeB0xRB5hDyxvLYfCMg7a8L8FlBhN39qXkIwnJp7yC59mb7AVoi6GWABrIfPv5yqakNVZ/2ZzRpjxFR3mEic69nUqhowbeq27/89xs0zTXL+NlIeVELLIQ/ly51GuScIe9fznwc2Vs2HtCrUQJHSvYS5HJPsBtCaSa4u+/mbBt8HURY9HOFHiKgFyIcZL1/mMXY64ZnrNArr1VhH2gukNA8Rpj5gJOR8hQTuQG+9 2021-03-23T13:48:24.450 INFO:teuthology.kill:2021-03-23 13:48:24,450.450 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-23T13:48:24.454 INFO:teuthology.kill:2021-03-23 13:48:24,454.454 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-23T13:48:24.455 INFO:teuthology.kill:2021-03-23 13:48:24,455.455 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-23T13:48:24.523 INFO:teuthology.kill:2021-03-23 13:48:24,523.523 INFO:teuthology.orchestra.console:Power off smithi084 2021-03-23T13:48:24.537 INFO:teuthology.kill:2021-03-23 13:48:24,537.537 INFO:teuthology.orchestra.console:Power off smithi205 2021-03-23T13:48:24.549 INFO:teuthology.kill:2021-03-23 13:48:24,548.548 INFO:teuthology.orchestra.console:Power off smithi075 2021-03-23T13:48:24.681 INFO:teuthology.kill:2021-03-23 13:48:24,680.680 INFO:teuthology.orchestra.console:Power off for smithi205 completed 2021-03-23T13:48:24.691 INFO:teuthology.kill:2021-03-23 13:48:24,691.691 INFO:teuthology.orchestra.console:Power off for smithi075 completed 2021-03-23T13:48:24.693 INFO:teuthology.kill:2021-03-23 13:48:24,693.693 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2021-03-23T13:48:24.824 INFO:teuthology.kill:2021-03-23 13:48:24,824.824 INFO:teuthology.lock.ops:unlocked smithi205.front.sepia.ceph.com 2021-03-23T13:48:24.835 INFO:teuthology.kill:2021-03-23 13:48:24,835.835 INFO:teuthology.lock.ops:unlocked smithi075.front.sepia.ceph.com 2021-03-23T13:48:24.839 INFO:teuthology.kill:2021-03-23 13:48:24,839.839 INFO:teuthology.lock.ops:unlocked smithi084.front.sepia.ceph.com 2021-03-23T13:50:25.124 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-03-23T13:50:25.285 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-03-23T13:50:25.285 INFO:teuthology.nuke:Checking targets against current locks 2021-03-23T13:50:25.379 INFO:teuthology.nuke:Not nuking smithi084.front.sepia.ceph.com because description doesn't match 2021-03-23T13:50:25.379 INFO:teuthology.nuke:Not nuking smithi075.front.sepia.ceph.com because description doesn't match 2021-03-23T13:50:25.380 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 59, in main verbose File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 152, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets nuke(fake_ctx, True) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable