2021-03-23T10:29:40.526 INFO:root:teuthology version: 1.1.0-6b3150e9
2021-03-23T10:29:40.704 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba012.front.sepia.ceph.com' reimaging
2021-03-23T10:29:40.704 INFO:teuthology.lock.ops:Updating [ubuntu@gibba012.front.sepia.ceph.com]: reset os type and version on server
2021-03-23T10:29:40.704 INFO:teuthology.lock.ops:Updating gibba012.front.sepia.ceph.com on lock server
2021-03-23T10:29:40.719 INFO:teuthology.lock.ops:Node 'ubuntu@gibba012.front.sepia.ceph.com' reimaging is complete
2021-03-23T10:29:40.719 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba020.front.sepia.ceph.com' reimaging
2021-03-23T10:29:40.720 INFO:teuthology.lock.ops:Updating [ubuntu@gibba020.front.sepia.ceph.com]: reset os type and version on server
2021-03-23T10:29:40.720 INFO:teuthology.lock.ops:Updating gibba020.front.sepia.ceph.com on lock server
2021-03-23T10:29:40.735 INFO:teuthology.lock.ops:Node 'ubuntu@gibba020.front.sepia.ceph.com' reimaging is complete
2021-03-23T10:29:40.735 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba023.front.sepia.ceph.com' reimaging
2021-03-23T10:29:40.735 INFO:teuthology.lock.ops:Updating [ubuntu@gibba023.front.sepia.ceph.com]: reset os type and version on server
2021-03-23T10:29:40.735 INFO:teuthology.lock.ops:Updating gibba023.front.sepia.ceph.com on lock server
2021-03-23T10:29:40.749 INFO:teuthology.lock.ops:Node 'ubuntu@gibba023.front.sepia.ceph.com' reimaging is complete
2021-03-23T10:29:40.749 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba038.front.sepia.ceph.com' reimaging
2021-03-23T10:29:40.749 INFO:teuthology.lock.ops:Updating [ubuntu@gibba038.front.sepia.ceph.com]: reset os type and version on server
2021-03-23T10:29:40.749 INFO:teuthology.lock.ops:Updating gibba038.front.sepia.ceph.com on lock server
2021-03-23T10:29:40.765 INFO:teuthology.lock.ops:Node 'ubuntu@gibba038.front.sepia.ceph.com' reimaging is complete
2021-03-23T10:29:40.765 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba045.front.sepia.ceph.com' reimaging
2021-03-23T10:29:40.765 INFO:teuthology.lock.ops:Updating [ubuntu@gibba045.front.sepia.ceph.com]: reset os type and version on server
2021-03-23T10:29:40.765 INFO:teuthology.lock.ops:Updating gibba045.front.sepia.ceph.com on lock server
2021-03-23T10:29:40.780 INFO:teuthology.lock.ops:Node 'ubuntu@gibba045.front.sepia.ceph.com' reimaging is complete
2021-03-23T10:29:40.948 INFO:teuthology.provision.fog.gibba020:Scheduling deploy of ubuntu 18.04
2021-03-23T10:29:40.959 INFO:teuthology.provision.fog.gibba012:Scheduling deploy of ubuntu 18.04
2021-03-23T10:29:40.971 INFO:teuthology.provision.fog.gibba038:Scheduling deploy of ubuntu 18.04
2021-03-23T10:29:40.975 INFO:teuthology.provision.fog.gibba023:Scheduling deploy of ubuntu 18.04
2021-03-23T10:29:41.002 INFO:teuthology.provision.fog.gibba045:Scheduling deploy of ubuntu 18.04
2021-03-23T10:29:41.333 INFO:teuthology.orchestra.console:Power off gibba020
2021-03-23T10:29:41.351 INFO:teuthology.orchestra.console:Power off gibba012
2021-03-23T10:29:41.366 INFO:teuthology.orchestra.console:Power off gibba038
2021-03-23T10:29:41.416 INFO:teuthology.orchestra.console:Power off gibba023
2021-03-23T10:29:41.426 INFO:teuthology.orchestra.console:Power off gibba045
2021-03-23T10:29:41.533 INFO:teuthology.orchestra.console:Power off for gibba012 completed
2021-03-23T10:29:41.563 INFO:teuthology.orchestra.console:Power off for gibba023 completed
2021-03-23T10:29:41.635 INFO:teuthology.orchestra.console:Power on gibba012
2021-03-23T10:29:41.670 INFO:teuthology.orchestra.console:Power on gibba023
2021-03-23T10:29:45.900 INFO:teuthology.orchestra.console:Power on for gibba012 completed
2021-03-23T10:29:45.932 INFO:teuthology.orchestra.console:Power on for gibba023 completed
2021-03-23T10:29:46.002 INFO:teuthology.provision.fog.gibba012:Waiting for deploy to finish
2021-03-23T10:29:46.033 INFO:teuthology.provision.fog.gibba023:Waiting for deploy to finish
2021-03-23T10:29:49.761 INFO:teuthology.orchestra.console:Power off for gibba020 completed
2021-03-23T10:29:49.862 INFO:teuthology.orchestra.console:Power on gibba020
2021-03-23T10:29:53.873 INFO:teuthology.orchestra.console:Power off for gibba038 completed
2021-03-23T10:29:53.914 INFO:teuthology.orchestra.console:Power off for gibba045 completed
2021-03-23T10:29:53.975 INFO:teuthology.orchestra.console:Power on gibba038
2021-03-23T10:29:54.015 INFO:teuthology.orchestra.console:Power on gibba045
2021-03-23T10:29:58.236 INFO:teuthology.orchestra.console:Power on for gibba020 completed
2021-03-23T10:29:58.242 INFO:teuthology.orchestra.console:Power on for gibba038 completed
2021-03-23T10:29:58.337 INFO:teuthology.provision.fog.gibba020:Waiting for deploy to finish
2021-03-23T10:29:58.343 INFO:teuthology.provision.fog.gibba038:Waiting for deploy to finish
2021-03-23T10:30:02.384 INFO:teuthology.orchestra.console:Power on for gibba045 completed
2021-03-23T10:30:02.485 INFO:teuthology.provision.fog.gibba045:Waiting for deploy to finish
2021-03-23T10:34:07.038 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-23T10:34:13.046 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-23T10:34:13.049 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-23T10:34:19.062 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-23T10:34:19.325 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-23T10:34:25.070 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-23T10:34:25.074 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-23T10:34:25.336 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-23T10:34:31.155 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-23T10:34:31.198 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-23T10:34:31.346 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-23T10:34:31.533 INFO:teuthology.provision.fog.gibba023:Node is ready
2021-03-23T10:34:31.583 INFO:teuthology.orchestra.run.gibba023.stdout:gibba023.front.sepia.ceph.com
2021-03-23T10:34:31.632 INFO:teuthology.orchestra.run.gibba023.stdout:172.21.2.123 gibba023.front.sepia.ceph.com gibba023
2021-03-23T10:34:31.640 INFO:teuthology.provision.fog.gibba012:Node is ready
2021-03-23T10:34:31.689 INFO:teuthology.orchestra.run.gibba012.stdout:gibba012.front.sepia.ceph.com
2021-03-23T10:34:31.739 INFO:teuthology.orchestra.run.gibba012.stdout:172.21.2.112 gibba012.front.sepia.ceph.com gibba012
2021-03-23T10:34:31.922 INFO:teuthology.provision.fog.gibba023:Deploy complete!
2021-03-23T10:34:32.088 INFO:teuthology.provision.fog.gibba012:Deploy complete!
2021-03-23T10:34:37.356 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-23T10:34:43.472 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-23T10:34:43.756 INFO:teuthology.provision.fog.gibba038:Node is ready
2021-03-23T10:34:43.803 INFO:teuthology.orchestra.run.gibba038.stdout:gibba038.front.sepia.ceph.com
2021-03-23T10:34:43.847 INFO:teuthology.orchestra.run.gibba038.stdout:172.21.2.138 gibba038.front.sepia.ceph.com gibba038
2021-03-23T10:34:44.161 INFO:teuthology.provision.fog.gibba038:Deploy complete!
2021-03-23T10:34:48.084 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-23T10:34:48.320 INFO:teuthology.provision.fog.gibba020:Node is ready
2021-03-23T10:34:48.368 INFO:teuthology.orchestra.run.gibba020.stdout:gibba020.front.sepia.ceph.com
2021-03-23T10:34:48.412 INFO:teuthology.orchestra.run.gibba020.stdout:172.21.2.120 gibba020.front.sepia.ceph.com gibba020
2021-03-23T10:34:48.679 INFO:teuthology.provision.fog.gibba020:Deploy complete!
2021-03-23T10:34:52.117 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-23T10:34:52.384 INFO:teuthology.provision.fog.gibba045:Node is ready
2021-03-23T10:34:52.429 INFO:teuthology.orchestra.run.gibba045.stdout:gibba045.front.sepia.ceph.com
2021-03-23T10:34:52.473 INFO:teuthology.orchestra.run.gibba045.stdout:172.21.2.145 gibba045.front.sepia.ceph.com gibba045
2021-03-23T10:34:52.743 INFO:teuthology.provision.fog.gibba045:Deploy complete!
2021-03-23T10:34:52.917 INFO:teuthology.lock.ops:Checking gibba012.front.sepia.ceph.com
2021-03-23T10:34:52.917 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-23T10:34:52.933 INFO:teuthology.lock.ops:Checking gibba020.front.sepia.ceph.com
2021-03-23T10:34:52.933 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-23T10:34:52.946 INFO:teuthology.lock.ops:Checking gibba023.front.sepia.ceph.com
2021-03-23T10:34:52.946 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-23T10:34:52.958 INFO:teuthology.lock.ops:Checking gibba038.front.sepia.ceph.com
2021-03-23T10:34:52.958 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-23T10:34:52.970 INFO:teuthology.lock.ops:Checking gibba045.front.sepia.ceph.com
2021-03-23T10:34:52.970 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-23T10:34:52.984 INFO:teuthology.lock.ops:Updating [gibba012.front.sepia.ceph.com]: set os type and version on server
2021-03-23T10:34:52.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-23T10:34:53.288 INFO:teuthology.orchestra.run.gibba012.stdout:x86_64
2021-03-23T10:34:53.339 INFO:teuthology.orchestra.run.gibba012.stdout:NAME="Ubuntu"
2021-03-23T10:34:53.339 INFO:teuthology.orchestra.run.gibba012.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-23T10:34:53.340 INFO:teuthology.orchestra.run.gibba012.stdout:ID=ubuntu
2021-03-23T10:34:53.340 INFO:teuthology.orchestra.run.gibba012.stdout:ID_LIKE=debian
2021-03-23T10:34:53.340 INFO:teuthology.orchestra.run.gibba012.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-23T10:34:53.340 INFO:teuthology.orchestra.run.gibba012.stdout:VERSION_ID="18.04"
2021-03-23T10:34:53.340 INFO:teuthology.orchestra.run.gibba012.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-23T10:34:53.340 INFO:teuthology.orchestra.run.gibba012.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-23T10:34:53.340 INFO:teuthology.orchestra.run.gibba012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-23T10:34:53.340 INFO:teuthology.orchestra.run.gibba012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-23T10:34:53.340 INFO:teuthology.orchestra.run.gibba012.stdout:VERSION_CODENAME=bionic
2021-03-23T10:34:53.340 INFO:teuthology.orchestra.run.gibba012.stdout:UBUNTU_CODENAME=bionic
2021-03-23T10:34:53.341 INFO:teuthology.lock.ops:Updating gibba012.front.sepia.ceph.com on lock server
2021-03-23T10:34:53.358 INFO:teuthology.lock.ops:Updating [gibba020.front.sepia.ceph.com]: set os type and version on server
2021-03-23T10:34:53.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-23T10:34:53.659 INFO:teuthology.orchestra.run.gibba020.stdout:x86_64
2021-03-23T10:34:53.703 INFO:teuthology.orchestra.run.gibba020.stdout:NAME="Ubuntu"
2021-03-23T10:34:53.703 INFO:teuthology.orchestra.run.gibba020.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-23T10:34:53.703 INFO:teuthology.orchestra.run.gibba020.stdout:ID=ubuntu
2021-03-23T10:34:53.704 INFO:teuthology.orchestra.run.gibba020.stdout:ID_LIKE=debian
2021-03-23T10:34:53.704 INFO:teuthology.orchestra.run.gibba020.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-23T10:34:53.704 INFO:teuthology.orchestra.run.gibba020.stdout:VERSION_ID="18.04"
2021-03-23T10:34:53.704 INFO:teuthology.orchestra.run.gibba020.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-23T10:34:53.704 INFO:teuthology.orchestra.run.gibba020.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-23T10:34:53.704 INFO:teuthology.orchestra.run.gibba020.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-23T10:34:53.704 INFO:teuthology.orchestra.run.gibba020.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-23T10:34:53.704 INFO:teuthology.orchestra.run.gibba020.stdout:VERSION_CODENAME=bionic
2021-03-23T10:34:53.704 INFO:teuthology.orchestra.run.gibba020.stdout:UBUNTU_CODENAME=bionic
2021-03-23T10:34:53.704 INFO:teuthology.lock.ops:Updating gibba020.front.sepia.ceph.com on lock server
2021-03-23T10:34:53.719 INFO:teuthology.lock.ops:Updating [gibba023.front.sepia.ceph.com]: set os type and version on server
2021-03-23T10:34:53.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-23T10:34:54.015 INFO:teuthology.orchestra.run.gibba023.stdout:x86_64
2021-03-23T10:34:54.065 INFO:teuthology.orchestra.run.gibba023.stdout:NAME="Ubuntu"
2021-03-23T10:34:54.066 INFO:teuthology.orchestra.run.gibba023.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-23T10:34:54.066 INFO:teuthology.orchestra.run.gibba023.stdout:ID=ubuntu
2021-03-23T10:34:54.066 INFO:teuthology.orchestra.run.gibba023.stdout:ID_LIKE=debian
2021-03-23T10:34:54.066 INFO:teuthology.orchestra.run.gibba023.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-23T10:34:54.066 INFO:teuthology.orchestra.run.gibba023.stdout:VERSION_ID="18.04"
2021-03-23T10:34:54.066 INFO:teuthology.orchestra.run.gibba023.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-23T10:34:54.066 INFO:teuthology.orchestra.run.gibba023.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-23T10:34:54.066 INFO:teuthology.orchestra.run.gibba023.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-23T10:34:54.066 INFO:teuthology.orchestra.run.gibba023.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-23T10:34:54.066 INFO:teuthology.orchestra.run.gibba023.stdout:VERSION_CODENAME=bionic
2021-03-23T10:34:54.067 INFO:teuthology.orchestra.run.gibba023.stdout:UBUNTU_CODENAME=bionic
2021-03-23T10:34:54.067 INFO:teuthology.lock.ops:Updating gibba023.front.sepia.ceph.com on lock server
2021-03-23T10:34:54.083 INFO:teuthology.lock.ops:Updating [gibba038.front.sepia.ceph.com]: set os type and version on server
2021-03-23T10:34:54.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-23T10:34:54.332 INFO:teuthology.orchestra.run.gibba038.stdout:x86_64
2021-03-23T10:34:54.377 INFO:teuthology.orchestra.run.gibba038.stdout:NAME="Ubuntu"
2021-03-23T10:34:54.377 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-23T10:34:54.377 INFO:teuthology.orchestra.run.gibba038.stdout:ID=ubuntu
2021-03-23T10:34:54.377 INFO:teuthology.orchestra.run.gibba038.stdout:ID_LIKE=debian
2021-03-23T10:34:54.377 INFO:teuthology.orchestra.run.gibba038.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-23T10:34:54.377 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION_ID="18.04"
2021-03-23T10:34:54.377 INFO:teuthology.orchestra.run.gibba038.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-23T10:34:54.377 INFO:teuthology.orchestra.run.gibba038.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-23T10:34:54.377 INFO:teuthology.orchestra.run.gibba038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-23T10:34:54.378 INFO:teuthology.orchestra.run.gibba038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-23T10:34:54.378 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION_CODENAME=bionic
2021-03-23T10:34:54.378 INFO:teuthology.orchestra.run.gibba038.stdout:UBUNTU_CODENAME=bionic
2021-03-23T10:34:54.378 INFO:teuthology.lock.ops:Updating gibba038.front.sepia.ceph.com on lock server
2021-03-23T10:34:54.393 INFO:teuthology.lock.ops:Updating [gibba045.front.sepia.ceph.com]: set os type and version on server
2021-03-23T10:34:54.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-23T10:34:54.678 INFO:teuthology.orchestra.run.gibba045.stdout:x86_64
2021-03-23T10:34:54.722 INFO:teuthology.orchestra.run.gibba045.stdout:NAME="Ubuntu"
2021-03-23T10:34:54.722 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-23T10:34:54.722 INFO:teuthology.orchestra.run.gibba045.stdout:ID=ubuntu
2021-03-23T10:34:54.722 INFO:teuthology.orchestra.run.gibba045.stdout:ID_LIKE=debian
2021-03-23T10:34:54.722 INFO:teuthology.orchestra.run.gibba045.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-23T10:34:54.723 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION_ID="18.04"
2021-03-23T10:34:54.723 INFO:teuthology.orchestra.run.gibba045.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-23T10:34:54.723 INFO:teuthology.orchestra.run.gibba045.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-23T10:34:54.723 INFO:teuthology.orchestra.run.gibba045.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-23T10:34:54.723 INFO:teuthology.orchestra.run.gibba045.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-23T10:34:54.723 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION_CODENAME=bionic
2021-03-23T10:34:54.723 INFO:teuthology.orchestra.run.gibba045.stdout:UBUNTU_CODENAME=bionic
2021-03-23T10:34:54.723 INFO:teuthology.lock.ops:Updating gibba045.front.sepia.ceph.com on lock server
2021-03-23T10:34:54.860 INFO:teuthology.dispatcher.supervisor:Running job 5989358
2021-03-23T10:34:54.860 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-03-23_02:00:05-upgrade:octopus-x-wip-sage-testing-2021-03-22-1729-distro-basic-gibba/5989358 --name sage-2021-03-23_02:00:05-upgrade:octopus-x-wip-sage-testing-2021-03-22-1729-distro-basic-gibba --description upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-pacific 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_18.04} -- /home/teuthworker/archive/sage-2021-03-23_02:00:05-upgrade:octopus-x-wip-sage-testing-2021-03-22-1729-distro-basic-gibba/5989358/orig.config.yaml
2021-03-23T10:34:54.864 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-03-23_02:00:05-upgrade:octopus-x-wip-sage-testing-2021-03-22-1729-distro-basic-gibba/5989358
2021-03-23T10:34:54.864 INFO:teuthology.dispatcher.supervisor:Job PID: 13281
2021-03-23T10:34:54.864 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-23T22:35:45.139 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-03-23T22:35:45.405 INFO:teuthology.kill:Killing Pids: {13281}
2021-03-23T22:35:47.217 INFO:teuthology.kill:Nuking machines: ['gibba012', 'gibba020', 'gibba023', 'gibba038', 'gibba045']
2021-03-23T22:35:48.241 INFO:teuthology.kill:2021-03-23 22:35:48,241.241 INFO:teuthology.nuke:targets:
2021-03-23T22:35:48.242 INFO:teuthology.kill:  gibba012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsSOrRXO+TMgICT8bdldOtUCWiMnFx4/ZY7Ha4uhr6dYAiGV/9xqasD5gudsjbubXjDdYwIZyFdf4Ssk1PtT2Z7o3kfYeiHSfm7K3HHWl6mB3lbN341WL7yq38ojWnUT+nrMx3thSPGXaaOtc6WbRLOicthhiOKhphCfMeswplIInpfRxt+AS5ADKFh9zpyh26ybTtzxt3iPwi3Z1qh44Ttjhynv1cbkAK0RoEHSnW+iNWFSY5LNZszuf5OMcoQ9F3jxhieh8SPHl4chemTSBDcEFBmChP65+OxgCUffR2hosPlMCMPBp1aJzLdkbq045SIojzGQ1QTu+zEI2ripVh
2021-03-23T22:35:48.242 INFO:teuthology.kill:  gibba020.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFTfg5h7II9q0U5JZTfp7k3p84XGPSTzzBQc7aOmVqOci4ZVbEPjP8UpP1UvOYOuOiv0vYZ4NXPF23Ah8mWPdSQibap7shgnCoKc/Zovk2cuUzQzPSEBpMxFI4X9fASxdsZFSZXDVIaJm6eV9JvrUvBZxjmA0z4I/j9eB2Unx+auj1O8oaFQS5BOripRbW5SRH+uXYMJ0eqJOTk6w4Sfj1yk28yqVROErwv3104AX+ynw5BLVYJTUnK+92TIfPz2/5T8/zggkHvG7wo7zcVFPklKx3AHrsbrdJK1K+g0M6p3N7FP9x+Wmww9t8n4IxRoWq6Q2yZfxaskhRmEaUhN0j
2021-03-23T22:35:48.242 INFO:teuthology.kill:  gibba023.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKyyPx/g0Q6sLtY5tzqrjLvcIarvYvQQYx+BRw8495zz8LCEdYzjQdld3v3E36qrRd7L2QOziBZ0wHsJ9WWqWC8k6Sz6YKofb5JGUp6DXdfbtZR+oF5eKfrGKp8sxRJetwVEPr1/jUyxHGMsoEFBV1QG31nsjTlIJ2pjlg6C1jIOKSavJja0wIRq7/uL/CzM/P+3KPMunb3ICkQqQe8GM2bHmnibaBKxQxZI3JpMKsu9zJzL65Ztj4GR0A1Wnfhf2Uno7CbpnoWFil/MJU6hnXkOUuxqW+pQ/OsPyhAfvZBylvQXDhDPZ4jMhfmtHztvxEYZDuiQVx+0AlXIAzU+I7
2021-03-23T22:35:48.242 INFO:teuthology.kill:  gibba038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRl00vdjjeXcbx7C0D3XwHLYTZX2N/j6nRBgoYdyAeqzdZrzo7dDB7eSOMYzE+Y78u1or+KzEU0CbZ3PUM//gH2y518Mg053wD+3t+VkHxl9WnUI/crWEQUstzCi6kXhKPTbdxThINDH3HuMOaELZz9a82TfICAcUrsG4s/69z4Y9No8cS/Kk17T0C1NKYZnyf9uZkkoRj9se105f5a5EucsKhQntDO7S9M55NaPh4czSvZOXlTFeePhoH6syWQkLAWpVTeb1g4hyFYgZCNeB0iYQ9pmYvDnIlqdAL/O9YLV8cgNaO/DWGIh2mPxvFXzVpB8xwN44yuXbvdz/95RUb
2021-03-23T22:35:48.242 INFO:teuthology.kill:  gibba045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCjpei9fONgcmAfUMBG6FaL/qBPZBIXRR7TsgxJrWC0Tip75eLKMWIQcDADxhqd3Q/tVK8GitrwQXOjDxOGWouNwx6DC02feVAy1oDI9QR0PvKvy772wGIZP5ljZ9xV9TbF0MrcuNOHqR3/OFA8kj5vZEvbnHMAwm7+mbe8HP62pp9nvGqKp1aMeoczHgVIGziLq5HNItAhcDwUZ6WXnbd6lx34fgmT6mrjXsEY8Up3VI89NzqyIS9AugZUZIZMbD+OxqNW3DG3xox+HKivtuJTURQRTqbaJDey2AXzgkasWyyc/XRXPvHFzr+Ui5CCPLBvPJ9WAcHVdhUSOp2s7H17
2021-03-23T22:35:48.242 INFO:teuthology.kill:2021-03-23 22:35:48,241.241 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T22:35:48.244 INFO:teuthology.kill:2021-03-23 22:35:48,244.244 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T22:35:48.245 INFO:teuthology.kill:2021-03-23 22:35:48,245.245 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T22:35:48.246 INFO:teuthology.kill:2021-03-23 22:35:48,246.246 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T22:35:48.248 INFO:teuthology.kill:2021-03-23 22:35:48,247.247 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T22:35:48.332 INFO:teuthology.kill:2021-03-23 22:35:48,332.332 INFO:teuthology.orchestra.console:Power off gibba023
2021-03-23T22:35:48.355 INFO:teuthology.kill:2021-03-23 22:35:48,355.355 INFO:teuthology.orchestra.console:Power off gibba045
2021-03-23T22:35:48.368 INFO:teuthology.kill:2021-03-23 22:35:48,368.368 INFO:teuthology.orchestra.console:Power off gibba012
2021-03-23T22:35:48.378 INFO:teuthology.kill:2021-03-23 22:35:48,378.378 INFO:teuthology.orchestra.console:Power off gibba038
2021-03-23T22:35:48.395 INFO:teuthology.kill:2021-03-23 22:35:48,394.394 INFO:teuthology.orchestra.console:Power off gibba020
2021-03-23T22:35:56.785 INFO:teuthology.kill:2021-03-23 22:35:56,784.784 INFO:teuthology.orchestra.console:Power off for gibba038 completed
2021-03-23T22:36:00.889 INFO:teuthology.kill:2021-03-23 22:36:00,889.889 INFO:teuthology.orchestra.console:Power off for gibba045 completed
2021-03-23T22:36:00.907 INFO:teuthology.kill:2021-03-23 22:36:00,907.907 INFO:teuthology.orchestra.console:Power off for gibba023 completed
2021-03-23T22:36:00.929 INFO:teuthology.kill:2021-03-23 22:36:00,929.929 INFO:teuthology.orchestra.console:Power off for gibba012 completed
2021-03-23T22:36:00.966 INFO:teuthology.kill:2021-03-23 22:36:00,966.966 INFO:teuthology.orchestra.console:Power off for gibba020 completed
2021-03-23T22:36:01.305 INFO:teuthology.task.internal:roles: ubuntu@gibba012.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
2021-03-23T22:36:01.305 INFO:teuthology.task.internal:roles: ubuntu@gibba020.front.sepia.ceph.com - ['mon.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-03-23T22:36:01.305 INFO:teuthology.task.internal:roles: ubuntu@gibba023.front.sepia.ceph.com - ['mon.c']
2021-03-23T22:36:01.305 INFO:teuthology.task.internal:roles: ubuntu@gibba038.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11']
2021-03-23T22:36:01.305 INFO:teuthology.task.internal:roles: ubuntu@gibba045.front.sepia.ceph.com - ['client.0']
2021-03-23T22:36:01.305 INFO:teuthology.misc:Compressing logs...
2021-03-23T22:36:01.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-23T22:36:35.907 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-03-23T22:36:36.031 INFO:teuthology.kill:No teuthology processes running
2021-03-23T22:36:37.960 INFO:teuthology.kill:Nuking machines: ['gibba012', 'gibba020', 'gibba023', 'gibba038', 'gibba045']
2021-03-23T22:36:39.590 INFO:teuthology.kill:2021-03-23 22:36:39,589.589 INFO:teuthology.nuke:targets:
2021-03-23T22:36:39.591 INFO:teuthology.kill:  gibba012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsSOrRXO+TMgICT8bdldOtUCWiMnFx4/ZY7Ha4uhr6dYAiGV/9xqasD5gudsjbubXjDdYwIZyFdf4Ssk1PtT2Z7o3kfYeiHSfm7K3HHWl6mB3lbN341WL7yq38ojWnUT+nrMx3thSPGXaaOtc6WbRLOicthhiOKhphCfMeswplIInpfRxt+AS5ADKFh9zpyh26ybTtzxt3iPwi3Z1qh44Ttjhynv1cbkAK0RoEHSnW+iNWFSY5LNZszuf5OMcoQ9F3jxhieh8SPHl4chemTSBDcEFBmChP65+OxgCUffR2hosPlMCMPBp1aJzLdkbq045SIojzGQ1QTu+zEI2ripVh
2021-03-23T22:36:39.591 INFO:teuthology.kill:  gibba020.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFTfg5h7II9q0U5JZTfp7k3p84XGPSTzzBQc7aOmVqOci4ZVbEPjP8UpP1UvOYOuOiv0vYZ4NXPF23Ah8mWPdSQibap7shgnCoKc/Zovk2cuUzQzPSEBpMxFI4X9fASxdsZFSZXDVIaJm6eV9JvrUvBZxjmA0z4I/j9eB2Unx+auj1O8oaFQS5BOripRbW5SRH+uXYMJ0eqJOTk6w4Sfj1yk28yqVROErwv3104AX+ynw5BLVYJTUnK+92TIfPz2/5T8/zggkHvG7wo7zcVFPklKx3AHrsbrdJK1K+g0M6p3N7FP9x+Wmww9t8n4IxRoWq6Q2yZfxaskhRmEaUhN0j
2021-03-23T22:36:39.591 INFO:teuthology.kill:  gibba023.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKyyPx/g0Q6sLtY5tzqrjLvcIarvYvQQYx+BRw8495zz8LCEdYzjQdld3v3E36qrRd7L2QOziBZ0wHsJ9WWqWC8k6Sz6YKofb5JGUp6DXdfbtZR+oF5eKfrGKp8sxRJetwVEPr1/jUyxHGMsoEFBV1QG31nsjTlIJ2pjlg6C1jIOKSavJja0wIRq7/uL/CzM/P+3KPMunb3ICkQqQe8GM2bHmnibaBKxQxZI3JpMKsu9zJzL65Ztj4GR0A1Wnfhf2Uno7CbpnoWFil/MJU6hnXkOUuxqW+pQ/OsPyhAfvZBylvQXDhDPZ4jMhfmtHztvxEYZDuiQVx+0AlXIAzU+I7
2021-03-23T22:36:39.591 INFO:teuthology.kill:  gibba038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRl00vdjjeXcbx7C0D3XwHLYTZX2N/j6nRBgoYdyAeqzdZrzo7dDB7eSOMYzE+Y78u1or+KzEU0CbZ3PUM//gH2y518Mg053wD+3t+VkHxl9WnUI/crWEQUstzCi6kXhKPTbdxThINDH3HuMOaELZz9a82TfICAcUrsG4s/69z4Y9No8cS/Kk17T0C1NKYZnyf9uZkkoRj9se105f5a5EucsKhQntDO7S9M55NaPh4czSvZOXlTFeePhoH6syWQkLAWpVTeb1g4hyFYgZCNeB0iYQ9pmYvDnIlqdAL/O9YLV8cgNaO/DWGIh2mPxvFXzVpB8xwN44yuXbvdz/95RUb
2021-03-23T22:36:39.591 INFO:teuthology.kill:  gibba045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCjpei9fONgcmAfUMBG6FaL/qBPZBIXRR7TsgxJrWC0Tip75eLKMWIQcDADxhqd3Q/tVK8GitrwQXOjDxOGWouNwx6DC02feVAy1oDI9QR0PvKvy772wGIZP5ljZ9xV9TbF0MrcuNOHqR3/OFA8kj5vZEvbnHMAwm7+mbe8HP62pp9nvGqKp1aMeoczHgVIGziLq5HNItAhcDwUZ6WXnbd6lx34fgmT6mrjXsEY8Up3VI89NzqyIS9AugZUZIZMbD+OxqNW3DG3xox+HKivtuJTURQRTqbaJDey2AXzgkasWyyc/XRXPvHFzr+Ui5CCPLBvPJ9WAcHVdhUSOp2s7H17
2021-03-23T22:36:39.624 INFO:teuthology.kill:2021-03-23 22:36:39,624.624 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T22:36:39.628 INFO:teuthology.kill:2021-03-23 22:36:39,628.628 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T22:36:39.631 INFO:teuthology.kill:2021-03-23 22:36:39,631.631 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T22:36:39.632 INFO:teuthology.kill:2021-03-23 22:36:39,632.632 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T22:36:39.637 INFO:teuthology.kill:2021-03-23 22:36:39,636.636 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-23T22:36:39.691 INFO:teuthology.kill:2021-03-23 22:36:39,690.690 INFO:teuthology.orchestra.console:Power off gibba023
2021-03-23T22:36:39.708 INFO:teuthology.kill:2021-03-23 22:36:39,708.708 INFO:teuthology.orchestra.console:Power off gibba045
2021-03-23T22:36:39.723 INFO:teuthology.kill:2021-03-23 22:36:39,722.722 INFO:teuthology.orchestra.console:Power off gibba020
2021-03-23T22:36:39.733 INFO:teuthology.kill:2021-03-23 22:36:39,733.733 INFO:teuthology.orchestra.console:Power off gibba012
2021-03-23T22:36:39.777 INFO:teuthology.kill:2021-03-23 22:36:39,776.776 INFO:teuthology.orchestra.console:Power off gibba038
2021-03-23T22:36:39.884 INFO:teuthology.kill:2021-03-23 22:36:39,883.883 INFO:teuthology.orchestra.console:Power off for gibba020 completed
2021-03-23T22:36:39.885 INFO:teuthology.kill:2021-03-23 22:36:39,884.884 INFO:teuthology.orchestra.console:Power off for gibba023 completed
2021-03-23T22:36:39.885 INFO:teuthology.kill:2021-03-23 22:36:39,884.884 INFO:teuthology.orchestra.console:Power off for gibba045 completed
2021-03-23T22:36:39.887 INFO:teuthology.kill:2021-03-23 22:36:39,886.886 INFO:teuthology.orchestra.console:Power off for gibba012 completed
2021-03-23T22:36:39.926 INFO:teuthology.kill:2021-03-23 22:36:39,926.926 INFO:teuthology.orchestra.console:Power off for gibba038 completed
2021-03-23T22:36:40.036 INFO:teuthology.kill:2021-03-23 22:36:40,035.035 INFO:teuthology.lock.ops:unlocked gibba020.front.sepia.ceph.com
2021-03-23T22:36:40.038 INFO:teuthology.kill:2021-03-23 22:36:40,037.037 ERROR:teuthology.lock.ops:failed to unlock gibba023.front.sepia.ceph.com. reason: 500
2021-03-23T22:36:40.038 INFO:teuthology.kill:2021-03-23 22:36:40,038.038 INFO:teuthology.lock.ops:unlocked gibba012.front.sepia.ceph.com
2021-03-23T22:36:40.056 INFO:teuthology.kill:2021-03-23 22:36:40,056.056 ERROR:teuthology.lock.ops:failed to unlock gibba038.front.sepia.ceph.com. reason: 500
2021-03-23T22:36:40.056 INFO:teuthology.kill:2021-03-23 22:36:40,056.056 INFO:teuthology.lock.ops:unlocked gibba045.front.sepia.ceph.com
2021-03-23T22:38:40.364 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-23T22:38:40.552 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-23T22:38:40.552 INFO:teuthology.nuke:Checking targets against current locks
2021-03-23T22:38:40.628 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/scripts/dispatcher.py", line 33, in main
    teuthology.dispatcher.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 59, in main
    verbose
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 152, in run_job
    unlock_targets(job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets
    nuke(fake_ctx, True)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/nuke/__init__.py", line 250, in nuke
    if ctx.name not in lock['description']:
TypeError: argument of type 'NoneType' is not iterable