2021-04-19T22:50:55.762 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-19T22:50:55.979 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba009.front.sepia.ceph.com' reimaging 2021-04-19T22:50:55.981 INFO:teuthology.lock.ops:Updating [ubuntu@gibba009.front.sepia.ceph.com]: reset os type and version on server 2021-04-19T22:50:55.981 INFO:teuthology.lock.ops:Updating gibba009.front.sepia.ceph.com on lock server 2021-04-19T22:50:55.999 INFO:teuthology.lock.ops:Node 'ubuntu@gibba009.front.sepia.ceph.com' reimaging is complete 2021-04-19T22:50:55.999 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba010.front.sepia.ceph.com' reimaging 2021-04-19T22:50:56.000 INFO:teuthology.lock.ops:Updating [ubuntu@gibba010.front.sepia.ceph.com]: reset os type and version on server 2021-04-19T22:50:56.001 INFO:teuthology.lock.ops:Updating gibba010.front.sepia.ceph.com on lock server 2021-04-19T22:50:56.018 INFO:teuthology.lock.ops:Node 'ubuntu@gibba010.front.sepia.ceph.com' reimaging is complete 2021-04-19T22:50:56.019 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba021.front.sepia.ceph.com' reimaging 2021-04-19T22:50:56.020 INFO:teuthology.lock.ops:Updating [ubuntu@gibba021.front.sepia.ceph.com]: reset os type and version on server 2021-04-19T22:50:56.020 INFO:teuthology.lock.ops:Updating gibba021.front.sepia.ceph.com on lock server 2021-04-19T22:50:56.035 INFO:teuthology.lock.ops:Node 'ubuntu@gibba021.front.sepia.ceph.com' reimaging is complete 2021-04-19T22:50:56.036 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba022.front.sepia.ceph.com' reimaging 2021-04-19T22:50:56.036 INFO:teuthology.lock.ops:Updating [ubuntu@gibba022.front.sepia.ceph.com]: reset os type and version on server 2021-04-19T22:50:56.037 INFO:teuthology.lock.ops:Updating gibba022.front.sepia.ceph.com on lock server 2021-04-19T22:50:56.052 INFO:teuthology.lock.ops:Node 'ubuntu@gibba022.front.sepia.ceph.com' reimaging is complete 2021-04-19T22:50:56.053 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba045.front.sepia.ceph.com' reimaging 2021-04-19T22:50:56.053 INFO:teuthology.lock.ops:Updating [ubuntu@gibba045.front.sepia.ceph.com]: reset os type and version on server 2021-04-19T22:50:56.053 INFO:teuthology.lock.ops:Updating gibba045.front.sepia.ceph.com on lock server 2021-04-19T22:50:56.068 INFO:teuthology.lock.ops:Node 'ubuntu@gibba045.front.sepia.ceph.com' reimaging is complete 2021-04-19T22:50:56.211 INFO:teuthology.provision.fog.gibba009:Scheduling deploy of ubuntu 16.04 2021-04-19T22:50:56.268 INFO:teuthology.provision.fog.gibba022:Scheduling deploy of ubuntu 16.04 2021-04-19T22:50:56.298 INFO:teuthology.provision.fog.gibba045:Scheduling deploy of ubuntu 16.04 2021-04-19T22:50:56.299 INFO:teuthology.provision.fog.gibba010:Scheduling deploy of ubuntu 16.04 2021-04-19T22:50:56.305 INFO:teuthology.provision.fog.gibba021:Scheduling deploy of ubuntu 16.04 2021-04-19T22:50:56.581 INFO:teuthology.orchestra.console:Power off gibba009 2021-04-19T22:50:56.629 INFO:teuthology.orchestra.console:Power off gibba022 2021-04-19T22:50:56.684 INFO:teuthology.orchestra.console:Power off gibba010 2021-04-19T22:50:56.736 INFO:teuthology.orchestra.console:Power off gibba021 2021-04-19T22:50:56.766 INFO:teuthology.orchestra.console:Power off gibba045 2021-04-19T22:51:05.000 INFO:teuthology.orchestra.console:Power off for gibba009 completed 2021-04-19T22:51:05.087 INFO:teuthology.orchestra.console:Power off for gibba010 completed 2021-04-19T22:51:05.104 INFO:teuthology.orchestra.console:Power on gibba009 2021-04-19T22:51:05.139 INFO:teuthology.orchestra.console:Power off for gibba021 completed 2021-04-19T22:51:05.175 INFO:teuthology.orchestra.console:Power off for gibba045 completed 2021-04-19T22:51:05.189 INFO:teuthology.orchestra.console:Power on gibba010 2021-04-19T22:51:05.241 INFO:teuthology.orchestra.console:Power on gibba021 2021-04-19T22:51:05.299 INFO:teuthology.orchestra.console:Power on gibba045 2021-04-19T22:51:09.174 INFO:teuthology.orchestra.console:Power off for gibba022 completed 2021-04-19T22:51:09.276 INFO:teuthology.orchestra.console:Power on gibba022 2021-04-19T22:51:13.568 INFO:teuthology.orchestra.console:Power on for gibba009 completed 2021-04-19T22:51:13.670 INFO:teuthology.provision.fog.gibba009:Waiting for deploy to finish 2021-04-19T22:51:13.673 INFO:teuthology.orchestra.console:Power on for gibba010 completed 2021-04-19T22:51:13.704 INFO:teuthology.orchestra.console:Power on for gibba021 completed 2021-04-19T22:51:13.756 INFO:teuthology.orchestra.console:Power on for gibba045 completed 2021-04-19T22:51:13.775 INFO:teuthology.provision.fog.gibba010:Waiting for deploy to finish 2021-04-19T22:51:13.806 INFO:teuthology.provision.fog.gibba021:Waiting for deploy to finish 2021-04-19T22:51:13.857 INFO:teuthology.provision.fog.gibba045:Waiting for deploy to finish 2021-04-19T22:51:17.776 INFO:teuthology.orchestra.console:Power on for gibba022 completed 2021-04-19T22:51:17.877 INFO:teuthology.provision.fog.gibba022:Waiting for deploy to finish 2021-04-19T22:55:13.508 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-04-19T22:55:25.532 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-04-19T22:55:31.648 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-19T22:55:32.038 INFO:teuthology.provision.fog.gibba009:Node is ready 2021-04-19T22:55:32.077 INFO:teuthology.orchestra.run.gibba009.stdout:gibba009.front.sepia.ceph.com 2021-04-19T22:55:32.118 INFO:teuthology.orchestra.run.gibba009.stdout:172.21.2.109 gibba009.front.sepia.ceph.com gibba009 2021-04-19T22:55:32.367 INFO:teuthology.provision.fog.gibba009:Deploy complete! 2021-04-19T22:55:39.215 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-19T22:55:39.245 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-19T22:55:39.398 INFO:teuthology.provision.fog.gibba010:Node is ready 2021-04-19T22:55:39.434 INFO:teuthology.provision.fog.gibba045:Node is ready 2021-04-19T22:55:39.439 INFO:teuthology.orchestra.run.gibba010.stdout:gibba010.front.sepia.ceph.com 2021-04-19T22:55:39.477 INFO:teuthology.orchestra.run.gibba045.stdout:gibba045.front.sepia.ceph.com 2021-04-19T22:55:39.482 INFO:teuthology.orchestra.run.gibba010.stdout:172.21.2.110 gibba010.front.sepia.ceph.com gibba010 2021-04-19T22:55:39.516 INFO:teuthology.orchestra.run.gibba045.stdout:172.21.2.145 gibba045.front.sepia.ceph.com gibba045 2021-04-19T22:55:39.722 INFO:teuthology.provision.fog.gibba010:Deploy complete! 2021-04-19T22:55:39.754 INFO:teuthology.provision.fog.gibba045:Deploy complete! 2021-04-19T22:55:43.202 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-19T22:55:43.398 INFO:teuthology.provision.fog.gibba022:Node is ready 2021-04-19T22:55:43.437 INFO:teuthology.orchestra.run.gibba022.stdout:gibba022.front.sepia.ceph.com 2021-04-19T22:55:43.478 INFO:teuthology.orchestra.run.gibba022.stdout:172.21.2.122 gibba022.front.sepia.ceph.com gibba022 2021-04-19T22:55:43.719 INFO:teuthology.provision.fog.gibba022:Deploy complete! 2021-04-19T22:55:48.298 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-19T22:55:48.479 INFO:teuthology.provision.fog.gibba021:Node is ready 2021-04-19T22:55:48.520 INFO:teuthology.orchestra.run.gibba021.stdout:gibba021.front.sepia.ceph.com 2021-04-19T22:55:48.559 INFO:teuthology.orchestra.run.gibba021.stdout:172.21.2.121 gibba021.front.sepia.ceph.com gibba021 2021-04-19T22:55:48.800 INFO:teuthology.provision.fog.gibba021:Deploy complete! 2021-04-19T22:55:51.286 INFO:teuthology.lock.ops:Checking gibba009.front.sepia.ceph.com 2021-04-19T22:55:51.287 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-19T22:55:51.304 INFO:teuthology.lock.ops:Checking gibba010.front.sepia.ceph.com 2021-04-19T22:55:51.305 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-19T22:55:51.317 INFO:teuthology.lock.ops:Checking gibba021.front.sepia.ceph.com 2021-04-19T22:55:51.318 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-19T22:55:51.340 INFO:teuthology.lock.ops:Checking gibba022.front.sepia.ceph.com 2021-04-19T22:55:51.341 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-19T22:55:51.358 INFO:teuthology.lock.ops:Checking gibba045.front.sepia.ceph.com 2021-04-19T22:55:51.358 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-19T22:55:51.377 INFO:teuthology.lock.ops:Updating [gibba009.front.sepia.ceph.com]: set os type and version on server 2021-04-19T22:55:51.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-19T22:55:51.662 INFO:teuthology.orchestra.run.gibba009.stdout:x86_64 2021-04-19T22:55:51.702 INFO:teuthology.orchestra.run.gibba009.stdout:NAME="Ubuntu" 2021-04-19T22:55:51.703 INFO:teuthology.orchestra.run.gibba009.stdout:VERSION="16.04.7 LTS (Xenial Xerus)" 2021-04-19T22:55:51.703 INFO:teuthology.orchestra.run.gibba009.stdout:ID=ubuntu 2021-04-19T22:55:51.703 INFO:teuthology.orchestra.run.gibba009.stdout:ID_LIKE=debian 2021-04-19T22:55:51.704 INFO:teuthology.orchestra.run.gibba009.stdout:PRETTY_NAME="Ubuntu 16.04.7 LTS" 2021-04-19T22:55:51.704 INFO:teuthology.orchestra.run.gibba009.stdout:VERSION_ID="16.04" 2021-04-19T22:55:51.704 INFO:teuthology.orchestra.run.gibba009.stdout:HOME_URL="http://www.ubuntu.com/" 2021-04-19T22:55:51.704 INFO:teuthology.orchestra.run.gibba009.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-04-19T22:55:51.704 INFO:teuthology.orchestra.run.gibba009.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-04-19T22:55:51.705 INFO:teuthology.orchestra.run.gibba009.stdout:VERSION_CODENAME=xenial 2021-04-19T22:55:51.705 INFO:teuthology.orchestra.run.gibba009.stdout:UBUNTU_CODENAME=xenial 2021-04-19T22:55:51.706 INFO:teuthology.lock.ops:Updating gibba009.front.sepia.ceph.com on lock server 2021-04-19T22:55:51.721 INFO:teuthology.lock.ops:Updating [gibba010.front.sepia.ceph.com]: set os type and version on server 2021-04-19T22:55:51.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-19T22:55:52.010 INFO:teuthology.orchestra.run.gibba010.stdout:x86_64 2021-04-19T22:55:52.049 INFO:teuthology.orchestra.run.gibba010.stdout:NAME="Ubuntu" 2021-04-19T22:55:52.050 INFO:teuthology.orchestra.run.gibba010.stdout:VERSION="16.04.7 LTS (Xenial Xerus)" 2021-04-19T22:55:52.050 INFO:teuthology.orchestra.run.gibba010.stdout:ID=ubuntu 2021-04-19T22:55:52.050 INFO:teuthology.orchestra.run.gibba010.stdout:ID_LIKE=debian 2021-04-19T22:55:52.050 INFO:teuthology.orchestra.run.gibba010.stdout:PRETTY_NAME="Ubuntu 16.04.7 LTS" 2021-04-19T22:55:52.051 INFO:teuthology.orchestra.run.gibba010.stdout:VERSION_ID="16.04" 2021-04-19T22:55:52.051 INFO:teuthology.orchestra.run.gibba010.stdout:HOME_URL="http://www.ubuntu.com/" 2021-04-19T22:55:52.051 INFO:teuthology.orchestra.run.gibba010.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-04-19T22:55:52.051 INFO:teuthology.orchestra.run.gibba010.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-04-19T22:55:52.052 INFO:teuthology.orchestra.run.gibba010.stdout:VERSION_CODENAME=xenial 2021-04-19T22:55:52.052 INFO:teuthology.orchestra.run.gibba010.stdout:UBUNTU_CODENAME=xenial 2021-04-19T22:55:52.052 INFO:teuthology.lock.ops:Updating gibba010.front.sepia.ceph.com on lock server 2021-04-19T22:55:52.087 INFO:teuthology.lock.ops:Updating [gibba021.front.sepia.ceph.com]: set os type and version on server 2021-04-19T22:55:52.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-19T22:55:52.375 INFO:teuthology.orchestra.run.gibba021.stdout:x86_64 2021-04-19T22:55:52.416 INFO:teuthology.orchestra.run.gibba021.stdout:NAME="Ubuntu" 2021-04-19T22:55:52.416 INFO:teuthology.orchestra.run.gibba021.stdout:VERSION="16.04.7 LTS (Xenial Xerus)" 2021-04-19T22:55:52.416 INFO:teuthology.orchestra.run.gibba021.stdout:ID=ubuntu 2021-04-19T22:55:52.416 INFO:teuthology.orchestra.run.gibba021.stdout:ID_LIKE=debian 2021-04-19T22:55:52.417 INFO:teuthology.orchestra.run.gibba021.stdout:PRETTY_NAME="Ubuntu 16.04.7 LTS" 2021-04-19T22:55:52.417 INFO:teuthology.orchestra.run.gibba021.stdout:VERSION_ID="16.04" 2021-04-19T22:55:52.417 INFO:teuthology.orchestra.run.gibba021.stdout:HOME_URL="http://www.ubuntu.com/" 2021-04-19T22:55:52.417 INFO:teuthology.orchestra.run.gibba021.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-04-19T22:55:52.418 INFO:teuthology.orchestra.run.gibba021.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-04-19T22:55:52.418 INFO:teuthology.orchestra.run.gibba021.stdout:VERSION_CODENAME=xenial 2021-04-19T22:55:52.418 INFO:teuthology.orchestra.run.gibba021.stdout:UBUNTU_CODENAME=xenial 2021-04-19T22:55:52.418 INFO:teuthology.lock.ops:Updating gibba021.front.sepia.ceph.com on lock server 2021-04-19T22:55:52.435 INFO:teuthology.lock.ops:Updating [gibba022.front.sepia.ceph.com]: set os type and version on server 2021-04-19T22:55:52.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-19T22:55:52.726 INFO:teuthology.orchestra.run.gibba022.stdout:x86_64 2021-04-19T22:55:52.766 INFO:teuthology.orchestra.run.gibba022.stdout:NAME="Ubuntu" 2021-04-19T22:55:52.767 INFO:teuthology.orchestra.run.gibba022.stdout:VERSION="16.04.7 LTS (Xenial Xerus)" 2021-04-19T22:55:52.767 INFO:teuthology.orchestra.run.gibba022.stdout:ID=ubuntu 2021-04-19T22:55:52.767 INFO:teuthology.orchestra.run.gibba022.stdout:ID_LIKE=debian 2021-04-19T22:55:52.767 INFO:teuthology.orchestra.run.gibba022.stdout:PRETTY_NAME="Ubuntu 16.04.7 LTS" 2021-04-19T22:55:52.768 INFO:teuthology.orchestra.run.gibba022.stdout:VERSION_ID="16.04" 2021-04-19T22:55:52.768 INFO:teuthology.orchestra.run.gibba022.stdout:HOME_URL="http://www.ubuntu.com/" 2021-04-19T22:55:52.768 INFO:teuthology.orchestra.run.gibba022.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-04-19T22:55:52.769 INFO:teuthology.orchestra.run.gibba022.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-04-19T22:55:52.769 INFO:teuthology.orchestra.run.gibba022.stdout:VERSION_CODENAME=xenial 2021-04-19T22:55:52.769 INFO:teuthology.orchestra.run.gibba022.stdout:UBUNTU_CODENAME=xenial 2021-04-19T22:55:52.770 INFO:teuthology.lock.ops:Updating gibba022.front.sepia.ceph.com on lock server 2021-04-19T22:55:52.790 INFO:teuthology.lock.ops:Updating [gibba045.front.sepia.ceph.com]: set os type and version on server 2021-04-19T22:55:52.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-19T22:55:53.072 INFO:teuthology.orchestra.run.gibba045.stdout:x86_64 2021-04-19T22:55:53.113 INFO:teuthology.orchestra.run.gibba045.stdout:NAME="Ubuntu" 2021-04-19T22:55:53.113 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION="16.04.7 LTS (Xenial Xerus)" 2021-04-19T22:55:53.113 INFO:teuthology.orchestra.run.gibba045.stdout:ID=ubuntu 2021-04-19T22:55:53.114 INFO:teuthology.orchestra.run.gibba045.stdout:ID_LIKE=debian 2021-04-19T22:55:53.114 INFO:teuthology.orchestra.run.gibba045.stdout:PRETTY_NAME="Ubuntu 16.04.7 LTS" 2021-04-19T22:55:53.114 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION_ID="16.04" 2021-04-19T22:55:53.114 INFO:teuthology.orchestra.run.gibba045.stdout:HOME_URL="http://www.ubuntu.com/" 2021-04-19T22:55:53.115 INFO:teuthology.orchestra.run.gibba045.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-04-19T22:55:53.115 INFO:teuthology.orchestra.run.gibba045.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-04-19T22:55:53.115 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION_CODENAME=xenial 2021-04-19T22:55:53.116 INFO:teuthology.orchestra.run.gibba045.stdout:UBUNTU_CODENAME=xenial 2021-04-19T22:55:53.117 INFO:teuthology.lock.ops:Updating gibba045.front.sepia.ceph.com on lock server 2021-04-19T22:55:53.218 INFO:teuthology.dispatcher.supervisor:Running job 6047839 2021-04-19T22:55:53.219 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-04-15_02:30:03-upgrade:mimic-x-nautilus-distro-basic-gibba/6047839 --name teuthology-2021-04-15_02:30:03-upgrade:mimic-x-nautilus-distro-basic-gibba --description upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-nautilus 6.1-msgr2 7-final-workload/{rbd-python rgw-swift-ragweed_check snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_16.04 thrashosds-health} -- /home/teuthworker/archive/teuthology-2021-04-15_02:30:03-upgrade:mimic-x-nautilus-distro-basic-gibba/6047839/orig.config.yaml 2021-04-19T22:55:53.223 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-04-15_02:30:03-upgrade:mimic-x-nautilus-distro-basic-gibba/6047839 2021-04-19T22:55:53.225 INFO:teuthology.dispatcher.supervisor:Job PID: 15964 2021-04-19T22:55:53.229 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-04-20T01:57:13.854 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-04-15_02:30:03-upgrade:mimic-x-nautilus-distro-basic-gibba/jobs/ failed with status 504: 504 Gateway Time-out

504 Gateway Time-out


nginx/1.10.3 (Ubuntu)
2021-04-20T10:55:57.417 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-04-20T10:55:57.684 INFO:teuthology.kill:Killing Pids: {15964} 2021-04-20T10:55:58.703 INFO:teuthology.kill:Nuking machines: ['gibba009', 'gibba010', 'gibba021', 'gibba022', 'gibba045'] 2021-04-20T10:55:59.587 INFO:teuthology.kill:2021-04-20 10:55:59,586.586 INFO:teuthology.nuke:targets: 2021-04-20T10:55:59.588 INFO:teuthology.kill: gibba009.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzXMk7MYv//NI/KM4OMgsYngg+wLJ1roGgbPD2mWsPudj7edNpUwxpL1ILoKrI7By/OyVXjhgTSLRZRF1+uGmVcRPmKA7D2/BdXPTVz1qa7W7ddkEf7CedSwZKpiewVmqPsB42EpFFjC1YdFAkvKomjcfFOn5uS3+4kgxrgCxt+dduPORRUiI5ZVRn/KrKmLCxL1FnJEvAd0au/mVVv3ezfrP/JHgHgvmCnQtbwDmf7NrkXkNZnUTVg4AE6DXga800FNpvi8cNmKlPP+o8yHuPUWR3te5w8HEUb849c47ctLt+eLFyEYjUmlcAvx3weKUe/VTr294R0DfwzX+Ha31V 2021-04-20T10:55:59.588 INFO:teuthology.kill: gibba010.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCrQ6TqM9G7tKiioLXCdHNzjSAs9UAhWulbSB+5yEvfy6MO+1UdsdNYQu+cjMawA+UmChG4FS1UlYs4IhSo6eJIXZs2ZEhFX/LU2CSgLK7X6G/gCXdcKI78QVsWGdNFzKNeVZDixvw5c/kYh4fPGF63lLvuXnQYPWsCDf6awsAfb/fPvl+aNciskmWtN0IZp1sADOsukyofrblWkdcjPIM0XNV7C4rPSuUsADoJQEKcL9OeblCtt5n0S5r14QsZhIjRfm4bP/S4Y/Up30/3HwwVeJS0QrZ2uycRL1LOGje4NWSlaun2/+dpnc05Tvvp7NaYo3cHO075gtaFlgg9NfoH 2021-04-20T10:55:59.588 INFO:teuthology.kill: gibba021.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpnhuow+Lsob+Jc1EP/fbrKHzwdBuTjWYYIDr1sGGB0xHxw5BtJ7cSMCPx9ed7hjI+vRQDi58eVeLPoMLH2IVJSA5PaOyFwpIau3mKybiwjbVd3a3mIOKxQLoYmTwyJ7qknLeUoRa+NNunoilGnpdGb/ied3hvT2cZ4i59G4kruvXfzNHrKJnkGRPns3V1TN4S22wBDQaSvnz7nj0eOwhFmzlnkafLlzsZzkmmhFOxFjQKIkgUYDCiYt9MLFH0+Ph5T3w/UKqdoZmhCoBBXTeFIXxVOVNuFTibSBmeIyFFONKlEOEuwNjhIreEJtiN4iVyPnO69SNl/F02wCDWdBAF 2021-04-20T10:55:59.589 INFO:teuthology.kill: gibba022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCsaPSnSNsmpI3IoO3zrX/TWNv5dunilVbur0TkX89ae/Mbys4AZfGEEXmL1seIHwLvdTB88w4zkzlq0CyEC+YaoyYI2G2fKww/CPinMI/z7nYJ2/4YW0daxuh4yLi5SnaXuKvKtkjsJ0Cg+t0YzzNfRMOUdt+WN6CZz3HaZhz0CO+Zwbv70rWcqI10mNAw0g53NbE5bsgBaCp/cLdG0l24eUULX7NjkPdtGeYLtmd+cj5SP3L/Eaicg7EaNV2Y11U+yji3lqDqYrRJHdPPQhrU+y5QPbZ2tTpKV+6MM0gH2kUv69C2opDmwF/0pxKjCTFwjau3pMnZ1Y9douunt0F 2021-04-20T10:55:59.589 INFO:teuthology.kill: gibba045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9AZbuc5pUkn1up01WaA3/+BoWDw4WeHdDoAV/7a6zgsCXzR3gkyp0ig3yAD0IAFL3EDFdW/CRGMxNDkMtHWxSiwq6tzvN/PP5yesBnZ8jCxSKeRcBINOlUDzeXxHeQjrNSc0w4tR6aVPDTDWXtOAVCRc5a8XoXZoP9YM5bcsVVokaZO8Db0PT0Qday3LCJo6iKOqPw1TE7UQvirUJSchCHU+VozsbejpzoFNTs/z18GxZo8vqmFRnGFELIgAOZjeeXlsIP65+DcNwC7PhCRwvN2IIDQqBzy0G7CEptYVKOYBnypTO/19mCi71EYI0YH09nZYaJt3WNujwJfLCjlo7 2021-04-20T10:55:59.589 INFO:teuthology.kill:2021-04-20 10:55:59,587.587 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-20T10:55:59.590 INFO:teuthology.kill:2021-04-20 10:55:59,589.589 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-20T10:55:59.590 INFO:teuthology.kill:2021-04-20 10:55:59,590.590 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-20T10:55:59.591 INFO:teuthology.kill:2021-04-20 10:55:59,591.591 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-20T10:55:59.592 INFO:teuthology.kill:2021-04-20 10:55:59,592.592 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-20T10:55:59.741 INFO:teuthology.kill:2021-04-20 10:55:59,741.741 INFO:teuthology.orchestra.console:Power off gibba022 2021-04-20T10:55:59.754 INFO:teuthology.kill:2021-04-20 10:55:59,754.754 INFO:teuthology.orchestra.console:Power off gibba021 2021-04-20T10:55:59.766 INFO:teuthology.kill:2021-04-20 10:55:59,765.765 INFO:teuthology.orchestra.console:Power off gibba010 2021-04-20T10:55:59.782 INFO:teuthology.kill:2021-04-20 10:55:59,782.782 INFO:teuthology.orchestra.console:Power off gibba009 2021-04-20T10:55:59.798 INFO:teuthology.kill:2021-04-20 10:55:59,798.798 INFO:teuthology.orchestra.console:Power off gibba045 2021-04-20T10:56:08.145 INFO:teuthology.kill:2021-04-20 10:56:08,144.144 INFO:teuthology.orchestra.console:Power off for gibba021 completed 2021-04-20T10:56:08.166 INFO:teuthology.kill:2021-04-20 10:56:08,166.166 INFO:teuthology.orchestra.console:Power off for gibba045 completed 2021-04-20T10:56:12.254 INFO:teuthology.kill:2021-04-20 10:56:12,253.253 INFO:teuthology.orchestra.console:Power off for gibba022 completed 2021-04-20T10:56:12.257 INFO:teuthology.kill:2021-04-20 10:56:12,257.257 INFO:teuthology.orchestra.console:Power off for gibba010 completed 2021-04-20T10:56:12.262 INFO:teuthology.kill:2021-04-20 10:56:12,262.262 INFO:teuthology.orchestra.console:Power off for gibba009 completed 2021-04-20T10:56:12.486 INFO:teuthology.task.internal:roles: ubuntu@gibba009.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-04-20T10:56:12.487 INFO:teuthology.task.internal:roles: ubuntu@gibba010.front.sepia.ceph.com - ['mon.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-04-20T10:56:12.487 INFO:teuthology.task.internal:roles: ubuntu@gibba021.front.sepia.ceph.com - ['mon.c'] 2021-04-20T10:56:12.488 INFO:teuthology.task.internal:roles: ubuntu@gibba022.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11'] 2021-04-20T10:56:12.488 INFO:teuthology.task.internal:roles: ubuntu@gibba045.front.sepia.ceph.com - ['client.0'] 2021-04-20T10:56:12.488 INFO:teuthology.misc:Compressing logs... 2021-04-20T10:56:12.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-20T10:57:12.539 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-04-20T10:57:12.642 INFO:teuthology.kill:No teuthology processes running 2021-04-20T10:57:30.497 INFO:teuthology.kill:Nuking machines: ['gibba009', 'gibba010', 'gibba021', 'gibba022', 'gibba045'] 2021-04-20T10:57:31.380 INFO:teuthology.kill:2021-04-20 10:57:31,379.379 INFO:teuthology.nuke:targets: 2021-04-20T10:57:31.380 INFO:teuthology.kill: gibba009.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzXMk7MYv//NI/KM4OMgsYngg+wLJ1roGgbPD2mWsPudj7edNpUwxpL1ILoKrI7By/OyVXjhgTSLRZRF1+uGmVcRPmKA7D2/BdXPTVz1qa7W7ddkEf7CedSwZKpiewVmqPsB42EpFFjC1YdFAkvKomjcfFOn5uS3+4kgxrgCxt+dduPORRUiI5ZVRn/KrKmLCxL1FnJEvAd0au/mVVv3ezfrP/JHgHgvmCnQtbwDmf7NrkXkNZnUTVg4AE6DXga800FNpvi8cNmKlPP+o8yHuPUWR3te5w8HEUb849c47ctLt+eLFyEYjUmlcAvx3weKUe/VTr294R0DfwzX+Ha31V 2021-04-20T10:57:31.381 INFO:teuthology.kill: gibba010.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCrQ6TqM9G7tKiioLXCdHNzjSAs9UAhWulbSB+5yEvfy6MO+1UdsdNYQu+cjMawA+UmChG4FS1UlYs4IhSo6eJIXZs2ZEhFX/LU2CSgLK7X6G/gCXdcKI78QVsWGdNFzKNeVZDixvw5c/kYh4fPGF63lLvuXnQYPWsCDf6awsAfb/fPvl+aNciskmWtN0IZp1sADOsukyofrblWkdcjPIM0XNV7C4rPSuUsADoJQEKcL9OeblCtt5n0S5r14QsZhIjRfm4bP/S4Y/Up30/3HwwVeJS0QrZ2uycRL1LOGje4NWSlaun2/+dpnc05Tvvp7NaYo3cHO075gtaFlgg9NfoH 2021-04-20T10:57:31.381 INFO:teuthology.kill: gibba021.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpnhuow+Lsob+Jc1EP/fbrKHzwdBuTjWYYIDr1sGGB0xHxw5BtJ7cSMCPx9ed7hjI+vRQDi58eVeLPoMLH2IVJSA5PaOyFwpIau3mKybiwjbVd3a3mIOKxQLoYmTwyJ7qknLeUoRa+NNunoilGnpdGb/ied3hvT2cZ4i59G4kruvXfzNHrKJnkGRPns3V1TN4S22wBDQaSvnz7nj0eOwhFmzlnkafLlzsZzkmmhFOxFjQKIkgUYDCiYt9MLFH0+Ph5T3w/UKqdoZmhCoBBXTeFIXxVOVNuFTibSBmeIyFFONKlEOEuwNjhIreEJtiN4iVyPnO69SNl/F02wCDWdBAF 2021-04-20T10:57:31.381 INFO:teuthology.kill: gibba022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCsaPSnSNsmpI3IoO3zrX/TWNv5dunilVbur0TkX89ae/Mbys4AZfGEEXmL1seIHwLvdTB88w4zkzlq0CyEC+YaoyYI2G2fKww/CPinMI/z7nYJ2/4YW0daxuh4yLi5SnaXuKvKtkjsJ0Cg+t0YzzNfRMOUdt+WN6CZz3HaZhz0CO+Zwbv70rWcqI10mNAw0g53NbE5bsgBaCp/cLdG0l24eUULX7NjkPdtGeYLtmd+cj5SP3L/Eaicg7EaNV2Y11U+yji3lqDqYrRJHdPPQhrU+y5QPbZ2tTpKV+6MM0gH2kUv69C2opDmwF/0pxKjCTFwjau3pMnZ1Y9douunt0F 2021-04-20T10:57:31.381 INFO:teuthology.kill: gibba045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9AZbuc5pUkn1up01WaA3/+BoWDw4WeHdDoAV/7a6zgsCXzR3gkyp0ig3yAD0IAFL3EDFdW/CRGMxNDkMtHWxSiwq6tzvN/PP5yesBnZ8jCxSKeRcBINOlUDzeXxHeQjrNSc0w4tR6aVPDTDWXtOAVCRc5a8XoXZoP9YM5bcsVVokaZO8Db0PT0Qday3LCJo6iKOqPw1TE7UQvirUJSchCHU+VozsbejpzoFNTs/z18GxZo8vqmFRnGFELIgAOZjeeXlsIP65+DcNwC7PhCRwvN2IIDQqBzy0G7CEptYVKOYBnypTO/19mCi71EYI0YH09nZYaJt3WNujwJfLCjlo7 2021-04-20T10:57:31.404 INFO:teuthology.kill:2021-04-20 10:57:31,404.404 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-20T10:57:31.416 INFO:teuthology.kill:2021-04-20 10:57:31,416.416 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-20T10:57:31.429 INFO:teuthology.kill:2021-04-20 10:57:31,429.429 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-20T10:57:31.441 INFO:teuthology.kill:2021-04-20 10:57:31,441.441 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-20T10:57:31.454 INFO:teuthology.kill:2021-04-20 10:57:31,454.454 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-20T10:57:31.591 INFO:teuthology.kill:2021-04-20 10:57:31,591.591 INFO:teuthology.orchestra.console:Power off gibba022 2021-04-20T10:57:31.604 INFO:teuthology.kill:2021-04-20 10:57:31,603.603 INFO:teuthology.orchestra.console:Power off gibba021 2021-04-20T10:57:31.615 INFO:teuthology.kill:2021-04-20 10:57:31,615.615 INFO:teuthology.orchestra.console:Power off gibba010 2021-04-20T10:57:31.632 INFO:teuthology.kill:2021-04-20 10:57:31,632.632 INFO:teuthology.orchestra.console:Power off gibba009 2021-04-20T10:57:31.649 INFO:teuthology.kill:2021-04-20 10:57:31,648.648 INFO:teuthology.orchestra.console:Power off gibba045 2021-04-20T10:57:31.765 INFO:teuthology.kill:2021-04-20 10:57:31,764.764 INFO:teuthology.orchestra.console:Power off for gibba022 completed 2021-04-20T10:57:31.765 INFO:teuthology.kill:2021-04-20 10:57:31,765.765 INFO:teuthology.orchestra.console:Power off for gibba021 completed 2021-04-20T10:57:31.776 INFO:teuthology.kill:2021-04-20 10:57:31,776.776 INFO:teuthology.orchestra.console:Power off for gibba010 completed 2021-04-20T10:57:31.780 INFO:teuthology.kill:2021-04-20 10:57:31,780.780 INFO:teuthology.orchestra.console:Power off for gibba009 completed 2021-04-20T10:57:31.793 INFO:teuthology.kill:2021-04-20 10:57:31,793.793 INFO:teuthology.orchestra.console:Power off for gibba045 completed 2021-04-20T10:57:31.940 INFO:teuthology.kill:2021-04-20 10:57:31,939.939 INFO:teuthology.lock.ops:unlocked gibba022.front.sepia.ceph.com 2021-04-20T10:57:31.969 INFO:teuthology.kill:2021-04-20 10:57:31,968.968 INFO:teuthology.lock.ops:unlocked gibba021.front.sepia.ceph.com 2021-04-20T10:57:31.987 INFO:teuthology.kill:2021-04-20 10:57:31,986.986 INFO:teuthology.lock.ops:unlocked gibba010.front.sepia.ceph.com 2021-04-20T10:57:32.004 INFO:teuthology.kill:2021-04-20 10:57:32,004.004 INFO:teuthology.lock.ops:unlocked gibba009.front.sepia.ceph.com 2021-04-20T10:57:32.021 INFO:teuthology.kill:2021-04-20 10:57:32,021.021 INFO:teuthology.lock.ops:unlocked gibba045.front.sepia.ceph.com 2021-04-20T11:00:48.992 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-04-20T11:00:50.755 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-04-20T11:00:50.755 INFO:teuthology.nuke:Checking targets against current locks 2021-04-20T11:00:50.926 INFO:teuthology.nuke:Not nuking gibba009.front.sepia.ceph.com because description doesn't match 2021-04-20T11:00:50.926 INFO:teuthology.nuke:Not nuking gibba045.front.sepia.ceph.com because description doesn't match 2021-04-20T11:00:50.926 INFO:teuthology.nuke:Not nuking gibba010.front.sepia.ceph.com because description doesn't match 2021-04-20T11:00:50.927 INFO:teuthology.nuke:Not nuking gibba021.front.sepia.ceph.com because description doesn't match 2021-04-20T11:00:50.927 INFO:teuthology.nuke:Not nuking gibba022.front.sepia.ceph.com because description doesn't match