2021-04-19T22:50:55.762 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-19T22:50:55.979 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba009.front.sepia.ceph.com' reimaging 2021-04-19T22:50:55.981 INFO:teuthology.lock.ops:Updating [ubuntu@gibba009.front.sepia.ceph.com]: reset os type and version on server 2021-04-19T22:50:55.981 INFO:teuthology.lock.ops:Updating gibba009.front.sepia.ceph.com on lock server 2021-04-19T22:50:55.999 INFO:teuthology.lock.ops:Node 'ubuntu@gibba009.front.sepia.ceph.com' reimaging is complete 2021-04-19T22:50:55.999 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba010.front.sepia.ceph.com' reimaging 2021-04-19T22:50:56.000 INFO:teuthology.lock.ops:Updating [ubuntu@gibba010.front.sepia.ceph.com]: reset os type and version on server 2021-04-19T22:50:56.001 INFO:teuthology.lock.ops:Updating gibba010.front.sepia.ceph.com on lock server 2021-04-19T22:50:56.018 INFO:teuthology.lock.ops:Node 'ubuntu@gibba010.front.sepia.ceph.com' reimaging is complete 2021-04-19T22:50:56.019 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba021.front.sepia.ceph.com' reimaging 2021-04-19T22:50:56.020 INFO:teuthology.lock.ops:Updating [ubuntu@gibba021.front.sepia.ceph.com]: reset os type and version on server 2021-04-19T22:50:56.020 INFO:teuthology.lock.ops:Updating gibba021.front.sepia.ceph.com on lock server 2021-04-19T22:50:56.035 INFO:teuthology.lock.ops:Node 'ubuntu@gibba021.front.sepia.ceph.com' reimaging is complete 2021-04-19T22:50:56.036 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba022.front.sepia.ceph.com' reimaging 2021-04-19T22:50:56.036 INFO:teuthology.lock.ops:Updating [ubuntu@gibba022.front.sepia.ceph.com]: reset os type and version on server 2021-04-19T22:50:56.037 INFO:teuthology.lock.ops:Updating gibba022.front.sepia.ceph.com on lock server 2021-04-19T22:50:56.052 INFO:teuthology.lock.ops:Node 'ubuntu@gibba022.front.sepia.ceph.com' reimaging is complete 2021-04-19T22:50:56.053 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba045.front.sepia.ceph.com' reimaging 2021-04-19T22:50:56.053 INFO:teuthology.lock.ops:Updating [ubuntu@gibba045.front.sepia.ceph.com]: reset os type and version on server 2021-04-19T22:50:56.053 INFO:teuthology.lock.ops:Updating gibba045.front.sepia.ceph.com on lock server 2021-04-19T22:50:56.068 INFO:teuthology.lock.ops:Node 'ubuntu@gibba045.front.sepia.ceph.com' reimaging is complete 2021-04-19T22:50:56.211 INFO:teuthology.provision.fog.gibba009:Scheduling deploy of ubuntu 16.04 2021-04-19T22:50:56.268 INFO:teuthology.provision.fog.gibba022:Scheduling deploy of ubuntu 16.04 2021-04-19T22:50:56.298 INFO:teuthology.provision.fog.gibba045:Scheduling deploy of ubuntu 16.04 2021-04-19T22:50:56.299 INFO:teuthology.provision.fog.gibba010:Scheduling deploy of ubuntu 16.04 2021-04-19T22:50:56.305 INFO:teuthology.provision.fog.gibba021:Scheduling deploy of ubuntu 16.04 2021-04-19T22:50:56.581 INFO:teuthology.orchestra.console:Power off gibba009 2021-04-19T22:50:56.629 INFO:teuthology.orchestra.console:Power off gibba022 2021-04-19T22:50:56.684 INFO:teuthology.orchestra.console:Power off gibba010 2021-04-19T22:50:56.736 INFO:teuthology.orchestra.console:Power off gibba021 2021-04-19T22:50:56.766 INFO:teuthology.orchestra.console:Power off gibba045 2021-04-19T22:51:05.000 INFO:teuthology.orchestra.console:Power off for gibba009 completed 2021-04-19T22:51:05.087 INFO:teuthology.orchestra.console:Power off for gibba010 completed 2021-04-19T22:51:05.104 INFO:teuthology.orchestra.console:Power on gibba009 2021-04-19T22:51:05.139 INFO:teuthology.orchestra.console:Power off for gibba021 completed 2021-04-19T22:51:05.175 INFO:teuthology.orchestra.console:Power off for gibba045 completed 2021-04-19T22:51:05.189 INFO:teuthology.orchestra.console:Power on gibba010 2021-04-19T22:51:05.241 INFO:teuthology.orchestra.console:Power on gibba021 2021-04-19T22:51:05.299 INFO:teuthology.orchestra.console:Power on gibba045 2021-04-19T22:51:09.174 INFO:teuthology.orchestra.console:Power off for gibba022 completed 2021-04-19T22:51:09.276 INFO:teuthology.orchestra.console:Power on gibba022 2021-04-19T22:51:13.568 INFO:teuthology.orchestra.console:Power on for gibba009 completed 2021-04-19T22:51:13.670 INFO:teuthology.provision.fog.gibba009:Waiting for deploy to finish 2021-04-19T22:51:13.673 INFO:teuthology.orchestra.console:Power on for gibba010 completed 2021-04-19T22:51:13.704 INFO:teuthology.orchestra.console:Power on for gibba021 completed 2021-04-19T22:51:13.756 INFO:teuthology.orchestra.console:Power on for gibba045 completed 2021-04-19T22:51:13.775 INFO:teuthology.provision.fog.gibba010:Waiting for deploy to finish 2021-04-19T22:51:13.806 INFO:teuthology.provision.fog.gibba021:Waiting for deploy to finish 2021-04-19T22:51:13.857 INFO:teuthology.provision.fog.gibba045:Waiting for deploy to finish 2021-04-19T22:51:17.776 INFO:teuthology.orchestra.console:Power on for gibba022 completed 2021-04-19T22:51:17.877 INFO:teuthology.provision.fog.gibba022:Waiting for deploy to finish 2021-04-19T22:55:13.508 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-04-19T22:55:25.532 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-04-19T22:55:31.648 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-19T22:55:32.038 INFO:teuthology.provision.fog.gibba009:Node is ready 2021-04-19T22:55:32.077 INFO:teuthology.orchestra.run.gibba009.stdout:gibba009.front.sepia.ceph.com 2021-04-19T22:55:32.118 INFO:teuthology.orchestra.run.gibba009.stdout:172.21.2.109 gibba009.front.sepia.ceph.com gibba009 2021-04-19T22:55:32.367 INFO:teuthology.provision.fog.gibba009:Deploy complete! 2021-04-19T22:55:39.215 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-19T22:55:39.245 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-19T22:55:39.398 INFO:teuthology.provision.fog.gibba010:Node is ready 2021-04-19T22:55:39.434 INFO:teuthology.provision.fog.gibba045:Node is ready 2021-04-19T22:55:39.439 INFO:teuthology.orchestra.run.gibba010.stdout:gibba010.front.sepia.ceph.com 2021-04-19T22:55:39.477 INFO:teuthology.orchestra.run.gibba045.stdout:gibba045.front.sepia.ceph.com 2021-04-19T22:55:39.482 INFO:teuthology.orchestra.run.gibba010.stdout:172.21.2.110 gibba010.front.sepia.ceph.com gibba010 2021-04-19T22:55:39.516 INFO:teuthology.orchestra.run.gibba045.stdout:172.21.2.145 gibba045.front.sepia.ceph.com gibba045 2021-04-19T22:55:39.722 INFO:teuthology.provision.fog.gibba010:Deploy complete! 2021-04-19T22:55:39.754 INFO:teuthology.provision.fog.gibba045:Deploy complete! 2021-04-19T22:55:43.202 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-19T22:55:43.398 INFO:teuthology.provision.fog.gibba022:Node is ready 2021-04-19T22:55:43.437 INFO:teuthology.orchestra.run.gibba022.stdout:gibba022.front.sepia.ceph.com 2021-04-19T22:55:43.478 INFO:teuthology.orchestra.run.gibba022.stdout:172.21.2.122 gibba022.front.sepia.ceph.com gibba022 2021-04-19T22:55:43.719 INFO:teuthology.provision.fog.gibba022:Deploy complete! 2021-04-19T22:55:48.298 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-19T22:55:48.479 INFO:teuthology.provision.fog.gibba021:Node is ready 2021-04-19T22:55:48.520 INFO:teuthology.orchestra.run.gibba021.stdout:gibba021.front.sepia.ceph.com 2021-04-19T22:55:48.559 INFO:teuthology.orchestra.run.gibba021.stdout:172.21.2.121 gibba021.front.sepia.ceph.com gibba021 2021-04-19T22:55:48.800 INFO:teuthology.provision.fog.gibba021:Deploy complete! 2021-04-19T22:55:51.286 INFO:teuthology.lock.ops:Checking gibba009.front.sepia.ceph.com 2021-04-19T22:55:51.287 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-19T22:55:51.304 INFO:teuthology.lock.ops:Checking gibba010.front.sepia.ceph.com 2021-04-19T22:55:51.305 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-19T22:55:51.317 INFO:teuthology.lock.ops:Checking gibba021.front.sepia.ceph.com 2021-04-19T22:55:51.318 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-19T22:55:51.340 INFO:teuthology.lock.ops:Checking gibba022.front.sepia.ceph.com 2021-04-19T22:55:51.341 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-19T22:55:51.358 INFO:teuthology.lock.ops:Checking gibba045.front.sepia.ceph.com 2021-04-19T22:55:51.358 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-19T22:55:51.377 INFO:teuthology.lock.ops:Updating [gibba009.front.sepia.ceph.com]: set os type and version on server 2021-04-19T22:55:51.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-19T22:55:51.662 INFO:teuthology.orchestra.run.gibba009.stdout:x86_64 2021-04-19T22:55:51.702 INFO:teuthology.orchestra.run.gibba009.stdout:NAME="Ubuntu" 2021-04-19T22:55:51.703 INFO:teuthology.orchestra.run.gibba009.stdout:VERSION="16.04.7 LTS (Xenial Xerus)" 2021-04-19T22:55:51.703 INFO:teuthology.orchestra.run.gibba009.stdout:ID=ubuntu 2021-04-19T22:55:51.703 INFO:teuthology.orchestra.run.gibba009.stdout:ID_LIKE=debian 2021-04-19T22:55:51.704 INFO:teuthology.orchestra.run.gibba009.stdout:PRETTY_NAME="Ubuntu 16.04.7 LTS" 2021-04-19T22:55:51.704 INFO:teuthology.orchestra.run.gibba009.stdout:VERSION_ID="16.04" 2021-04-19T22:55:51.704 INFO:teuthology.orchestra.run.gibba009.stdout:HOME_URL="http://www.ubuntu.com/" 2021-04-19T22:55:51.704 INFO:teuthology.orchestra.run.gibba009.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-04-19T22:55:51.704 INFO:teuthology.orchestra.run.gibba009.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-04-19T22:55:51.705 INFO:teuthology.orchestra.run.gibba009.stdout:VERSION_CODENAME=xenial 2021-04-19T22:55:51.705 INFO:teuthology.orchestra.run.gibba009.stdout:UBUNTU_CODENAME=xenial 2021-04-19T22:55:51.706 INFO:teuthology.lock.ops:Updating gibba009.front.sepia.ceph.com on lock server 2021-04-19T22:55:51.721 INFO:teuthology.lock.ops:Updating [gibba010.front.sepia.ceph.com]: set os type and version on server 2021-04-19T22:55:51.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-19T22:55:52.010 INFO:teuthology.orchestra.run.gibba010.stdout:x86_64 2021-04-19T22:55:52.049 INFO:teuthology.orchestra.run.gibba010.stdout:NAME="Ubuntu" 2021-04-19T22:55:52.050 INFO:teuthology.orchestra.run.gibba010.stdout:VERSION="16.04.7 LTS (Xenial Xerus)" 2021-04-19T22:55:52.050 INFO:teuthology.orchestra.run.gibba010.stdout:ID=ubuntu 2021-04-19T22:55:52.050 INFO:teuthology.orchestra.run.gibba010.stdout:ID_LIKE=debian 2021-04-19T22:55:52.050 INFO:teuthology.orchestra.run.gibba010.stdout:PRETTY_NAME="Ubuntu 16.04.7 LTS" 2021-04-19T22:55:52.051 INFO:teuthology.orchestra.run.gibba010.stdout:VERSION_ID="16.04" 2021-04-19T22:55:52.051 INFO:teuthology.orchestra.run.gibba010.stdout:HOME_URL="http://www.ubuntu.com/" 2021-04-19T22:55:52.051 INFO:teuthology.orchestra.run.gibba010.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-04-19T22:55:52.051 INFO:teuthology.orchestra.run.gibba010.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-04-19T22:55:52.052 INFO:teuthology.orchestra.run.gibba010.stdout:VERSION_CODENAME=xenial 2021-04-19T22:55:52.052 INFO:teuthology.orchestra.run.gibba010.stdout:UBUNTU_CODENAME=xenial 2021-04-19T22:55:52.052 INFO:teuthology.lock.ops:Updating gibba010.front.sepia.ceph.com on lock server 2021-04-19T22:55:52.087 INFO:teuthology.lock.ops:Updating [gibba021.front.sepia.ceph.com]: set os type and version on server 2021-04-19T22:55:52.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-19T22:55:52.375 INFO:teuthology.orchestra.run.gibba021.stdout:x86_64 2021-04-19T22:55:52.416 INFO:teuthology.orchestra.run.gibba021.stdout:NAME="Ubuntu" 2021-04-19T22:55:52.416 INFO:teuthology.orchestra.run.gibba021.stdout:VERSION="16.04.7 LTS (Xenial Xerus)" 2021-04-19T22:55:52.416 INFO:teuthology.orchestra.run.gibba021.stdout:ID=ubuntu 2021-04-19T22:55:52.416 INFO:teuthology.orchestra.run.gibba021.stdout:ID_LIKE=debian 2021-04-19T22:55:52.417 INFO:teuthology.orchestra.run.gibba021.stdout:PRETTY_NAME="Ubuntu 16.04.7 LTS" 2021-04-19T22:55:52.417 INFO:teuthology.orchestra.run.gibba021.stdout:VERSION_ID="16.04" 2021-04-19T22:55:52.417 INFO:teuthology.orchestra.run.gibba021.stdout:HOME_URL="http://www.ubuntu.com/" 2021-04-19T22:55:52.417 INFO:teuthology.orchestra.run.gibba021.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-04-19T22:55:52.418 INFO:teuthology.orchestra.run.gibba021.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-04-19T22:55:52.418 INFO:teuthology.orchestra.run.gibba021.stdout:VERSION_CODENAME=xenial 2021-04-19T22:55:52.418 INFO:teuthology.orchestra.run.gibba021.stdout:UBUNTU_CODENAME=xenial 2021-04-19T22:55:52.418 INFO:teuthology.lock.ops:Updating gibba021.front.sepia.ceph.com on lock server 2021-04-19T22:55:52.435 INFO:teuthology.lock.ops:Updating [gibba022.front.sepia.ceph.com]: set os type and version on server 2021-04-19T22:55:52.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-19T22:55:52.726 INFO:teuthology.orchestra.run.gibba022.stdout:x86_64 2021-04-19T22:55:52.766 INFO:teuthology.orchestra.run.gibba022.stdout:NAME="Ubuntu" 2021-04-19T22:55:52.767 INFO:teuthology.orchestra.run.gibba022.stdout:VERSION="16.04.7 LTS (Xenial Xerus)" 2021-04-19T22:55:52.767 INFO:teuthology.orchestra.run.gibba022.stdout:ID=ubuntu 2021-04-19T22:55:52.767 INFO:teuthology.orchestra.run.gibba022.stdout:ID_LIKE=debian 2021-04-19T22:55:52.767 INFO:teuthology.orchestra.run.gibba022.stdout:PRETTY_NAME="Ubuntu 16.04.7 LTS" 2021-04-19T22:55:52.768 INFO:teuthology.orchestra.run.gibba022.stdout:VERSION_ID="16.04" 2021-04-19T22:55:52.768 INFO:teuthology.orchestra.run.gibba022.stdout:HOME_URL="http://www.ubuntu.com/" 2021-04-19T22:55:52.768 INFO:teuthology.orchestra.run.gibba022.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-04-19T22:55:52.769 INFO:teuthology.orchestra.run.gibba022.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-04-19T22:55:52.769 INFO:teuthology.orchestra.run.gibba022.stdout:VERSION_CODENAME=xenial 2021-04-19T22:55:52.769 INFO:teuthology.orchestra.run.gibba022.stdout:UBUNTU_CODENAME=xenial 2021-04-19T22:55:52.770 INFO:teuthology.lock.ops:Updating gibba022.front.sepia.ceph.com on lock server 2021-04-19T22:55:52.790 INFO:teuthology.lock.ops:Updating [gibba045.front.sepia.ceph.com]: set os type and version on server 2021-04-19T22:55:52.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-19T22:55:53.072 INFO:teuthology.orchestra.run.gibba045.stdout:x86_64 2021-04-19T22:55:53.113 INFO:teuthology.orchestra.run.gibba045.stdout:NAME="Ubuntu" 2021-04-19T22:55:53.113 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION="16.04.7 LTS (Xenial Xerus)" 2021-04-19T22:55:53.113 INFO:teuthology.orchestra.run.gibba045.stdout:ID=ubuntu 2021-04-19T22:55:53.114 INFO:teuthology.orchestra.run.gibba045.stdout:ID_LIKE=debian 2021-04-19T22:55:53.114 INFO:teuthology.orchestra.run.gibba045.stdout:PRETTY_NAME="Ubuntu 16.04.7 LTS" 2021-04-19T22:55:53.114 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION_ID="16.04" 2021-04-19T22:55:53.114 INFO:teuthology.orchestra.run.gibba045.stdout:HOME_URL="http://www.ubuntu.com/" 2021-04-19T22:55:53.115 INFO:teuthology.orchestra.run.gibba045.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-04-19T22:55:53.115 INFO:teuthology.orchestra.run.gibba045.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-04-19T22:55:53.115 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION_CODENAME=xenial 2021-04-19T22:55:53.116 INFO:teuthology.orchestra.run.gibba045.stdout:UBUNTU_CODENAME=xenial 2021-04-19T22:55:53.117 INFO:teuthology.lock.ops:Updating gibba045.front.sepia.ceph.com on lock server 2021-04-19T22:55:53.218 INFO:teuthology.dispatcher.supervisor:Running job 6047839 2021-04-19T22:55:53.219 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-04-15_02:30:03-upgrade:mimic-x-nautilus-distro-basic-gibba/6047839 --name teuthology-2021-04-15_02:30:03-upgrade:mimic-x-nautilus-distro-basic-gibba --description upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-nautilus 6.1-msgr2 7-final-workload/{rbd-python rgw-swift-ragweed_check snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_16.04 thrashosds-health} -- /home/teuthworker/archive/teuthology-2021-04-15_02:30:03-upgrade:mimic-x-nautilus-distro-basic-gibba/6047839/orig.config.yaml 2021-04-19T22:55:53.223 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-04-15_02:30:03-upgrade:mimic-x-nautilus-distro-basic-gibba/6047839 2021-04-19T22:55:53.225 INFO:teuthology.dispatcher.supervisor:Job PID: 15964 2021-04-19T22:55:53.229 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-04-20T01:57:13.854 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-04-15_02:30:03-upgrade:mimic-x-nautilus-distro-basic-gibba/jobs/ failed with status 504: