2021-02-09T09:56:54.009 INFO:root:teuthology version: 1.1.0-17c09965 2021-02-09T09:56:54.175 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging 2021-02-09T09:56:54.175 INFO:teuthology.lock.ops:Updating [ubuntu@smithi036.front.sepia.ceph.com]: reset os type and version on server 2021-02-09T09:56:54.175 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2021-02-09T09:56:54.191 INFO:teuthology.lock.ops:Node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging is complete 2021-02-09T09:56:54.191 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging 2021-02-09T09:56:54.191 INFO:teuthology.lock.ops:Updating [ubuntu@smithi060.front.sepia.ceph.com]: reset os type and version on server 2021-02-09T09:56:54.191 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2021-02-09T09:56:54.205 INFO:teuthology.lock.ops:Node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging is complete 2021-02-09T09:56:54.205 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi064.front.sepia.ceph.com' reimaging 2021-02-09T09:56:54.205 INFO:teuthology.lock.ops:Updating [ubuntu@smithi064.front.sepia.ceph.com]: reset os type and version on server 2021-02-09T09:56:54.205 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2021-02-09T09:56:54.217 INFO:teuthology.lock.ops:Node 'ubuntu@smithi064.front.sepia.ceph.com' reimaging is complete 2021-02-09T09:56:54.217 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi065.front.sepia.ceph.com' reimaging 2021-02-09T09:56:54.218 INFO:teuthology.lock.ops:Updating [ubuntu@smithi065.front.sepia.ceph.com]: reset os type and version on server 2021-02-09T09:56:54.218 INFO:teuthology.lock.ops:Updating smithi065.front.sepia.ceph.com on lock server 2021-02-09T09:56:54.230 INFO:teuthology.lock.ops:Node 'ubuntu@smithi065.front.sepia.ceph.com' reimaging is complete 2021-02-09T09:56:54.230 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi066.front.sepia.ceph.com' reimaging 2021-02-09T09:56:54.231 INFO:teuthology.lock.ops:Updating [ubuntu@smithi066.front.sepia.ceph.com]: reset os type and version on server 2021-02-09T09:56:54.231 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2021-02-09T09:56:54.243 INFO:teuthology.lock.ops:Node 'ubuntu@smithi066.front.sepia.ceph.com' reimaging is complete 2021-02-09T09:56:54.394 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of ubuntu 16.04 2021-02-09T09:56:54.417 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of ubuntu 16.04 2021-02-09T09:56:54.438 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of ubuntu 16.04 2021-02-09T09:56:54.483 INFO:teuthology.provision.fog.smithi065:Scheduling deploy of ubuntu 16.04 2021-02-09T09:56:54.514 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of ubuntu 16.04 2021-02-09T09:56:54.732 INFO:teuthology.orchestra.console:Power off smithi036 2021-02-09T09:56:54.786 INFO:teuthology.orchestra.console:Power off smithi060 2021-02-09T09:56:54.799 INFO:teuthology.orchestra.console:Power off smithi066 2021-02-09T09:56:54.832 INFO:teuthology.orchestra.console:Power off smithi065 2021-02-09T09:56:54.875 INFO:teuthology.orchestra.console:Power off smithi064 2021-02-09T09:57:03.158 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2021-02-09T09:57:03.167 INFO:teuthology.orchestra.console:Power off for smithi066 completed 2021-02-09T09:57:03.201 INFO:teuthology.orchestra.console:Power off for smithi065 completed 2021-02-09T09:57:03.260 INFO:teuthology.orchestra.console:Power on smithi060 2021-02-09T09:57:03.269 INFO:teuthology.orchestra.console:Power on smithi066 2021-02-09T09:57:03.302 INFO:teuthology.orchestra.console:Power on smithi065 2021-02-09T09:57:07.224 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2021-02-09T09:57:07.325 INFO:teuthology.orchestra.console:Power on smithi036 2021-02-09T09:57:07.345 INFO:teuthology.orchestra.console:Power off for smithi064 completed 2021-02-09T09:57:07.446 INFO:teuthology.orchestra.console:Power on smithi064 2021-02-09T09:57:07.508 INFO:teuthology.orchestra.console:Power on for smithi060 completed 2021-02-09T09:57:07.609 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2021-02-09T09:57:11.689 INFO:teuthology.orchestra.console:Power on for smithi065 completed 2021-02-09T09:57:11.694 INFO:teuthology.orchestra.console:Power on for smithi066 completed 2021-02-09T09:57:11.791 INFO:teuthology.provision.fog.smithi065:Waiting for deploy to finish 2021-02-09T09:57:11.795 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2021-02-09T09:57:15.690 INFO:teuthology.orchestra.console:Power on for smithi036 completed 2021-02-09T09:57:15.792 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish 2021-02-09T09:57:15.799 INFO:teuthology.orchestra.console:Power on for smithi064 completed 2021-02-09T09:57:15.900 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2021-02-09T09:59:42.835 ERROR:teuthology.orchestra.connection:Error authenticating with smithi065.front.sepia.ceph.com: Authentication failed. 2021-02-09T10:01:14.963 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-09T10:01:15.332 INFO:teuthology.provision.fog.smithi060:Node is ready 2021-02-09T10:01:15.374 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com 2021-02-09T10:01:15.414 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060 2021-02-09T10:01:15.657 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2021-02-09T10:01:17.782 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-02-09T10:01:23.155 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-09T10:01:23.461 INFO:teuthology.provision.fog.smithi036:Node is ready 2021-02-09T10:01:24.074 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com 2021-02-09T10:01:24.075 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-02-09T10:01:24.116 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2021-02-09T10:01:24.358 INFO:teuthology.provision.fog.smithi036:Deploy complete! 2021-02-09T10:01:37.094 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-02-09T10:01:43.258 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-09T10:01:43.557 INFO:teuthology.provision.fog.smithi066:Node is ready 2021-02-09T10:01:43.599 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2021-02-09T10:01:43.640 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2021-02-09T10:01:43.862 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2021-02-09T10:01:47.404 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-09T10:01:47.754 INFO:teuthology.provision.fog.smithi064:Node is ready 2021-02-09T10:01:47.795 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2021-02-09T10:01:47.835 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2021-02-09T10:01:48.086 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2021-02-09T10:01:56.035 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-09T10:01:56.384 INFO:teuthology.provision.fog.smithi065:Node is ready 2021-02-09T10:01:56.425 INFO:teuthology.orchestra.run.smithi065.stdout:smithi065.front.sepia.ceph.com 2021-02-09T10:01:56.468 INFO:teuthology.orchestra.run.smithi065.stdout:172.21.15.65 smithi065.front.sepia.ceph.com smithi065 2021-02-09T10:01:56.717 INFO:teuthology.provision.fog.smithi065:Deploy complete! 2021-02-09T10:01:57.199 INFO:teuthology.lock.ops:Checking smithi036.front.sepia.ceph.com 2021-02-09T10:01:57.199 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-09T10:01:57.222 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2021-02-09T10:01:57.223 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-09T10:01:57.244 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2021-02-09T10:01:57.244 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-09T10:01:57.312 INFO:teuthology.lock.ops:Checking smithi065.front.sepia.ceph.com 2021-02-09T10:01:57.312 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-09T10:01:57.335 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2021-02-09T10:01:57.335 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-09T10:01:57.355 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: set os type and version on server 2021-02-09T10:01:57.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T10:01:57.831 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2021-02-09T10:01:57.878 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="Ubuntu" 2021-02-09T10:01:57.879 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="16.04.6 LTS (Xenial Xerus)" 2021-02-09T10:01:57.879 INFO:teuthology.orchestra.run.smithi036.stdout:ID=ubuntu 2021-02-09T10:01:57.879 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE=debian 2021-02-09T10:01:57.879 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="Ubuntu 16.04.6 LTS" 2021-02-09T10:01:57.879 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="16.04" 2021-02-09T10:01:57.879 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="http://www.ubuntu.com/" 2021-02-09T10:01:57.879 INFO:teuthology.orchestra.run.smithi036.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-02-09T10:01:57.879 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-02-09T10:01:57.879 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_CODENAME=xenial 2021-02-09T10:01:57.879 INFO:teuthology.orchestra.run.smithi036.stdout:UBUNTU_CODENAME=xenial 2021-02-09T10:01:57.880 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2021-02-09T10:01:57.904 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2021-02-09T10:01:57.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T10:01:58.380 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2021-02-09T10:01:58.426 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Ubuntu" 2021-02-09T10:01:58.426 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="16.04.6 LTS (Xenial Xerus)" 2021-02-09T10:01:58.426 INFO:teuthology.orchestra.run.smithi060.stdout:ID=ubuntu 2021-02-09T10:01:58.427 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE=debian 2021-02-09T10:01:58.427 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Ubuntu 16.04.6 LTS" 2021-02-09T10:01:58.427 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="16.04" 2021-02-09T10:01:58.427 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="http://www.ubuntu.com/" 2021-02-09T10:01:58.427 INFO:teuthology.orchestra.run.smithi060.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-02-09T10:01:58.427 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-02-09T10:01:58.427 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_CODENAME=xenial 2021-02-09T10:01:58.427 INFO:teuthology.orchestra.run.smithi060.stdout:UBUNTU_CODENAME=xenial 2021-02-09T10:01:58.427 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2021-02-09T10:01:58.444 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2021-02-09T10:01:58.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T10:01:58.775 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2021-02-09T10:01:58.815 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Ubuntu" 2021-02-09T10:01:58.816 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="16.04.6 LTS (Xenial Xerus)" 2021-02-09T10:01:58.816 INFO:teuthology.orchestra.run.smithi064.stdout:ID=ubuntu 2021-02-09T10:01:58.816 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE=debian 2021-02-09T10:01:58.816 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Ubuntu 16.04.6 LTS" 2021-02-09T10:01:58.816 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="16.04" 2021-02-09T10:01:58.816 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="http://www.ubuntu.com/" 2021-02-09T10:01:58.816 INFO:teuthology.orchestra.run.smithi064.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-02-09T10:01:58.816 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-02-09T10:01:58.816 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_CODENAME=xenial 2021-02-09T10:01:58.816 INFO:teuthology.orchestra.run.smithi064.stdout:UBUNTU_CODENAME=xenial 2021-02-09T10:01:58.817 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2021-02-09T10:01:58.832 INFO:teuthology.lock.ops:Updating [smithi065.front.sepia.ceph.com]: set os type and version on server 2021-02-09T10:01:58.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T10:01:59.156 INFO:teuthology.orchestra.run.smithi065.stdout:x86_64 2021-02-09T10:01:59.196 INFO:teuthology.orchestra.run.smithi065.stdout:NAME="Ubuntu" 2021-02-09T10:01:59.196 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION="16.04.6 LTS (Xenial Xerus)" 2021-02-09T10:01:59.196 INFO:teuthology.orchestra.run.smithi065.stdout:ID=ubuntu 2021-02-09T10:01:59.196 INFO:teuthology.orchestra.run.smithi065.stdout:ID_LIKE=debian 2021-02-09T10:01:59.196 INFO:teuthology.orchestra.run.smithi065.stdout:PRETTY_NAME="Ubuntu 16.04.6 LTS" 2021-02-09T10:01:59.196 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION_ID="16.04" 2021-02-09T10:01:59.196 INFO:teuthology.orchestra.run.smithi065.stdout:HOME_URL="http://www.ubuntu.com/" 2021-02-09T10:01:59.196 INFO:teuthology.orchestra.run.smithi065.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-02-09T10:01:59.196 INFO:teuthology.orchestra.run.smithi065.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-02-09T10:01:59.196 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION_CODENAME=xenial 2021-02-09T10:01:59.197 INFO:teuthology.orchestra.run.smithi065.stdout:UBUNTU_CODENAME=xenial 2021-02-09T10:01:59.197 INFO:teuthology.lock.ops:Updating smithi065.front.sepia.ceph.com on lock server 2021-02-09T10:01:59.216 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2021-02-09T10:01:59.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T10:01:59.530 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2021-02-09T10:01:59.571 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Ubuntu" 2021-02-09T10:01:59.571 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="16.04.6 LTS (Xenial Xerus)" 2021-02-09T10:01:59.571 INFO:teuthology.orchestra.run.smithi066.stdout:ID=ubuntu 2021-02-09T10:01:59.571 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE=debian 2021-02-09T10:01:59.571 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Ubuntu 16.04.6 LTS" 2021-02-09T10:01:59.571 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="16.04" 2021-02-09T10:01:59.571 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="http://www.ubuntu.com/" 2021-02-09T10:01:59.571 INFO:teuthology.orchestra.run.smithi066.stdout:SUPPORT_URL="http://help.ubuntu.com/" 2021-02-09T10:01:59.572 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" 2021-02-09T10:01:59.572 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_CODENAME=xenial 2021-02-09T10:01:59.572 INFO:teuthology.orchestra.run.smithi066.stdout:UBUNTU_CODENAME=xenial 2021-02-09T10:01:59.572 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2021-02-09T10:01:59.672 INFO:teuthology.dispatcher.supervisor:Running job 5869899 2021-02-09T10:01:59.672 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-02-09_02:30:03-upgrade:mimic-x-nautilus-distro-basic-smithi/5869899 --name teuthology-2021-02-09_02:30:03-upgrade:mimic-x-nautilus-distro-basic-smithi --description upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-nautilus 6.1-msgr2 7-final-workload/{rbd-python rgw-swift-ragweed_check snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_16.04 thrashosds-health} -- /home/teuthworker/archive/teuthology-2021-02-09_02:30:03-upgrade:mimic-x-nautilus-distro-basic-smithi/5869899/orig.config.yaml 2021-02-09T10:01:59.675 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-02-09_02:30:03-upgrade:mimic-x-nautilus-distro-basic-smithi/5869899 2021-02-09T10:01:59.675 INFO:teuthology.dispatcher.supervisor:Job PID: 30487 2021-02-09T10:01:59.675 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-02-09T18:56:11.024 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-02-09T18:56:11.344 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-02-09T18:56:11.345 INFO:teuthology.nuke:Checking targets against current locks 2021-02-09T18:56:11.420 INFO:teuthology.nuke:Not nuking smithi066.front.sepia.ceph.com because description doesn't match 2021-02-09T18:56:11.420 INFO:teuthology.nuke:Not nuking smithi064.front.sepia.ceph.com because description doesn't match 2021-02-09T18:56:11.420 INFO:teuthology.nuke:Not nuking smithi065.front.sepia.ceph.com because description doesn't match 2021-02-09T18:56:11.421 INFO:teuthology.nuke:Not nuking smithi060.front.sepia.ceph.com because description doesn't match 2021-02-09T18:56:11.421 INFO:teuthology.nuke:Not nuking smithi036.front.sepia.ceph.com because description doesn't match