2021-09-22T17:00:00.865 INFO:root:teuthology version: 1.1.0-d3a488f5 2021-09-22T17:00:01.031 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi101.front.sepia.ceph.com' reimaging 2021-09-22T17:00:01.033 INFO:teuthology.lock.ops:Updating [ubuntu@smithi101.front.sepia.ceph.com]: reset os type and version on server 2021-09-22T17:00:01.034 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2021-09-22T17:00:01.059 INFO:teuthology.lock.ops:Node 'ubuntu@smithi101.front.sepia.ceph.com' reimaging is complete 2021-09-22T17:00:01.059 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi151.front.sepia.ceph.com' reimaging 2021-09-22T17:00:01.060 INFO:teuthology.lock.ops:Updating [ubuntu@smithi151.front.sepia.ceph.com]: reset os type and version on server 2021-09-22T17:00:01.060 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2021-09-22T17:00:01.077 INFO:teuthology.lock.ops:Node 'ubuntu@smithi151.front.sepia.ceph.com' reimaging is complete 2021-09-22T17:00:01.077 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi173.front.sepia.ceph.com' reimaging 2021-09-22T17:00:01.078 INFO:teuthology.lock.ops:Updating [ubuntu@smithi173.front.sepia.ceph.com]: reset os type and version on server 2021-09-22T17:00:01.079 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2021-09-22T17:00:01.105 INFO:teuthology.lock.ops:Node 'ubuntu@smithi173.front.sepia.ceph.com' reimaging is complete 2021-09-22T17:00:01.106 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi194.front.sepia.ceph.com' reimaging 2021-09-22T17:00:01.106 INFO:teuthology.lock.ops:Updating [ubuntu@smithi194.front.sepia.ceph.com]: reset os type and version on server 2021-09-22T17:00:01.107 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2021-09-22T17:00:01.126 INFO:teuthology.lock.ops:Node 'ubuntu@smithi194.front.sepia.ceph.com' reimaging is complete 2021-09-22T17:00:01.274 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of ubuntu 18.04 2021-09-22T17:00:01.295 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of ubuntu 18.04 2021-09-22T17:00:01.329 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of ubuntu 18.04 2021-09-22T17:00:01.349 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of ubuntu 18.04 2021-09-22T17:00:01.644 INFO:teuthology.orchestra.console:Power off smithi101 2021-09-22T17:00:01.683 INFO:teuthology.orchestra.console:Power off smithi151 2021-09-22T17:00:01.725 INFO:teuthology.orchestra.console:Power off smithi194 2021-09-22T17:00:01.739 INFO:teuthology.orchestra.console:Power off smithi173 2021-09-22T17:00:10.069 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2021-09-22T17:00:10.090 INFO:teuthology.orchestra.console:Power off for smithi194 completed 2021-09-22T17:00:10.102 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2021-09-22T17:00:10.170 INFO:teuthology.orchestra.console:Power on smithi151 2021-09-22T17:00:10.191 INFO:teuthology.orchestra.console:Power on smithi194 2021-09-22T17:00:10.208 INFO:teuthology.orchestra.console:Power on smithi173 2021-09-22T17:00:14.138 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2021-09-22T17:00:14.240 INFO:teuthology.orchestra.console:Power on smithi101 2021-09-22T17:00:14.459 INFO:teuthology.orchestra.console:Power on for smithi151 completed 2021-09-22T17:00:14.560 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2021-09-22T17:00:18.511 INFO:teuthology.orchestra.console:Power on for smithi101 completed 2021-09-22T17:00:18.584 INFO:teuthology.orchestra.console:Power on for smithi173 completed 2021-09-22T17:00:18.612 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2021-09-22T17:00:18.685 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2021-09-22T17:00:18.695 INFO:teuthology.orchestra.console:Power on for smithi194 completed 2021-09-22T17:00:18.796 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2021-09-22T17:05:14.631 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-22T17:05:14.929 INFO:teuthology.provision.fog.smithi194:Node is ready 2021-09-22T17:05:14.977 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2021-09-22T17:05:15.026 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2021-09-22T17:05:15.312 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2021-09-22T17:05:20.557 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-22T17:05:20.563 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-22T17:05:20.867 INFO:teuthology.provision.fog.smithi101:Node is ready 2021-09-22T17:05:20.916 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101.front.sepia.ceph.com 2021-09-22T17:05:20.932 INFO:teuthology.provision.fog.smithi173:Node is ready 2021-09-22T17:05:20.963 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101 2021-09-22T17:05:20.981 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2021-09-22T17:05:21.029 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2021-09-22T17:05:21.248 INFO:teuthology.provision.fog.smithi101:Deploy complete! 2021-09-22T17:05:21.343 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2021-09-22T17:05:31.712 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-22T17:05:32.016 INFO:teuthology.provision.fog.smithi151:Node is ready 2021-09-22T17:05:32.064 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2021-09-22T17:05:32.113 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2021-09-22T17:05:32.404 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2021-09-22T17:05:32.611 INFO:teuthology.lock.ops:Checking smithi101.front.sepia.ceph.com 2021-09-22T17:05:32.612 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-22T17:05:32.652 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2021-09-22T17:05:32.653 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-22T17:05:32.668 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2021-09-22T17:05:32.669 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-22T17:05:32.683 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2021-09-22T17:05:32.684 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-22T17:05:32.699 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: set os type and version on server 2021-09-22T17:05:32.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2021-09-22T17:05:32.990 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64 2021-09-22T17:05:33.038 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Ubuntu" 2021-09-22T17:05:33.039 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-09-22T17:05:33.039 INFO:teuthology.orchestra.run.smithi101.stdout:ID=ubuntu 2021-09-22T17:05:33.039 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE=debian 2021-09-22T17:05:33.039 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-09-22T17:05:33.040 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="18.04" 2021-09-22T17:05:33.040 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.ubuntu.com/" 2021-09-22T17:05:33.040 INFO:teuthology.orchestra.run.smithi101.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-09-22T17:05:33.040 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-09-22T17:05:33.041 INFO:teuthology.orchestra.run.smithi101.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-09-22T17:05:33.041 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_CODENAME=bionic 2021-09-22T17:05:33.041 INFO:teuthology.orchestra.run.smithi101.stdout:UBUNTU_CODENAME=bionic 2021-09-22T17:05:33.042 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2021-09-22T17:05:33.057 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2021-09-22T17:05:33.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2021-09-22T17:05:33.344 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2021-09-22T17:05:33.392 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2021-09-22T17:05:33.392 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-09-22T17:05:33.392 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2021-09-22T17:05:33.393 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2021-09-22T17:05:33.393 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-09-22T17:05:33.393 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="18.04" 2021-09-22T17:05:33.393 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2021-09-22T17:05:33.394 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-09-22T17:05:33.394 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-09-22T17:05:33.394 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-09-22T17:05:33.394 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=bionic 2021-09-22T17:05:33.395 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=bionic 2021-09-22T17:05:33.395 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2021-09-22T17:05:33.411 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2021-09-22T17:05:33.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2021-09-22T17:05:33.696 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2021-09-22T17:05:33.744 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Ubuntu" 2021-09-22T17:05:33.744 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-09-22T17:05:33.745 INFO:teuthology.orchestra.run.smithi173.stdout:ID=ubuntu 2021-09-22T17:05:33.745 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE=debian 2021-09-22T17:05:33.745 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-09-22T17:05:33.745 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="18.04" 2021-09-22T17:05:33.746 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.ubuntu.com/" 2021-09-22T17:05:33.746 INFO:teuthology.orchestra.run.smithi173.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-09-22T17:05:33.746 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-09-22T17:05:33.746 INFO:teuthology.orchestra.run.smithi173.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-09-22T17:05:33.747 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_CODENAME=bionic 2021-09-22T17:05:33.747 INFO:teuthology.orchestra.run.smithi173.stdout:UBUNTU_CODENAME=bionic 2021-09-22T17:05:33.747 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2021-09-22T17:05:33.765 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2021-09-22T17:05:33.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2021-09-22T17:05:34.047 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2021-09-22T17:05:34.095 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Ubuntu" 2021-09-22T17:05:34.096 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-09-22T17:05:34.096 INFO:teuthology.orchestra.run.smithi194.stdout:ID=ubuntu 2021-09-22T17:05:34.096 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE=debian 2021-09-22T17:05:34.096 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-09-22T17:05:34.097 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="18.04" 2021-09-22T17:05:34.097 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.ubuntu.com/" 2021-09-22T17:05:34.097 INFO:teuthology.orchestra.run.smithi194.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-09-22T17:05:34.097 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-09-22T17:05:34.097 INFO:teuthology.orchestra.run.smithi194.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-09-22T17:05:34.098 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_CODENAME=bionic 2021-09-22T17:05:34.098 INFO:teuthology.orchestra.run.smithi194.stdout:UBUNTU_CODENAME=bionic 2021-09-22T17:05:34.099 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2021-09-22T17:05:34.200 INFO:teuthology.dispatcher.supervisor:Running job 6402896 2021-09-22T17:05:34.201 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-09-22_14:54:43-rados-wip-yuri8-testing-2021-09-21-0415-pacific-distro-basic-smithi/6402896 --name yuriw-2021-09-22_14:54:43-rados-wip-yuri8-testing-2021-09-21-0415-pacific-distro-basic-smithi --description rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} -- /home/teuthworker/archive/yuriw-2021-09-22_14:54:43-rados-wip-yuri8-testing-2021-09-21-0415-pacific-distro-basic-smithi/6402896/orig.config.yaml 2021-09-22T17:05:34.204 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-09-22_14:54:43-rados-wip-yuri8-testing-2021-09-21-0415-pacific-distro-basic-smithi/6402896 2021-09-22T17:05:34.205 INFO:teuthology.dispatcher.supervisor:Job PID: 10714 2021-09-22T17:05:34.205 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-09-22T19:41:43.859 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2021-09-22_14:54:43-rados-wip-yuri8-testing-2021-09-21-0415-pacific-distro-basic-smithi/jobs/ failed with status 500:
Internal Server Error
2021-09-22T19:41:44.902 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2021-09-22_14:54:43-rados-wip-yuri8-testing-2021-09-21-0415-pacific-distro-basic-smithi/jobs/ failed with status 500:Internal Server Error
2021-09-22T20:15:48.491 WARNING:urllib3.connectionpool:Retrying (Retry(total=9, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('