2021-08-12T17:04:00.259 INFO:root:teuthology version: 1.1.0-321319b1
2021-08-12T17:04:00.359 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging
2021-08-12T17:04:00.360 INFO:teuthology.lock.ops:Updating [ubuntu@smithi017.front.sepia.ceph.com]: reset os type and version on server
2021-08-12T17:04:00.360 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2021-08-12T17:04:00.377 INFO:teuthology.lock.ops:Node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging is complete
2021-08-12T17:04:00.378 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging
2021-08-12T17:04:00.378 INFO:teuthology.lock.ops:Updating [ubuntu@smithi134.front.sepia.ceph.com]: reset os type and version on server
2021-08-12T17:04:00.378 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2021-08-12T17:04:00.399 INFO:teuthology.lock.ops:Node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging is complete
2021-08-12T17:04:00.609 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 8.3
2021-08-12T17:04:00.624 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 8.3
2021-08-12T17:04:00.997 INFO:teuthology.orchestra.console:Power off smithi134
2021-08-12T17:04:01.038 INFO:teuthology.orchestra.console:Power off smithi017
2021-08-12T17:04:09.590 INFO:teuthology.orchestra.console:Power off for smithi134 completed
2021-08-12T17:04:09.692 INFO:teuthology.orchestra.console:Power on smithi134
2021-08-12T17:04:13.699 INFO:teuthology.orchestra.console:Power off for smithi017 completed
2021-08-12T17:04:13.802 INFO:teuthology.orchestra.console:Power on smithi017
2021-08-12T17:04:18.071 INFO:teuthology.orchestra.console:Power on for smithi134 completed
2021-08-12T17:04:18.090 INFO:teuthology.orchestra.console:Power on for smithi017 completed
2021-08-12T17:04:18.174 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish
2021-08-12T17:04:18.195 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish
2021-08-12T17:08:17.277 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-12T17:08:27.040 INFO:teuthology.provision.fog.smithi017:Node is ready
2021-08-12T17:08:27.061 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com
2021-08-12T17:08:27.119 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017
2021-08-12T17:08:27.474 INFO:teuthology.provision.fog.smithi017:Deploy complete!
2021-08-12T17:08:59.050 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-12T17:08:59.332 INFO:teuthology.provision.fog.smithi134:Node is ready
2021-08-12T17:08:59.346 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com
2021-08-12T17:08:59.401 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134
2021-08-12T17:08:59.733 INFO:teuthology.provision.fog.smithi134:Deploy complete!
2021-08-12T17:08:59.882 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com
2021-08-12T17:08:59.883 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-12T17:08:59.900 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com
2021-08-12T17:08:59.900 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-12T17:08:59.917 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server
2021-08-12T17:08:59.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-12T17:09:00.196 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64
2021-08-12T17:09:00.252 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Linux"
2021-08-12T17:09:00.253 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8"
2021-08-12T17:09:00.253 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2021-08-12T17:09:00.253 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2021-08-12T17:09:00.254 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8"
2021-08-12T17:09:00.254 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8"
2021-08-12T17:09:00.254 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Linux 8"
2021-08-12T17:09:00.254 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2021-08-12T17:09:00.254 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-08-12T17:09:00.255 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2021-08-12T17:09:00.255 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-08-12T17:09:00.255 INFO:teuthology.orchestra.run.smithi017.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-08-12T17:09:00.255 INFO:teuthology.orchestra.run.smithi017.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-08-12T17:09:00.257 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2021-08-12T17:09:00.274 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server
2021-08-12T17:09:00.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-12T17:09:00.528 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64
2021-08-12T17:09:00.584 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Linux"
2021-08-12T17:09:00.584 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8"
2021-08-12T17:09:00.584 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos"
2021-08-12T17:09:00.585 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora"
2021-08-12T17:09:00.585 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8"
2021-08-12T17:09:00.585 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8"
2021-08-12T17:09:00.586 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Linux 8"
2021-08-12T17:09:00.586 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2021-08-12T17:09:00.586 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-08-12T17:09:00.587 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/"
2021-08-12T17:09:00.587 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-08-12T17:09:00.588 INFO:teuthology.orchestra.run.smithi134.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-08-12T17:09:00.589 INFO:teuthology.orchestra.run.smithi134.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-08-12T17:09:00.589 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2021-08-12T17:09:00.717 INFO:teuthology.dispatcher.supervisor:Running job 6335852
2021-08-12T17:09:00.718 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-08-12_15:36:23-rados-wip-yuri3-testing-2021-08-09-1006-distro-basic-smithi/6335852 --name yuriw-2021-08-12_15:36:23-rados-wip-yuri3-testing-2021-08-09-1006-distro-basic-smithi --description rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} -- /home/teuthworker/archive/yuriw-2021-08-12_15:36:23-rados-wip-yuri3-testing-2021-08-09-1006-distro-basic-smithi/6335852/orig.config.yaml
2021-08-12T17:09:00.721 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-08-12_15:36:23-rados-wip-yuri3-testing-2021-08-09-1006-distro-basic-smithi/6335852
2021-08-12T17:09:00.722 INFO:teuthology.dispatcher.supervisor:Job PID: 6532
2021-08-12T17:09:00.723 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-08-13T05:09:53.529 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-08-13T05:09:53.716 INFO:teuthology.kill:Killing Pids: {6532}
2021-08-13T05:09:54.860 INFO:teuthology.kill:Nuking machines: ['smithi017', 'smithi134']
2021-08-13T05:09:55.824 INFO:teuthology.kill:2021-08-13 05:09:55,824.824 INFO:teuthology.nuke:targets:
2021-08-13T05:09:55.825 INFO:teuthology.kill:  smithi017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqBTpA35k2xRR5BT5UTQS4KpOmLtZVAE9f4MlFVEHGWmq+lSZ9VnkmQK+NgqeSu7/E/xyYAO7zfG8UvVyqmlf4y6T739vQGVTEIbNembqCu2mILRCUwV+t8nM8f6VwNO+e4wT+PsTg2867QQiITYh2ncO4UBOEXgSuI6eJOTPv/qgd7EW6BgYJ3wslS1a+LN+57iDDQRes9y26tI8VNveUQv0znxfJcjUDA2/9wCw9sM8Xv8Y1q5qp5htjZCWyQw/w8d463kOfZeLCiEsHzZu2qd/ngjQkxiKc86EQBbcEfc8GbjIDPJbxqwJstePeZyzQo1KfunKErED6slMntI/gtQDPl0II/+KVgOyAsJf6Xd3sGGBAVz/LnaZGY/UnL6+stvg4+1cGVKeTXCYGe6x9YFjfcK2fpKBmra8ciaM23ZnTKp7XUvHESuoPGEtU8kNT+yNWORHpnYVNnXLMHEOT51aLsYstizmFYTVMiOtJLql3AW+2suXqdI2HVtjZ9rs=
2021-08-13T05:09:55.825 INFO:teuthology.kill:  smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDO/2+JOiAS9lcruqqmEKg+SI/nuvYl34nkZybUxKkKotseafd/O8w0sF5pxomP8uREU3+VXE40T5YDcSnPxzofTD0+626iWH9bMruizguNdBEedoaNvZVeFpc9CDj89Rrd4gOC8aMIGiradCh7uyiTsJ84c8IMSZC8ui0s9pjHpHrWd5hcomu1gT263ORIUq9++xDvP21jcZDAuizFQNCqNCTZoc3Yq+ZZs6MnC+EPTzIqotyTv6wYvcLsR5zjpzxXXRFXpK0vmAz9nep5m0ICd5kt8QQ+82xIekbKpGuYgHxrSnMzmUEtxZqDJcjY2rGfvp2Ga9QYjxqogfcWBcYBWpRv3+ACevad7f9FW6wflXx3T+JbqQFOZacQIn7FMjOewFiPNffJHBABQ1qs2fjWRTFlNlE03rZAB7zGfa5XvehHPhbRxq2Ci1GESZMnXdv4lWCm3tQgBM6gGiDu9uAkGUcgsXWjX3T3ukpABB6JPBzf+iLh233YH4kv9T1eHq8=
2021-08-13T05:09:55.826 INFO:teuthology.kill:2021-08-13 05:09:55,824.824 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-13T05:09:55.827 INFO:teuthology.kill:2021-08-13 05:09:55,827.827 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-13T05:09:55.889 INFO:teuthology.kill:2021-08-13 05:09:55,888.888 INFO:teuthology.orchestra.console:Power off smithi017
2021-08-13T05:09:55.902 INFO:teuthology.kill:2021-08-13 05:09:55,901.901 INFO:teuthology.orchestra.console:Power off smithi134
2021-08-13T05:10:04.260 INFO:teuthology.kill:2021-08-13 05:10:04,259.259 INFO:teuthology.orchestra.console:Power off for smithi017 completed
2021-08-13T05:10:08.380 INFO:teuthology.kill:2021-08-13 05:10:08,379.379 INFO:teuthology.orchestra.console:Power off for smithi134 completed
2021-08-13T05:10:08.601 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2021-08-13T05:10:08.602 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2021-08-13T05:10:08.603 INFO:teuthology.misc:Compressing logs...
2021-08-13T05:10:08.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-13T05:11:08.663 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-08-13T05:11:08.712 INFO:teuthology.kill:No teuthology processes running
2021-08-13T05:11:09.908 INFO:teuthology.kill:Nuking machines: ['smithi017', 'smithi134']
2021-08-13T05:11:10.860 INFO:teuthology.kill:2021-08-13 05:11:10,859.859 INFO:teuthology.nuke:targets:
2021-08-13T05:11:10.861 INFO:teuthology.kill:  smithi017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqBTpA35k2xRR5BT5UTQS4KpOmLtZVAE9f4MlFVEHGWmq+lSZ9VnkmQK+NgqeSu7/E/xyYAO7zfG8UvVyqmlf4y6T739vQGVTEIbNembqCu2mILRCUwV+t8nM8f6VwNO+e4wT+PsTg2867QQiITYh2ncO4UBOEXgSuI6eJOTPv/qgd7EW6BgYJ3wslS1a+LN+57iDDQRes9y26tI8VNveUQv0znxfJcjUDA2/9wCw9sM8Xv8Y1q5qp5htjZCWyQw/w8d463kOfZeLCiEsHzZu2qd/ngjQkxiKc86EQBbcEfc8GbjIDPJbxqwJstePeZyzQo1KfunKErED6slMntI/gtQDPl0II/+KVgOyAsJf6Xd3sGGBAVz/LnaZGY/UnL6+stvg4+1cGVKeTXCYGe6x9YFjfcK2fpKBmra8ciaM23ZnTKp7XUvHESuoPGEtU8kNT+yNWORHpnYVNnXLMHEOT51aLsYstizmFYTVMiOtJLql3AW+2suXqdI2HVtjZ9rs=
2021-08-13T05:11:10.862 INFO:teuthology.kill:  smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDO/2+JOiAS9lcruqqmEKg+SI/nuvYl34nkZybUxKkKotseafd/O8w0sF5pxomP8uREU3+VXE40T5YDcSnPxzofTD0+626iWH9bMruizguNdBEedoaNvZVeFpc9CDj89Rrd4gOC8aMIGiradCh7uyiTsJ84c8IMSZC8ui0s9pjHpHrWd5hcomu1gT263ORIUq9++xDvP21jcZDAuizFQNCqNCTZoc3Yq+ZZs6MnC+EPTzIqotyTv6wYvcLsR5zjpzxXXRFXpK0vmAz9nep5m0ICd5kt8QQ+82xIekbKpGuYgHxrSnMzmUEtxZqDJcjY2rGfvp2Ga9QYjxqogfcWBcYBWpRv3+ACevad7f9FW6wflXx3T+JbqQFOZacQIn7FMjOewFiPNffJHBABQ1qs2fjWRTFlNlE03rZAB7zGfa5XvehHPhbRxq2Ci1GESZMnXdv4lWCm3tQgBM6gGiDu9uAkGUcgsXWjX3T3ukpABB6JPBzf+iLh233YH4kv9T1eHq8=
2021-08-13T05:11:10.881 INFO:teuthology.kill:2021-08-13 05:11:10,881.881 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-13T05:11:10.885 INFO:teuthology.kill:2021-08-13 05:11:10,884.884 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-13T05:11:10.944 INFO:teuthology.kill:2021-08-13 05:11:10,943.943 INFO:teuthology.orchestra.console:Power off smithi134
2021-08-13T05:11:10.956 INFO:teuthology.kill:2021-08-13 05:11:10,956.956 INFO:teuthology.orchestra.console:Power off smithi017
2021-08-13T05:11:11.084 INFO:teuthology.kill:2021-08-13 05:11:11,084.084 INFO:teuthology.orchestra.console:Power off for smithi134 completed
2021-08-13T05:11:11.095 INFO:teuthology.kill:2021-08-13 05:11:11,095.095 INFO:teuthology.orchestra.console:Power off for smithi017 completed
2021-08-13T05:11:11.225 INFO:teuthology.kill:2021-08-13 05:11:11,224.224 INFO:teuthology.lock.ops:unlocked smithi134.front.sepia.ceph.com
2021-08-13T05:11:11.231 INFO:teuthology.kill:2021-08-13 05:11:11,230.230 INFO:teuthology.lock.ops:unlocked smithi017.front.sepia.ceph.com
2021-08-13T05:13:11.526 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-08-13T05:13:11.597 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-08-13T05:13:11.598 INFO:teuthology.nuke:Checking targets against current locks
2021-08-13T05:13:11.692 INFO:teuthology.nuke:Not nuking smithi134.front.sepia.ceph.com because description doesn't match
2021-08-13T05:13:11.693 INFO:teuthology.nuke:Not nuking smithi017.front.sepia.ceph.com because description doesn't match