2021-07-14T21:30:34.374 INFO:root:teuthology version: 1.1.0-22d0fca1
2021-07-14T21:30:34.621 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi100.front.sepia.ceph.com' reimaging
2021-07-14T21:30:34.622 INFO:teuthology.lock.ops:Updating [ubuntu@smithi100.front.sepia.ceph.com]: reset os type and version on server
2021-07-14T21:30:34.623 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2021-07-14T21:30:34.658 INFO:teuthology.lock.ops:Node 'ubuntu@smithi100.front.sepia.ceph.com' reimaging is complete
2021-07-14T21:30:34.658 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging
2021-07-14T21:30:34.659 INFO:teuthology.lock.ops:Updating [ubuntu@smithi136.front.sepia.ceph.com]: reset os type and version on server
2021-07-14T21:30:34.659 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2021-07-14T21:30:34.685 INFO:teuthology.lock.ops:Node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging is complete
2021-07-14T21:30:34.932 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of ubuntu 20.04
2021-07-14T21:30:34.938 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of ubuntu 20.04
2021-07-14T21:30:35.464 INFO:teuthology.orchestra.console:Power off smithi100
2021-07-14T21:30:35.531 INFO:teuthology.orchestra.console:Power off smithi136
2021-07-14T21:30:44.026 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2021-07-14T21:30:44.130 INFO:teuthology.orchestra.console:Power on smithi136
2021-07-14T21:30:48.142 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2021-07-14T21:30:48.244 INFO:teuthology.orchestra.console:Power on smithi100
2021-07-14T21:30:52.570 INFO:teuthology.orchestra.console:Power on for smithi136 completed
2021-07-14T21:30:52.574 INFO:teuthology.orchestra.console:Power on for smithi100 completed
2021-07-14T21:30:52.675 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2021-07-14T21:30:52.687 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2021-07-14T21:35:41.103 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-14T21:35:41.540 INFO:teuthology.provision.fog.smithi136:Node is ready
2021-07-14T21:35:41.548 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2021-07-14T21:35:41.599 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2021-07-14T21:35:41.806 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2021-07-14T21:36:00.296 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-14T21:36:00.839 INFO:teuthology.provision.fog.smithi100:Node is ready
2021-07-14T21:36:00.848 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com
2021-07-14T21:36:00.855 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100
2021-07-14T21:36:01.079 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2021-07-14T21:36:01.235 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com
2021-07-14T21:36:01.239 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-14T21:36:01.257 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2021-07-14T21:36:01.257 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-14T21:36:01.282 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server
2021-07-14T21:36:01.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-14T21:36:01.479 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64
2021-07-14T21:36:01.484 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu"
2021-07-14T21:36:01.485 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-07-14T21:36:01.485 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu
2021-07-14T21:36:01.485 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian
2021-07-14T21:36:01.486 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-07-14T21:36:01.486 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="20.04"
2021-07-14T21:36:01.486 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/"
2021-07-14T21:36:01.487 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-07-14T21:36:01.487 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-07-14T21:36:01.487 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-07-14T21:36:01.487 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=focal
2021-07-14T21:36:01.488 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=focal
2021-07-14T21:36:01.489 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2021-07-14T21:36:01.505 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2021-07-14T21:36:01.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-14T21:36:01.686 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2021-07-14T21:36:01.692 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu"
2021-07-14T21:36:01.693 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-07-14T21:36:01.693 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu
2021-07-14T21:36:01.694 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian
2021-07-14T21:36:01.694 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-07-14T21:36:01.694 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="20.04"
2021-07-14T21:36:01.694 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/"
2021-07-14T21:36:01.694 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-07-14T21:36:01.695 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-07-14T21:36:01.695 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-07-14T21:36:01.695 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=focal
2021-07-14T21:36:01.695 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=focal
2021-07-14T21:36:01.696 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2021-07-14T21:36:01.772 INFO:teuthology.dispatcher.supervisor:Running job 6271996
2021-07-14T21:36:01.773 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_22d0fca188262bb2f460f46cb79ab21e54fb316f/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-07-14_21:27:35-rados:upgrade-wip-sage-testing-2021-07-14-1613-distro-basic-smithi/6271996 --name sage-2021-07-14_21:27:35-rados:upgrade-wip-sage-testing-2021-07-14-1613-distro-basic-smithi --description rados:upgrade/parallel/{0-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/sage-2021-07-14_21:27:35-rados:upgrade-wip-sage-testing-2021-07-14-1613-distro-basic-smithi/6271996/orig.config.yaml
2021-07-14T21:36:01.778 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-07-14_21:27:35-rados:upgrade-wip-sage-testing-2021-07-14-1613-distro-basic-smithi/6271996
2021-07-14T21:36:01.779 INFO:teuthology.dispatcher.supervisor:Job PID: 9239
2021-07-14T21:36:01.780 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-07-15T09:36:59.847 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-07-15T09:37:00.757 INFO:teuthology.kill:Killing Pids: {9239}
2021-07-15T09:37:02.049 INFO:teuthology.kill:Nuking machines: ['smithi100', 'smithi136']
2021-07-15T09:37:02.963 INFO:teuthology.kill:2021-07-15 09:37:02,962.962 INFO:teuthology.nuke:targets:
2021-07-15T09:37:02.963 INFO:teuthology.kill:  smithi100.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeaVsCGLkNe1LfegU8GIQkmkaJCOTMdUKwJucRgMvwJ5EKE6zYr9IgD0wiVWa0p2sunDETQiYPHfu54oZOXP1Vp9o37Ecu8rXNWK90VTaaJZFaQRWnT+bNWtGUWY0hhs+K88FshCUA60SjZxkml3xXRVMysx66tZS6B6/yXNzubvz9DJEL9TXl0h27hdl37RNQnaFcbDrNoGbr0qgB5EDoLeT08dm4n1yzka4EkzIVqVUwNQPTM8KLSBvMYpC4W3fv928hPMUhhJlkpJDyaySRWj4NUgXdEvuzbYrJl/92haJ1IjVcwJ8wpjAbL478UIWqD6WMW5gQKEabPKQPXZQhBV5oRt9cchnWrJvronFAbHRzDT8yX2zEIx6W1ISBrI4jP7TkA8TmqHtCarERqobKhSEnDnKL/hBzqJ8cNenLzmD57oVIxv1qyPuirqJ5PCYgnQ9jwII6mT5PJ7vN67rMqA1Z1tCrfLbikltpgXi6/MhWqP3giKtbTRqQWQWCMUc=
2021-07-15T09:37:02.966 INFO:teuthology.kill:  smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkf1ZY0XxB8gT8XWC+UxSOWAW4dvcaccK+iE8d9hL7d/bgXB3/6RgM3+y6ZAkCDNjepCI1GEJIOIBOuFnQkhScwcXp4tsvgn5bXi1bGokjnMo4w8DUcioiE18/P2QMlSgnjqOfuaJdOaxnsJ7Uhf37lUAA14vX0cz5UUR/oZnyyAE5REM/ixo6G8g4XNqeUhoHqHFdgaC87bfbRCC/LiulyRJEF0IjVuoV/RnNH0bHFeR7EexcjCB2kjmxyLzrSaV9pfJIZaBlFivHPuoydP5dfYMQ4idYvZj87KlQ+l2PnoD0Z1YjVRbMEh7ZrMZ6t10mM4W33wSvzJspTE46FmqRoTxzCM4MbyQsD9iLkkm5TwiutS9pFUYNah3hX2uk/jA5BPjr41vDO332uyP9MxXNDIzmtMeCFVRWW853o6wkpGs6Lj1QhQyQOj1oRmueWZ4nYfzfz0h7Ce+1eDeA26qjo5tKiibrwpwpq1+aIUSkB9wOD2QC+dx3pRaaaAONa/s=
2021-07-15T09:37:02.967 INFO:teuthology.kill:2021-07-15 09:37:02,963.963 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-15T09:37:02.967 INFO:teuthology.kill:2021-07-15 09:37:02,965.965 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-15T09:37:03.026 INFO:teuthology.kill:2021-07-15 09:37:03,026.026 INFO:teuthology.orchestra.console:Power off smithi136
2021-07-15T09:37:03.041 INFO:teuthology.kill:2021-07-15 09:37:03,040.040 INFO:teuthology.orchestra.console:Power off smithi100
2021-07-15T09:37:11.399 INFO:teuthology.kill:2021-07-15 09:37:11,398.398 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2021-07-15T09:37:11.404 INFO:teuthology.kill:2021-07-15 09:37:11,404.404 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2021-07-15T09:37:11.665 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2021-07-15T09:37:11.667 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2021-07-15T09:37:11.672 INFO:teuthology.misc:Compressing logs...
2021-07-15T09:37:11.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-15T09:37:46.198 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_22d0fca188262bb2f460f46cb79ab21e54fb316f/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_22d0fca188262bb2f460f46cb79ab21e54fb316f/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_22d0fca188262bb2f460f46cb79ab21e54fb316f/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_22d0fca188262bb2f460f46cb79ab21e54fb316f/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_22d0fca188262bb2f460f46cb79ab21e54fb316f/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_22d0fca188262bb2f460f46cb79ab21e54fb316f/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_22d0fca188262bb2f460f46cb79ab21e54fb316f/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-07-15T09:37:46.299 INFO:teuthology.kill:No teuthology processes running
2021-07-15T09:37:47.335 INFO:teuthology.kill:Nuking machines: ['smithi100', 'smithi136']
2021-07-15T09:37:48.220 INFO:teuthology.kill:2021-07-15 09:37:48,220.220 INFO:teuthology.nuke:targets:
2021-07-15T09:37:48.221 INFO:teuthology.kill:  smithi100.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeaVsCGLkNe1LfegU8GIQkmkaJCOTMdUKwJucRgMvwJ5EKE6zYr9IgD0wiVWa0p2sunDETQiYPHfu54oZOXP1Vp9o37Ecu8rXNWK90VTaaJZFaQRWnT+bNWtGUWY0hhs+K88FshCUA60SjZxkml3xXRVMysx66tZS6B6/yXNzubvz9DJEL9TXl0h27hdl37RNQnaFcbDrNoGbr0qgB5EDoLeT08dm4n1yzka4EkzIVqVUwNQPTM8KLSBvMYpC4W3fv928hPMUhhJlkpJDyaySRWj4NUgXdEvuzbYrJl/92haJ1IjVcwJ8wpjAbL478UIWqD6WMW5gQKEabPKQPXZQhBV5oRt9cchnWrJvronFAbHRzDT8yX2zEIx6W1ISBrI4jP7TkA8TmqHtCarERqobKhSEnDnKL/hBzqJ8cNenLzmD57oVIxv1qyPuirqJ5PCYgnQ9jwII6mT5PJ7vN67rMqA1Z1tCrfLbikltpgXi6/MhWqP3giKtbTRqQWQWCMUc=
2021-07-15T09:37:48.224 INFO:teuthology.kill:  smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkf1ZY0XxB8gT8XWC+UxSOWAW4dvcaccK+iE8d9hL7d/bgXB3/6RgM3+y6ZAkCDNjepCI1GEJIOIBOuFnQkhScwcXp4tsvgn5bXi1bGokjnMo4w8DUcioiE18/P2QMlSgnjqOfuaJdOaxnsJ7Uhf37lUAA14vX0cz5UUR/oZnyyAE5REM/ixo6G8g4XNqeUhoHqHFdgaC87bfbRCC/LiulyRJEF0IjVuoV/RnNH0bHFeR7EexcjCB2kjmxyLzrSaV9pfJIZaBlFivHPuoydP5dfYMQ4idYvZj87KlQ+l2PnoD0Z1YjVRbMEh7ZrMZ6t10mM4W33wSvzJspTE46FmqRoTxzCM4MbyQsD9iLkkm5TwiutS9pFUYNah3hX2uk/jA5BPjr41vDO332uyP9MxXNDIzmtMeCFVRWW853o6wkpGs6Lj1QhQyQOj1oRmueWZ4nYfzfz0h7Ce+1eDeA26qjo5tKiibrwpwpq1+aIUSkB9wOD2QC+dx3pRaaaAONa/s=
2021-07-15T09:37:48.241 INFO:teuthology.kill:2021-07-15 09:37:48,241.241 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-15T09:37:48.243 INFO:teuthology.kill:2021-07-15 09:37:48,243.243 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-15T09:37:48.296 INFO:teuthology.kill:2021-07-15 09:37:48,296.296 INFO:teuthology.orchestra.console:Power off smithi100
2021-07-15T09:37:48.308 INFO:teuthology.kill:2021-07-15 09:37:48,308.308 INFO:teuthology.orchestra.console:Power off smithi136
2021-07-15T09:37:48.436 INFO:teuthology.kill:2021-07-15 09:37:48,436.436 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2021-07-15T09:37:48.450 INFO:teuthology.kill:2021-07-15 09:37:48,449.449 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2021-07-15T09:37:48.574 INFO:teuthology.kill:2021-07-15 09:37:48,573.573 INFO:teuthology.lock.ops:unlocked smithi100.front.sepia.ceph.com
2021-07-15T09:37:48.584 INFO:teuthology.kill:2021-07-15 09:37:48,584.584 INFO:teuthology.lock.ops:unlocked smithi136.front.sepia.ceph.com
2021-07-15T09:39:48.857 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-07-15T09:39:48.973 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-07-15T09:39:48.976 INFO:teuthology.nuke:Checking targets against current locks
2021-07-15T09:39:49.319 INFO:teuthology.nuke:Not nuking smithi100.front.sepia.ceph.com because description doesn't match
2021-07-15T09:39:49.320 INFO:teuthology.nuke:Not nuking smithi136.front.sepia.ceph.com because description doesn't match