2021-06-03T03:25:58.884 INFO:root:teuthology version: 1.1.0-f359b10d
2021-06-03T03:25:59.179 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi118.front.sepia.ceph.com' reimaging
2021-06-03T03:25:59.181 INFO:teuthology.lock.ops:Updating [ubuntu@smithi118.front.sepia.ceph.com]: reset os type and version on server
2021-06-03T03:25:59.182 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server
2021-06-03T03:25:59.198 INFO:teuthology.lock.ops:Node 'ubuntu@smithi118.front.sepia.ceph.com' reimaging is complete
2021-06-03T03:25:59.199 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi160.front.sepia.ceph.com' reimaging
2021-06-03T03:25:59.199 INFO:teuthology.lock.ops:Updating [ubuntu@smithi160.front.sepia.ceph.com]: reset os type and version on server
2021-06-03T03:25:59.199 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2021-06-03T03:25:59.224 INFO:teuthology.lock.ops:Node 'ubuntu@smithi160.front.sepia.ceph.com' reimaging is complete
2021-06-03T03:25:59.438 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 8.3
2021-06-03T03:25:59.465 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of centos 8.3
2021-06-03T03:25:59.806 INFO:teuthology.orchestra.console:Power off smithi118
2021-06-03T03:25:59.880 INFO:teuthology.orchestra.console:Power off smithi160
2021-06-03T03:26:12.351 INFO:teuthology.orchestra.console:Power off for smithi118 completed
2021-06-03T03:26:12.418 INFO:teuthology.orchestra.console:Power off for smithi160 completed
2021-06-03T03:26:12.453 INFO:teuthology.orchestra.console:Power on smithi118
2021-06-03T03:26:12.519 INFO:teuthology.orchestra.console:Power on smithi160
2021-06-03T03:26:20.897 INFO:teuthology.orchestra.console:Power on for smithi118 completed
2021-06-03T03:26:20.926 INFO:teuthology.orchestra.console:Power on for smithi160 completed
2021-06-03T03:26:20.998 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish
2021-06-03T03:26:21.028 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish
2021-06-03T03:31:08.338 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-06-03T03:31:08.647 INFO:teuthology.provision.fog.smithi160:Node is ready
2021-06-03T03:31:08.661 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com
2021-06-03T03:31:08.717 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160
2021-06-03T03:31:09.042 INFO:teuthology.provision.fog.smithi160:Deploy complete!
2021-06-03T03:31:26.370 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-06-03T03:31:26.708 INFO:teuthology.provision.fog.smithi118:Node is ready
2021-06-03T03:31:26.723 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com
2021-06-03T03:31:26.778 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118
2021-06-03T03:31:27.090 INFO:teuthology.provision.fog.smithi118:Deploy complete!
2021-06-03T03:31:27.216 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com
2021-06-03T03:31:27.217 INFO:teuthology.lock.ops:New key found. Updating...
2021-06-03T03:31:27.234 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com
2021-06-03T03:31:27.238 INFO:teuthology.lock.ops:New key found. Updating...
2021-06-03T03:31:27.258 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server
2021-06-03T03:31:27.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-06-03T03:31:27.542 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64
2021-06-03T03:31:27.597 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Linux"
2021-06-03T03:31:27.597 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8"
2021-06-03T03:31:27.598 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos"
2021-06-03T03:31:27.598 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora"
2021-06-03T03:31:27.599 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8"
2021-06-03T03:31:27.599 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8"
2021-06-03T03:31:27.599 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Linux 8"
2021-06-03T03:31:27.600 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31"
2021-06-03T03:31:27.600 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-06-03T03:31:27.601 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/"
2021-06-03T03:31:27.601 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-06-03T03:31:27.602 INFO:teuthology.orchestra.run.smithi118.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-06-03T03:31:27.602 INFO:teuthology.orchestra.run.smithi118.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-06-03T03:31:27.605 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server
2021-06-03T03:31:27.621 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server
2021-06-03T03:31:27.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-06-03T03:31:27.923 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64
2021-06-03T03:31:27.978 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Linux"
2021-06-03T03:31:27.979 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8"
2021-06-03T03:31:27.979 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos"
2021-06-03T03:31:27.980 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora"
2021-06-03T03:31:27.980 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8"
2021-06-03T03:31:27.981 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8"
2021-06-03T03:31:27.981 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Linux 8"
2021-06-03T03:31:27.982 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31"
2021-06-03T03:31:27.982 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-06-03T03:31:27.983 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/"
2021-06-03T03:31:27.983 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-06-03T03:31:27.983 INFO:teuthology.orchestra.run.smithi160.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-06-03T03:31:27.984 INFO:teuthology.orchestra.run.smithi160.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-06-03T03:31:27.985 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2021-06-03T03:31:28.069 INFO:teuthology.dispatcher.supervisor:Running job 6147931
2021-06-03T03:31:28.070 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-06-03_00:33:39-rados:cephadm-wip-sage-testing-2021-06-02-1921-distro-basic-smithi/6147931 --name sage-2021-06-03_00:33:39-rados:cephadm-wip-sage-testing-2021-06-02-1921-distro-basic-smithi --description rados:cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/connectivity} -- /home/teuthworker/archive/sage-2021-06-03_00:33:39-rados:cephadm-wip-sage-testing-2021-06-02-1921-distro-basic-smithi/6147931/orig.config.yaml
2021-06-03T03:31:28.075 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-06-03_00:33:39-rados:cephadm-wip-sage-testing-2021-06-02-1921-distro-basic-smithi/6147931
2021-06-03T03:31:28.076 INFO:teuthology.dispatcher.supervisor:Job PID: 16734
2021-06-03T03:31:28.076 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-06-03T15:32:18.367 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-06-03T15:32:18.520 INFO:teuthology.kill:Killing Pids: {16734}
2021-06-03T15:32:19.632 INFO:teuthology.kill:Nuking machines: ['smithi118', 'smithi160']
2021-06-03T15:32:20.606 INFO:teuthology.kill:2021-06-03 15:32:20,606.606 INFO:teuthology.nuke:targets:
2021-06-03T15:32:20.607 INFO:teuthology.kill:  smithi118.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCWc/Mu0NNV/Uc0o4WfNoIz8WKPbcEtFIKQQq48l/dUxnBSLCzul3XJq1iaBVjs+EkeH6kdFZVzn8FPdKvhnOzk9GgP/1WX9xTFrLI0w2i9M6J8U/ZmtWOZOiUdQXh04JUp5hQebZR/7CwyqSN+iej2rckpA0pMYJbS6TPAVrnrXQIMsV2OyfWbGxXW4ENqn1d5QanMdZUg/T+GVvIVEOYEq9U9d3t60Rofzig1Bhlj6VlxHQLpOGEhJIsN5ydWoJZ8N9j1tVBUQtWl1flpbDaUktsMOrn4ECV9vg7GEWuaZM+xrxCuT0mG2VlQ6GOFW2TdAJqWNBVS5biWb1kOs9RtA4H8rBv110a0Pfpqs4CIINfGQ1WMErHr+niC/KdYmXdhN/1I5lMHy4g2H2D1OiGuwobg7LYm80/aCQpyXi/CRR0RabeV/5vt9jP5liAmVpo+rSeKWkGLLHGjHGLHenbjB73TH/PxaXH9BJbl9qTcyINjlLdcGMjNlF84NtnHz0=
2021-06-03T15:32:20.608 INFO:teuthology.kill:  smithi160.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDWs1VhK/LgDSvM9YR7fLVUJW20nPxzMbDgcP7L4ibJdpB0XjwPX+hz2fcYN6A7+sKq0DZoBlvd0yPAxIZean+4g/Lw8wJdgugzdbfUp3+lSZws4uTUzlsWM19PLW33v9VUu2LZVpAupeDkfksOp9UpZPYPFKwfXg03S6FXInQnoLEryaB6tNtl8sTzDpmVRvOgGOFDSU0y5mQeSjTJgbEgeEba7yV/7OusEv2qKIoYjbbJkRe6VFfDjCOMV9WxdglUpbd6LqOBk3pzJDRKvGe+Yw/rOFOfWcGLbfj/e8nMK1rKN0jal3Bi7KYe9gDaFlIIMdC8MF8LfQ9zaoKsjyqwiSI8Hfe0kn+XnvPDGHmPJN7aZdHPHIHkZ5gQCeSl0WLmnOuhnHmkl6VYYk9c8aEyrE+I0jnr+2Ds857IPIiEqSoBBz/Aifeof/IQoAEpYkWCdyjQOdseN7wowhtg1nNn7PSDb1FkpUbGzwLU5YUh/UeBeM/GEBBBshHRdegvgM=
2021-06-03T15:32:20.608 INFO:teuthology.kill:2021-06-03 15:32:20,606.606 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-06-03T15:32:20.609 INFO:teuthology.kill:2021-06-03 15:32:20,609.609 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-06-03T15:32:20.671 INFO:teuthology.kill:2021-06-03 15:32:20,671.671 INFO:teuthology.orchestra.console:Power off smithi118
2021-06-03T15:32:20.689 INFO:teuthology.kill:2021-06-03 15:32:20,689.689 INFO:teuthology.orchestra.console:Power off smithi160
2021-06-03T15:32:33.160 INFO:teuthology.kill:2021-06-03 15:32:33,160.160 INFO:teuthology.orchestra.console:Power off for smithi118 completed
2021-06-03T15:32:33.187 INFO:teuthology.kill:2021-06-03 15:32:33,187.187 INFO:teuthology.orchestra.console:Power off for smithi160 completed
2021-06-03T15:32:33.440 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2021-06-03T15:32:33.441 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2021-06-03T15:32:33.441 INFO:teuthology.misc:Compressing logs...
2021-06-03T15:32:33.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-06-03T15:33:33.503 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-06-03T15:33:33.548 INFO:teuthology.kill:No teuthology processes running
2021-06-03T15:33:34.593 INFO:teuthology.kill:Nuking machines: ['smithi118', 'smithi160']
2021-06-03T15:33:35.536 INFO:teuthology.kill:2021-06-03 15:33:35,535.535 INFO:teuthology.nuke:targets:
2021-06-03T15:33:35.536 INFO:teuthology.kill:  smithi118.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCWc/Mu0NNV/Uc0o4WfNoIz8WKPbcEtFIKQQq48l/dUxnBSLCzul3XJq1iaBVjs+EkeH6kdFZVzn8FPdKvhnOzk9GgP/1WX9xTFrLI0w2i9M6J8U/ZmtWOZOiUdQXh04JUp5hQebZR/7CwyqSN+iej2rckpA0pMYJbS6TPAVrnrXQIMsV2OyfWbGxXW4ENqn1d5QanMdZUg/T+GVvIVEOYEq9U9d3t60Rofzig1Bhlj6VlxHQLpOGEhJIsN5ydWoJZ8N9j1tVBUQtWl1flpbDaUktsMOrn4ECV9vg7GEWuaZM+xrxCuT0mG2VlQ6GOFW2TdAJqWNBVS5biWb1kOs9RtA4H8rBv110a0Pfpqs4CIINfGQ1WMErHr+niC/KdYmXdhN/1I5lMHy4g2H2D1OiGuwobg7LYm80/aCQpyXi/CRR0RabeV/5vt9jP5liAmVpo+rSeKWkGLLHGjHGLHenbjB73TH/PxaXH9BJbl9qTcyINjlLdcGMjNlF84NtnHz0=
2021-06-03T15:33:35.537 INFO:teuthology.kill:  smithi160.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDWs1VhK/LgDSvM9YR7fLVUJW20nPxzMbDgcP7L4ibJdpB0XjwPX+hz2fcYN6A7+sKq0DZoBlvd0yPAxIZean+4g/Lw8wJdgugzdbfUp3+lSZws4uTUzlsWM19PLW33v9VUu2LZVpAupeDkfksOp9UpZPYPFKwfXg03S6FXInQnoLEryaB6tNtl8sTzDpmVRvOgGOFDSU0y5mQeSjTJgbEgeEba7yV/7OusEv2qKIoYjbbJkRe6VFfDjCOMV9WxdglUpbd6LqOBk3pzJDRKvGe+Yw/rOFOfWcGLbfj/e8nMK1rKN0jal3Bi7KYe9gDaFlIIMdC8MF8LfQ9zaoKsjyqwiSI8Hfe0kn+XnvPDGHmPJN7aZdHPHIHkZ5gQCeSl0WLmnOuhnHmkl6VYYk9c8aEyrE+I0jnr+2Ds857IPIiEqSoBBz/Aifeof/IQoAEpYkWCdyjQOdseN7wowhtg1nNn7PSDb1FkpUbGzwLU5YUh/UeBeM/GEBBBshHRdegvgM=
2021-06-03T15:33:35.556 INFO:teuthology.kill:2021-06-03 15:33:35,555.555 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-06-03T15:33:35.558 INFO:teuthology.kill:2021-06-03 15:33:35,558.558 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-06-03T15:33:35.613 INFO:teuthology.kill:2021-06-03 15:33:35,613.613 INFO:teuthology.orchestra.console:Power off smithi160
2021-06-03T15:33:35.628 INFO:teuthology.kill:2021-06-03 15:33:35,627.627 INFO:teuthology.orchestra.console:Power off smithi118
2021-06-03T15:33:35.756 INFO:teuthology.kill:2021-06-03 15:33:35,755.755 INFO:teuthology.orchestra.console:Power off for smithi160 completed
2021-06-03T15:33:35.767 INFO:teuthology.kill:2021-06-03 15:33:35,767.767 INFO:teuthology.orchestra.console:Power off for smithi118 completed
2021-06-03T15:33:35.894 INFO:teuthology.kill:2021-06-03 15:33:35,893.893 INFO:teuthology.lock.ops:unlocked smithi160.front.sepia.ceph.com
2021-06-03T15:33:35.905 INFO:teuthology.kill:2021-06-03 15:33:35,904.904 INFO:teuthology.lock.ops:unlocked smithi118.front.sepia.ceph.com
2021-06-03T15:35:36.200 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-06-03T15:35:36.276 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-06-03T15:35:36.276 INFO:teuthology.nuke:Checking targets against current locks
2021-06-03T15:35:36.343 INFO:teuthology.nuke:Not nuking smithi118.front.sepia.ceph.com because description doesn't match
2021-06-03T15:35:36.344 INFO:teuthology.nuke:Not nuking smithi160.front.sepia.ceph.com because description doesn't match