2021-03-26T21:07:51.936 INFO:root:teuthology version: 1.1.0-d5a60f86
2021-03-26T21:07:52.033 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi079.front.sepia.ceph.com' reimaging
2021-03-26T21:07:52.033 INFO:teuthology.lock.ops:Updating [ubuntu@smithi079.front.sepia.ceph.com]: reset os type and version on server
2021-03-26T21:07:52.033 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2021-03-26T21:07:52.048 INFO:teuthology.lock.ops:Node 'ubuntu@smithi079.front.sepia.ceph.com' reimaging is complete
2021-03-26T21:07:52.048 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi084.front.sepia.ceph.com' reimaging
2021-03-26T21:07:52.048 INFO:teuthology.lock.ops:Updating [ubuntu@smithi084.front.sepia.ceph.com]: reset os type and version on server
2021-03-26T21:07:52.048 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2021-03-26T21:07:52.065 INFO:teuthology.lock.ops:Node 'ubuntu@smithi084.front.sepia.ceph.com' reimaging is complete
2021-03-26T21:07:52.251 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 8.3
2021-03-26T21:07:52.272 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 8.3
2021-03-26T21:07:52.543 INFO:teuthology.orchestra.console:Power off smithi079
2021-03-26T21:07:52.716 INFO:teuthology.orchestra.console:Power off smithi084
2021-03-26T21:08:05.024 INFO:teuthology.orchestra.console:Power off for smithi079 completed
2021-03-26T21:08:05.126 INFO:teuthology.orchestra.console:Power on smithi079
2021-03-26T21:08:05.187 INFO:teuthology.orchestra.console:Power off for smithi084 completed
2021-03-26T21:08:05.288 INFO:teuthology.orchestra.console:Power on smithi084
2021-03-26T21:08:09.538 INFO:teuthology.orchestra.console:Power on for smithi084 completed
2021-03-26T21:08:09.638 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish
2021-03-26T21:08:13.509 INFO:teuthology.orchestra.console:Power on for smithi079 completed
2021-03-26T21:08:13.610 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish
2021-03-26T21:10:40.965 ERROR:teuthology.orchestra.connection:Error authenticating with smithi084.front.sepia.ceph.com: Authentication failed.
2021-03-26T21:12:21.832 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-26T21:12:37.129 INFO:teuthology.provision.fog.smithi084:Node is ready
2021-03-26T21:12:37.147 INFO:teuthology.orchestra.run.smithi084.stdout:smithi012
2021-03-26T21:12:37.204 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012
2021-03-26T21:12:37.585 INFO:teuthology.provision.fog.smithi084:Deploy complete!
2021-03-26T21:12:45.357 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-26T21:12:45.663 INFO:teuthology.provision.fog.smithi079:Node is ready
2021-03-26T21:12:45.677 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com
2021-03-26T21:12:45.732 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079
2021-03-26T21:12:46.052 INFO:teuthology.provision.fog.smithi079:Deploy complete!
2021-03-26T21:12:46.184 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com
2021-03-26T21:12:46.185 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-26T21:12:46.204 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com
2021-03-26T21:12:46.205 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-26T21:12:46.219 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server
2021-03-26T21:12:46.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-26T21:12:46.494 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64
2021-03-26T21:12:46.548 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Linux"
2021-03-26T21:12:46.548 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8"
2021-03-26T21:12:46.548 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos"
2021-03-26T21:12:46.549 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora"
2021-03-26T21:12:46.549 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8"
2021-03-26T21:12:46.549 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8"
2021-03-26T21:12:46.549 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Linux 8"
2021-03-26T21:12:46.549 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2021-03-26T21:12:46.549 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-26T21:12:46.549 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/"
2021-03-26T21:12:46.549 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-26T21:12:46.549 INFO:teuthology.orchestra.run.smithi079.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-26T21:12:46.549 INFO:teuthology.orchestra.run.smithi079.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-26T21:12:46.550 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2021-03-26T21:12:46.566 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server
2021-03-26T21:12:46.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-26T21:12:46.847 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64
2021-03-26T21:12:46.901 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Linux"
2021-03-26T21:12:46.901 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8"
2021-03-26T21:12:46.902 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos"
2021-03-26T21:12:46.902 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora"
2021-03-26T21:12:46.902 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8"
2021-03-26T21:12:46.902 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8"
2021-03-26T21:12:46.902 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Linux 8"
2021-03-26T21:12:46.902 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31"
2021-03-26T21:12:46.902 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-26T21:12:46.902 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/"
2021-03-26T21:12:46.902 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-26T21:12:46.902 INFO:teuthology.orchestra.run.smithi084.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-26T21:12:46.902 INFO:teuthology.orchestra.run.smithi084.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-26T21:12:46.903 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2021-03-26T21:12:46.986 INFO:teuthology.dispatcher.supervisor:Running job 6002357
2021-03-26T21:12:46.986 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-03-26_20:15:38-rados-wip-sage3-testing-e-2021-03-26-1228-distro-basic-smithi/6002357 --name sage-2021-03-26_20:15:38-rados-wip-sage3-testing-e-2021-03-26-1228-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench} -- /home/teuthworker/archive/sage-2021-03-26_20:15:38-rados-wip-sage3-testing-e-2021-03-26-1228-distro-basic-smithi/6002357/orig.config.yaml
2021-03-26T21:12:46.991 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-03-26_20:15:38-rados-wip-sage3-testing-e-2021-03-26-1228-distro-basic-smithi/6002357
2021-03-26T21:12:46.992 INFO:teuthology.dispatcher.supervisor:Job PID: 31302
2021-03-26T21:12:46.992 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-27T09:13:01.252 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-03-27T09:13:01.496 INFO:teuthology.kill:Killing Pids: {31302}
2021-03-27T09:13:03.032 INFO:teuthology.kill:Nuking machines: ['smithi079', 'smithi084']
2021-03-27T09:13:03.984 INFO:teuthology.kill:2021-03-27 09:13:03,983.983 INFO:teuthology.nuke:targets:
2021-03-27T09:13:03.984 INFO:teuthology.kill:  smithi079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6spk1kUTUEPOLBdfaE4vKxAN5DpuvjoacEFJ0mMZ07wn6fe0MyyxG8GC6P3EkMb2jx2je/NLoYBEwb94ro9lqN6Nf+xC5PHubIdpMRDbEwtefq34h3ijGysVcVdjqFOmNe8kfsVoWEuJuXCk+vVlpNeKta8Cd8AekH5Bc+Qy69qc3ql1RSzSzkJzktRqhMcDqCsRNoS8JWct71A9NwsatQdLwwAOYdpBrPlgXmfj7OZ0EqieFwJUUtnY+FtJgiv7TSHYFQ0jeO4VToGL3pU9GOfRc0CHBdJ9VgTLs3Anst57/pBI+AcVBfoA9xGOJmTcR0TmtKapKnKndMlMJBwRH/l176eQAqqvLLbgOhD54bNM28sFyRVxlzlo3qwgWUejKHmhm2ZZaqpylfPDXnbUwBe8ml2Oapz6QhrAmCiloWYuJI/81AUrToxuopysSSf9NUSZBRqTAIXULOIzixNW7x2K/Otc9sneRHX4FpMQWSsuLiz3aERmEklaMAKHyoAM=
2021-03-27T09:13:03.984 INFO:teuthology.kill:  smithi084.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmNZH+uO0y5TkT1xOA3FSm37ov+yxAPkev8+ZOdbxZjZbM/11PMCm51A5OWUxWv1KLBpYWDg26tK7hWVl7qwYCQCPLFBzYb8x8aS/pZjnyCPMU5mfbmHkCTl7cvtMZEPnumo4YQAsSuAQ+mnGb2w43YRGTj6DTOBJjjmVRPLcxtiY/1K4GlHkE+nFyfBK1r3fe6SJPTSWTdsAZ48woYroryJih8E3KPJnLRxh018h3J+2Zsu0kJYf8RQRqiXxdXjQz6yIsZoSaUYkef/n3CsJjmYOhwBx8gBfJoYMhAw8yJy+Ox260/uIlwDUVKXt4YD8sEQW0/VLVCg0tuJDMVFR5DS7OTUJaSHrTMbDbHrFKR3zQM3j6cIQBuj65gabHjH+iP/Zg9OO+GpZ+81byZZhq24AbwQElHC07Lv4bvRy0V3RNOBb97VE3D167Qv6FJ4egiLmut5rJswtevcGA6WI4CUNMdcaHAi8ycezhuM5ryNfwk/iJoZS5wmve1zdZxik=
2021-03-27T09:13:03.984 INFO:teuthology.kill:2021-03-27 09:13:03,984.984 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-27T09:13:03.987 INFO:teuthology.kill:2021-03-27 09:13:03,986.986 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-27T09:13:04.063 INFO:teuthology.kill:2021-03-27 09:13:04,063.063 INFO:teuthology.orchestra.console:Power off smithi079
2021-03-27T09:13:04.080 INFO:teuthology.kill:2021-03-27 09:13:04,080.080 INFO:teuthology.orchestra.console:Power off smithi084
2021-03-27T09:13:16.553 INFO:teuthology.kill:2021-03-27 09:13:16,552.552 INFO:teuthology.orchestra.console:Power off for smithi079 completed
2021-03-27T09:13:16.562 INFO:teuthology.kill:2021-03-27 09:13:16,561.561 INFO:teuthology.orchestra.console:Power off for smithi084 completed
2021-03-27T09:13:16.849 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-03-27T09:13:16.849 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-03-27T09:13:16.849 INFO:teuthology.misc:Compressing logs...
2021-03-27T09:13:16.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-27T09:13:51.500 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-03-27T09:13:51.569 INFO:teuthology.kill:No teuthology processes running
2021-03-27T09:13:52.679 INFO:teuthology.kill:Nuking machines: ['smithi079', 'smithi084']
2021-03-27T09:13:53.594 INFO:teuthology.kill:2021-03-27 09:13:53,593.593 INFO:teuthology.nuke:targets:
2021-03-27T09:13:53.594 INFO:teuthology.kill:  smithi079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6spk1kUTUEPOLBdfaE4vKxAN5DpuvjoacEFJ0mMZ07wn6fe0MyyxG8GC6P3EkMb2jx2je/NLoYBEwb94ro9lqN6Nf+xC5PHubIdpMRDbEwtefq34h3ijGysVcVdjqFOmNe8kfsVoWEuJuXCk+vVlpNeKta8Cd8AekH5Bc+Qy69qc3ql1RSzSzkJzktRqhMcDqCsRNoS8JWct71A9NwsatQdLwwAOYdpBrPlgXmfj7OZ0EqieFwJUUtnY+FtJgiv7TSHYFQ0jeO4VToGL3pU9GOfRc0CHBdJ9VgTLs3Anst57/pBI+AcVBfoA9xGOJmTcR0TmtKapKnKndMlMJBwRH/l176eQAqqvLLbgOhD54bNM28sFyRVxlzlo3qwgWUejKHmhm2ZZaqpylfPDXnbUwBe8ml2Oapz6QhrAmCiloWYuJI/81AUrToxuopysSSf9NUSZBRqTAIXULOIzixNW7x2K/Otc9sneRHX4FpMQWSsuLiz3aERmEklaMAKHyoAM=
2021-03-27T09:13:53.594 INFO:teuthology.kill:  smithi084.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmNZH+uO0y5TkT1xOA3FSm37ov+yxAPkev8+ZOdbxZjZbM/11PMCm51A5OWUxWv1KLBpYWDg26tK7hWVl7qwYCQCPLFBzYb8x8aS/pZjnyCPMU5mfbmHkCTl7cvtMZEPnumo4YQAsSuAQ+mnGb2w43YRGTj6DTOBJjjmVRPLcxtiY/1K4GlHkE+nFyfBK1r3fe6SJPTSWTdsAZ48woYroryJih8E3KPJnLRxh018h3J+2Zsu0kJYf8RQRqiXxdXjQz6yIsZoSaUYkef/n3CsJjmYOhwBx8gBfJoYMhAw8yJy+Ox260/uIlwDUVKXt4YD8sEQW0/VLVCg0tuJDMVFR5DS7OTUJaSHrTMbDbHrFKR3zQM3j6cIQBuj65gabHjH+iP/Zg9OO+GpZ+81byZZhq24AbwQElHC07Lv4bvRy0V3RNOBb97VE3D167Qv6FJ4egiLmut5rJswtevcGA6WI4CUNMdcaHAi8ycezhuM5ryNfwk/iJoZS5wmve1zdZxik=
2021-03-27T09:13:53.616 INFO:teuthology.kill:2021-03-27 09:13:53,616.616 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-27T09:13:53.628 INFO:teuthology.kill:2021-03-27 09:13:53,628.628 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-27T09:13:53.692 INFO:teuthology.kill:2021-03-27 09:13:53,691.691 INFO:teuthology.orchestra.console:Power off smithi079
2021-03-27T09:13:53.704 INFO:teuthology.kill:2021-03-27 09:13:53,703.703 INFO:teuthology.orchestra.console:Power off smithi084
2021-03-27T09:13:53.830 INFO:teuthology.kill:2021-03-27 09:13:53,830.830 INFO:teuthology.orchestra.console:Power off for smithi079 completed
2021-03-27T09:13:53.841 INFO:teuthology.kill:2021-03-27 09:13:53,841.841 INFO:teuthology.orchestra.console:Power off for smithi084 completed
2021-03-27T09:13:53.981 INFO:teuthology.kill:2021-03-27 09:13:53,980.980 INFO:teuthology.lock.ops:unlocked smithi079.front.sepia.ceph.com
2021-03-27T09:13:53.996 INFO:teuthology.kill:2021-03-27 09:13:53,995.995 INFO:teuthology.lock.ops:unlocked smithi084.front.sepia.ceph.com
2021-03-27T09:15:54.197 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-27T09:15:54.318 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-27T09:15:54.319 INFO:teuthology.nuke:Checking targets against current locks
2021-03-27T09:15:54.412 INFO:teuthology.nuke:Not nuking smithi079.front.sepia.ceph.com because description doesn't match
2021-03-27T09:15:54.412 INFO:teuthology.nuke:Not nuking smithi084.front.sepia.ceph.com because description doesn't match