2021-03-02T16:56:28.627 INFO:root:teuthology version: 1.1.0-3082387b
2021-03-02T16:56:28.719 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi025.front.sepia.ceph.com' reimaging
2021-03-02T16:56:28.720 INFO:teuthology.lock.ops:Updating [ubuntu@smithi025.front.sepia.ceph.com]: reset os type and version on server
2021-03-02T16:56:28.721 INFO:teuthology.lock.ops:Updating smithi025.front.sepia.ceph.com on lock server
2021-03-02T16:56:28.734 INFO:teuthology.lock.ops:Node 'ubuntu@smithi025.front.sepia.ceph.com' reimaging is complete
2021-03-02T16:56:28.735 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi109.front.sepia.ceph.com' reimaging
2021-03-02T16:56:28.735 INFO:teuthology.lock.ops:Updating [ubuntu@smithi109.front.sepia.ceph.com]: reset os type and version on server
2021-03-02T16:56:28.735 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server
2021-03-02T16:56:28.750 INFO:teuthology.lock.ops:Node 'ubuntu@smithi109.front.sepia.ceph.com' reimaging is complete
2021-03-02T16:56:28.931 INFO:teuthology.provision.fog.smithi025:Scheduling deploy of centos 8.2
2021-03-02T16:56:28.934 INFO:teuthology.provision.fog.smithi109:Scheduling deploy of centos 8.2
2021-03-02T16:56:29.262 INFO:teuthology.orchestra.console:Power off smithi109
2021-03-02T16:56:29.276 INFO:teuthology.orchestra.console:Power off smithi025
2021-03-02T16:56:37.636 INFO:teuthology.orchestra.console:Power off for smithi025 completed
2021-03-02T16:56:37.737 INFO:teuthology.orchestra.console:Power on smithi025
2021-03-02T16:56:41.840 INFO:teuthology.orchestra.console:Power off for smithi109 completed
2021-03-02T16:56:41.942 INFO:teuthology.orchestra.console:Power on smithi109
2021-03-02T16:56:46.191 INFO:teuthology.orchestra.console:Power on for smithi025 completed
2021-03-02T16:56:46.292 INFO:teuthology.provision.fog.smithi025:Waiting for deploy to finish
2021-03-02T16:56:50.304 INFO:teuthology.orchestra.console:Power on for smithi109 completed
2021-03-02T16:56:50.405 INFO:teuthology.provision.fog.smithi109:Waiting for deploy to finish
2021-03-02T17:00:21.392 ERROR:teuthology.orchestra.connection:Error authenticating with smithi109.front.sepia.ceph.com: Authentication timeout.
2021-03-02T17:01:08.423 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-02T17:01:28.698 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-02T17:01:29.003 INFO:teuthology.provision.fog.smithi109:Node is ready
2021-03-02T17:01:29.017 INFO:teuthology.orchestra.run.smithi109.stdout:smithi109.front.sepia.ceph.com
2021-03-02T17:01:29.072 INFO:teuthology.orchestra.run.smithi109.stdout:172.21.15.109 smithi109.front.sepia.ceph.com smithi109
2021-03-02T17:01:29.395 INFO:teuthology.provision.fog.smithi109:Deploy complete!
2021-03-02T17:02:06.154 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-02T17:02:06.484 INFO:teuthology.provision.fog.smithi025:Node is ready
2021-03-02T17:02:06.499 INFO:teuthology.orchestra.run.smithi025.stdout:smithi025.front.sepia.ceph.com
2021-03-02T17:02:06.554 INFO:teuthology.orchestra.run.smithi025.stdout:172.21.15.25 smithi025.front.sepia.ceph.com smithi025
2021-03-02T17:02:06.873 INFO:teuthology.provision.fog.smithi025:Deploy complete!
2021-03-02T17:02:07.004 INFO:teuthology.lock.ops:Checking smithi025.front.sepia.ceph.com
2021-03-02T17:02:07.005 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-02T17:02:07.022 INFO:teuthology.lock.ops:Checking smithi109.front.sepia.ceph.com
2021-03-02T17:02:07.022 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-02T17:02:07.038 INFO:teuthology.lock.ops:Updating [smithi025.front.sepia.ceph.com]: set os type and version on server
2021-03-02T17:02:07.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-02T17:02:07.248 INFO:teuthology.orchestra.run.smithi025.stdout:x86_64
2021-03-02T17:02:07.302 INFO:teuthology.orchestra.run.smithi025.stdout:NAME="CentOS Linux"
2021-03-02T17:02:07.302 INFO:teuthology.orchestra.run.smithi025.stdout:VERSION="8 (Core)"
2021-03-02T17:02:07.303 INFO:teuthology.orchestra.run.smithi025.stdout:ID="centos"
2021-03-02T17:02:07.303 INFO:teuthology.orchestra.run.smithi025.stdout:ID_LIKE="rhel fedora"
2021-03-02T17:02:07.303 INFO:teuthology.orchestra.run.smithi025.stdout:VERSION_ID="8"
2021-03-02T17:02:07.304 INFO:teuthology.orchestra.run.smithi025.stdout:PLATFORM_ID="platform:el8"
2021-03-02T17:02:07.304 INFO:teuthology.orchestra.run.smithi025.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-03-02T17:02:07.304 INFO:teuthology.orchestra.run.smithi025.stdout:ANSI_COLOR="0;31"
2021-03-02T17:02:07.304 INFO:teuthology.orchestra.run.smithi025.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-02T17:02:07.304 INFO:teuthology.orchestra.run.smithi025.stdout:HOME_URL="https://www.centos.org/"
2021-03-02T17:02:07.305 INFO:teuthology.orchestra.run.smithi025.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-02T17:02:07.305 INFO:teuthology.orchestra.run.smithi025.stdout:
2021-03-02T17:02:07.305 INFO:teuthology.orchestra.run.smithi025.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-02T17:02:07.305 INFO:teuthology.orchestra.run.smithi025.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-02T17:02:07.306 INFO:teuthology.orchestra.run.smithi025.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-03-02T17:02:07.306 INFO:teuthology.orchestra.run.smithi025.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-03-02T17:02:07.306 INFO:teuthology.orchestra.run.smithi025.stdout:
2021-03-02T17:02:07.307 INFO:teuthology.lock.ops:Updating smithi025.front.sepia.ceph.com on lock server
2021-03-02T17:02:07.325 INFO:teuthology.lock.ops:Updating [smithi109.front.sepia.ceph.com]: set os type and version on server
2021-03-02T17:02:07.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-02T17:02:07.602 INFO:teuthology.orchestra.run.smithi109.stdout:x86_64
2021-03-02T17:02:07.655 INFO:teuthology.orchestra.run.smithi109.stdout:NAME="CentOS Linux"
2021-03-02T17:02:07.656 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION="8 (Core)"
2021-03-02T17:02:07.656 INFO:teuthology.orchestra.run.smithi109.stdout:ID="centos"
2021-03-02T17:02:07.657 INFO:teuthology.orchestra.run.smithi109.stdout:ID_LIKE="rhel fedora"
2021-03-02T17:02:07.657 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION_ID="8"
2021-03-02T17:02:07.657 INFO:teuthology.orchestra.run.smithi109.stdout:PLATFORM_ID="platform:el8"
2021-03-02T17:02:07.657 INFO:teuthology.orchestra.run.smithi109.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-03-02T17:02:07.657 INFO:teuthology.orchestra.run.smithi109.stdout:ANSI_COLOR="0;31"
2021-03-02T17:02:07.658 INFO:teuthology.orchestra.run.smithi109.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-02T17:02:07.658 INFO:teuthology.orchestra.run.smithi109.stdout:HOME_URL="https://www.centos.org/"
2021-03-02T17:02:07.658 INFO:teuthology.orchestra.run.smithi109.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-02T17:02:07.658 INFO:teuthology.orchestra.run.smithi109.stdout:
2021-03-02T17:02:07.659 INFO:teuthology.orchestra.run.smithi109.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-02T17:02:07.659 INFO:teuthology.orchestra.run.smithi109.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-02T17:02:07.659 INFO:teuthology.orchestra.run.smithi109.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-03-02T17:02:07.659 INFO:teuthology.orchestra.run.smithi109.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-03-02T17:02:07.659 INFO:teuthology.orchestra.run.smithi109.stdout:
2021-03-02T17:02:07.660 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server
2021-03-02T17:02:07.743 INFO:teuthology.dispatcher.supervisor:Running job 5927505
2021-03-02T17:02:07.743 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-03-02_16:43:57-upgrade:octopus-x:parallel-wip-sage-testing-2021-03-01-1118-distro-basic-smithi/5927505 --name sage-2021-03-02_16:43:57-upgrade:octopus-x:parallel-wip-sage-testing-2021-03-01-1118-distro-basic-smithi --description upgrade:octopus-x:parallel/{0-start 1-tasks distro1$/{centos_latest} mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} -- /home/teuthworker/archive/sage-2021-03-02_16:43:57-upgrade:octopus-x:parallel-wip-sage-testing-2021-03-01-1118-distro-basic-smithi/5927505/orig.config.yaml
2021-03-02T17:02:07.747 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-03-02_16:43:57-upgrade:octopus-x:parallel-wip-sage-testing-2021-03-01-1118-distro-basic-smithi/5927505
2021-03-02T17:02:07.748 INFO:teuthology.dispatcher.supervisor:Job PID: 4580
2021-03-02T17:02:07.748 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-03T05:02:57.735 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-03-03T05:02:57.955 INFO:teuthology.kill:Killing Pids: {4580}
2021-03-03T05:03:00.139 INFO:teuthology.kill:Nuking machines: ['smithi025', 'smithi109']
2021-03-03T05:03:01.921 INFO:teuthology.kill:2021-03-03 05:03:01,920.920 INFO:teuthology.nuke:targets:
2021-03-03T05:03:01.922 INFO:teuthology.kill:  smithi025.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8psiEf818QHQduM37wvyJ4l6O99mIeS3wkA2/7xC5nBfN5Mbwnx9nZ6fiTzuU0HV5gqWywF8QftcEBn0jEMnPImIg/lEoRJmRIN2CuHINW1qQv3K0hjJZx8eytE+rp6/RaKtuhkViKpuOwY5R412OMqcqiAngypN6GmOzV57avBFIHmAMb95iFY3IeGb1YWWaf8ypKDFEk5/YKzEjiGC0rrLmZLKr17wrGZIHDYcCymhP2SyY4HhrFxZbxh1SubCdINdkFcrZMNBvJ/5InOvfN3Jzq091iaglBdoBAfpNMbGzkA/grbJIsf6iFA4vgeH5n4YpcRH0fX4zBWkHGBNddRRZTstoOZKA4iaAyC4c1IIMptkaaCkUNpvlMPji4ZjLvuCmlGx6kEIQurj9funXn3wTvW1X/q1uqoUCYLEU0slz/fZryinwur+QslKfD7C4ELSjE/lbO/LB+s/eJu0mcWYcA6Aypmkv5dr4Ajy21CdQ+oVdL/S7mhN8nY/+rlE=
2021-03-03T05:03:01.931 INFO:teuthology.kill:  smithi109.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5FVeXFZOAG4neSNm+GinpJ3d7gRECHexe2kEUu/i+T3Lh6I+z30CLaSP1mfhTAlewhNSiFBzKttLb1tCTRavu5dvhOcOiJKBtaonH/k+dAOG6y+ahPjL5znA8ZwwyOcK9RkS+DYEUiJhs3wUzCYolWPnYS7PjeyWCPmaHveRWlDBHm9KBGRC2LJzxNOfPf7QQ+QhrofC9NIY6AZYjdW8HqMIUx+He+ZjrTbH0F/3b/oFa1GrS5b6HQJVVOu3G9wlF//P/0IQ0hLol5LfSJI4b0b73L/lqgBGg835LvjDV7JgXIXicMrNz7tRxc2EcP5p1jK1M0CkQGlVUmT50ga+V7aC4+ISzplH23WPxdg7IIChqSW5Nk9aqRpnpplnLQHGHoixAc0RLJ3cRItB92gO/zYArXWz3n7fWTazXx2l0RMa9keaiiUDny3AwavZC6bKV/aqpEpXPjM9YIkLYLOOrITNLZta8W/GXmNAxc5y39OeowhB/2JSmmgUd2EuqDZk=
2021-03-03T05:03:01.931 INFO:teuthology.kill:2021-03-03 05:03:01,921.921 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-03T05:03:01.932 INFO:teuthology.kill:2021-03-03 05:03:01,931.931 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-03T05:03:02.014 INFO:teuthology.kill:2021-03-03 05:03:02,013.013 INFO:teuthology.orchestra.console:Power off smithi025
2021-03-03T05:03:02.035 INFO:teuthology.kill:2021-03-03 05:03:02,034.034 INFO:teuthology.orchestra.console:Power off smithi109
2021-03-03T05:03:10.457 INFO:teuthology.kill:2021-03-03 05:03:10,457.457 INFO:teuthology.orchestra.console:Power off for smithi025 completed
2021-03-03T05:03:14.694 INFO:teuthology.kill:2021-03-03 05:03:14,694.694 INFO:teuthology.orchestra.console:Power off for smithi109 completed
2021-03-03T05:03:14.995 INFO:teuthology.task.internal:roles: ubuntu@smithi025.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2021-03-03T05:03:14.996 INFO:teuthology.task.internal:roles: ubuntu@smithi109.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2021-03-03T05:03:14.996 INFO:teuthology.misc:Compressing logs...
2021-03-03T05:03:14.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-03T05:04:15.060 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-03-03T05:04:15.145 INFO:teuthology.kill:No teuthology processes running
2021-03-03T05:04:17.974 INFO:teuthology.kill:Nuking machines: ['smithi025', 'smithi109']
2021-03-03T05:04:20.230 INFO:teuthology.kill:2021-03-03 05:04:20,229.229 INFO:teuthology.nuke:targets:
2021-03-03T05:04:20.233 INFO:teuthology.kill:  smithi025.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8psiEf818QHQduM37wvyJ4l6O99mIeS3wkA2/7xC5nBfN5Mbwnx9nZ6fiTzuU0HV5gqWywF8QftcEBn0jEMnPImIg/lEoRJmRIN2CuHINW1qQv3K0hjJZx8eytE+rp6/RaKtuhkViKpuOwY5R412OMqcqiAngypN6GmOzV57avBFIHmAMb95iFY3IeGb1YWWaf8ypKDFEk5/YKzEjiGC0rrLmZLKr17wrGZIHDYcCymhP2SyY4HhrFxZbxh1SubCdINdkFcrZMNBvJ/5InOvfN3Jzq091iaglBdoBAfpNMbGzkA/grbJIsf6iFA4vgeH5n4YpcRH0fX4zBWkHGBNddRRZTstoOZKA4iaAyC4c1IIMptkaaCkUNpvlMPji4ZjLvuCmlGx6kEIQurj9funXn3wTvW1X/q1uqoUCYLEU0slz/fZryinwur+QslKfD7C4ELSjE/lbO/LB+s/eJu0mcWYcA6Aypmkv5dr4Ajy21CdQ+oVdL/S7mhN8nY/+rlE=
2021-03-03T05:04:20.234 INFO:teuthology.kill:  smithi109.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5FVeXFZOAG4neSNm+GinpJ3d7gRECHexe2kEUu/i+T3Lh6I+z30CLaSP1mfhTAlewhNSiFBzKttLb1tCTRavu5dvhOcOiJKBtaonH/k+dAOG6y+ahPjL5znA8ZwwyOcK9RkS+DYEUiJhs3wUzCYolWPnYS7PjeyWCPmaHveRWlDBHm9KBGRC2LJzxNOfPf7QQ+QhrofC9NIY6AZYjdW8HqMIUx+He+ZjrTbH0F/3b/oFa1GrS5b6HQJVVOu3G9wlF//P/0IQ0hLol5LfSJI4b0b73L/lqgBGg835LvjDV7JgXIXicMrNz7tRxc2EcP5p1jK1M0CkQGlVUmT50ga+V7aC4+ISzplH23WPxdg7IIChqSW5Nk9aqRpnpplnLQHGHoixAc0RLJ3cRItB92gO/zYArXWz3n7fWTazXx2l0RMa9keaiiUDny3AwavZC6bKV/aqpEpXPjM9YIkLYLOOrITNLZta8W/GXmNAxc5y39OeowhB/2JSmmgUd2EuqDZk=
2021-03-03T05:04:20.254 INFO:teuthology.kill:2021-03-03 05:04:20,254.254 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-03T05:04:20.258 INFO:teuthology.kill:2021-03-03 05:04:20,258.258 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-03T05:04:20.337 INFO:teuthology.kill:2021-03-03 05:04:20,337.337 INFO:teuthology.orchestra.console:Power off smithi025
2021-03-03T05:04:20.357 INFO:teuthology.kill:2021-03-03 05:04:20,357.357 INFO:teuthology.orchestra.console:Power off smithi109
2021-03-03T05:04:20.527 INFO:teuthology.kill:2021-03-03 05:04:20,526.526 INFO:teuthology.orchestra.console:Power off for smithi025 completed
2021-03-03T05:04:20.537 INFO:teuthology.kill:2021-03-03 05:04:20,536.536 INFO:teuthology.orchestra.console:Power off for smithi109 completed
2021-03-03T05:04:20.686 INFO:teuthology.kill:2021-03-03 05:04:20,685.685 INFO:teuthology.lock.ops:unlocked smithi025.front.sepia.ceph.com
2021-03-03T05:04:20.707 INFO:teuthology.kill:2021-03-03 05:04:20,706.706 INFO:teuthology.lock.ops:unlocked smithi109.front.sepia.ceph.com
2021-03-03T05:06:21.084 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-03T05:06:21.218 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-03T05:06:21.219 INFO:teuthology.nuke:Checking targets against current locks
2021-03-03T05:06:21.306 INFO:teuthology.nuke:Not nuking smithi109.front.sepia.ceph.com because description doesn't match
2021-03-03T05:06:21.306 INFO:teuthology.nuke:Not nuking smithi025.front.sepia.ceph.com because description doesn't match