2021-03-06T17:56:53.854 INFO:root:teuthology version: 1.1.0-3082387b
2021-03-06T17:56:53.965 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi117.front.sepia.ceph.com' reimaging
2021-03-06T17:56:53.966 INFO:teuthology.lock.ops:Updating [ubuntu@smithi117.front.sepia.ceph.com]: reset os type and version on server
2021-03-06T17:56:53.966 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2021-03-06T17:56:53.981 INFO:teuthology.lock.ops:Node 'ubuntu@smithi117.front.sepia.ceph.com' reimaging is complete
2021-03-06T17:56:53.981 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi129.front.sepia.ceph.com' reimaging
2021-03-06T17:56:53.982 INFO:teuthology.lock.ops:Updating [ubuntu@smithi129.front.sepia.ceph.com]: reset os type and version on server
2021-03-06T17:56:53.982 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server
2021-03-06T17:56:53.997 INFO:teuthology.lock.ops:Node 'ubuntu@smithi129.front.sepia.ceph.com' reimaging is complete
2021-03-06T17:56:54.189 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of centos 8.2
2021-03-06T17:56:54.196 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 8.2
2021-03-06T17:56:54.562 INFO:teuthology.orchestra.console:Power off smithi129
2021-03-06T17:56:54.575 INFO:teuthology.orchestra.console:Power off smithi117
2021-03-06T17:57:02.952 INFO:teuthology.orchestra.console:Power off for smithi129 completed
2021-03-06T17:57:02.963 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2021-03-06T17:57:03.054 INFO:teuthology.orchestra.console:Power on smithi129
2021-03-06T17:57:03.064 INFO:teuthology.orchestra.console:Power on smithi117
2021-03-06T17:57:07.337 INFO:teuthology.orchestra.console:Power on for smithi129 completed
2021-03-06T17:57:07.438 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish
2021-03-06T17:57:11.462 INFO:teuthology.orchestra.console:Power on for smithi117 completed
2021-03-06T17:57:11.564 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish
2021-03-06T18:01:17.996 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-06T18:01:37.993 INFO:teuthology.provision.fog.smithi117:Node is ready
2021-03-06T18:01:38.012 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com
2021-03-06T18:01:38.068 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117
2021-03-06T18:01:38.420 INFO:teuthology.provision.fog.smithi117:Deploy complete!
2021-03-06T18:01:39.396 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-06T18:01:39.682 INFO:teuthology.provision.fog.smithi129:Node is ready
2021-03-06T18:01:39.695 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com
2021-03-06T18:01:39.753 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129
2021-03-06T18:01:40.097 INFO:teuthology.provision.fog.smithi129:Deploy complete!
2021-03-06T18:01:40.287 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com
2021-03-06T18:01:40.288 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-06T18:01:40.303 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com
2021-03-06T18:01:40.304 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-06T18:01:40.320 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server
2021-03-06T18:01:40.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-06T18:01:40.600 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64
2021-03-06T18:01:40.655 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Linux"
2021-03-06T18:01:40.655 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8 (Core)"
2021-03-06T18:01:40.655 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos"
2021-03-06T18:01:40.656 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora"
2021-03-06T18:01:40.656 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8"
2021-03-06T18:01:40.656 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8"
2021-03-06T18:01:40.656 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-03-06T18:01:40.657 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2021-03-06T18:01:40.657 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-06T18:01:40.657 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.centos.org/"
2021-03-06T18:01:40.657 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-06T18:01:40.657 INFO:teuthology.orchestra.run.smithi117.stdout:
2021-03-06T18:01:40.658 INFO:teuthology.orchestra.run.smithi117.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-06T18:01:40.658 INFO:teuthology.orchestra.run.smithi117.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-06T18:01:40.658 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-03-06T18:01:40.659 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-03-06T18:01:40.659 INFO:teuthology.orchestra.run.smithi117.stdout:
2021-03-06T18:01:40.660 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2021-03-06T18:01:40.676 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server
2021-03-06T18:01:40.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-06T18:01:40.945 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64
2021-03-06T18:01:41.004 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Linux"
2021-03-06T18:01:41.004 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8 (Core)"
2021-03-06T18:01:41.005 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos"
2021-03-06T18:01:41.005 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora"
2021-03-06T18:01:41.005 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8"
2021-03-06T18:01:41.005 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8"
2021-03-06T18:01:41.005 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-03-06T18:01:41.006 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31"
2021-03-06T18:01:41.006 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-06T18:01:41.006 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.centos.org/"
2021-03-06T18:01:41.006 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-06T18:01:41.007 INFO:teuthology.orchestra.run.smithi129.stdout:
2021-03-06T18:01:41.007 INFO:teuthology.orchestra.run.smithi129.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-06T18:01:41.007 INFO:teuthology.orchestra.run.smithi129.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-06T18:01:41.007 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-03-06T18:01:41.007 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-03-06T18:01:41.008 INFO:teuthology.orchestra.run.smithi129.stdout:
2021-03-06T18:01:41.008 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server
2021-03-06T18:01:41.108 INFO:teuthology.dispatcher.supervisor:Running job 5942397
2021-03-06T18:01:41.108 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-03-06_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5942397 --name teuthology-2021-03-06_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi --description upgrade:octopus-x/stress-split/{0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export distro$/{centos_latest} mon_election/classic} -- /home/teuthworker/archive/teuthology-2021-03-06_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5942397/orig.config.yaml
2021-03-06T18:01:41.117 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-03-06_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5942397
2021-03-06T18:01:41.118 INFO:teuthology.dispatcher.supervisor:Job PID: 18663
2021-03-06T18:01:41.118 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-07T06:02:31.839 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-03-07T06:02:32.129 INFO:teuthology.kill:Killing Pids: {18663}
2021-03-07T06:02:34.902 INFO:teuthology.kill:Nuking machines: ['smithi117', 'smithi129']
2021-03-07T06:02:37.331 INFO:teuthology.kill:2021-03-07 06:02:37,330.330 INFO:teuthology.nuke:targets:
2021-03-07T06:02:37.335 INFO:teuthology.kill:  smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEyT6at/J7mSwGyKUo9OJDQpD2raTzQu0XaxZrr8YJTgCksBjY453WtdOz3wQFtK8AEK4O6l5X5w7ky3/Z/uHAeYJWG1/WZKc0jO+wLaA087O7eeD+sY+oHf1bhloqtTsBVwAzv2n3ITxs1stUrT3C+6ZF4/wRyhwsn4FCGFdPk6Jsm0G2GOPtn3+SRgFcdd30N9timxDneXpUdqV0s+1+V/rN5TJyFqhCMrB+s88lZxM/5pB1kWKA+yIKv4KuHydFLqN+FmmztjPuM3J0UhqYvAOKjtHRpXO5pWwIrpcEj4HHereovCaV8mae1tXgcwi9igfCo219Vh/llIuxIB2mmwTNmWxom90BwkEXe25S8t7bMOE5EriW05KkH4vBTtZOxhBMBGIfmUN5VZNSdnBXOjo+0N9odGdhTAl2DE6lHhbIpWzIvWZsWTKWhV0Y4urb+Cl7JUrfCG+zxyI87uJl4xkIMzkMpp/33MT228xJOANuCV6C9b8YxDVckSFkgz0=
2021-03-07T06:02:37.335 INFO:teuthology.kill:  smithi129.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNTcZEGKRMthk45fJ2Sj693upA00mMhqMyKS2T7I9uHnScweUvGCuH0UM0HVFiaFoOaSDWFTvZ+eJcGxEUM25sti1v+Rbs91JW5VHfbNKNNvGPktmTkSpmLkshSPGtdBWVM2ACgYVuo0oYE/06BNkHaYt/DOmrRcssXtP/4sjyDH+UhLoPo1UbeGLmX2qEUdCixNWc3xG/yXTi8Lo69k6sBoJcJOk4tNV9ZcJWl6a9FJEmEaKgDfcm75z4umUcKRi0fEEQ3XTLBRP3f//689CbCok6D7wuiou2eGtRu/IBiConH4XtyCaXWBQf7fP5mMqlhSdA9HdpW1+8sDR7JBzpUFR9bQ7JH/UsY9kvndQ84u0vkyUBfXjZGPFrntPhkHLGGdTyYspxXhu9eUZ2/Pa//HM1/zRir7sKpW53VMSo8CDYqmvbwGEpONnchlmFrph5XgcswzAI7NheF0Vvyu3AdDOg86b45P/mGQHC5jzJMXAjwq1Na2Fj+P6AcAKnync=
2021-03-07T06:02:37.336 INFO:teuthology.kill:2021-03-07 06:02:37,331.331 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-07T06:02:37.337 INFO:teuthology.kill:2021-03-07 06:02:37,336.336 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-07T06:02:37.421 INFO:teuthology.kill:2021-03-07 06:02:37,420.420 INFO:teuthology.orchestra.console:Power off smithi117
2021-03-07T06:02:37.444 INFO:teuthology.kill:2021-03-07 06:02:37,444.444 INFO:teuthology.orchestra.console:Power off smithi129
2021-03-07T06:02:45.890 INFO:teuthology.kill:2021-03-07 06:02:45,889.889 INFO:teuthology.orchestra.console:Power off for smithi129 completed
2021-03-07T06:02:45.914 INFO:teuthology.kill:2021-03-07 06:02:45,914.914 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2021-03-07T06:02:46.260 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2021-03-07T06:02:46.261 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2021-03-07T06:02:46.261 INFO:teuthology.misc:Compressing logs...
2021-03-07T06:02:46.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-07T06:03:20.899 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-03-07T06:03:20.984 INFO:teuthology.kill:No teuthology processes running
2021-03-07T06:03:22.684 INFO:teuthology.kill:Nuking machines: ['smithi117', 'smithi129']
2021-03-07T06:03:23.972 INFO:teuthology.kill:2021-03-07 06:03:23,972.972 INFO:teuthology.nuke:targets:
2021-03-07T06:03:23.975 INFO:teuthology.kill:  smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEyT6at/J7mSwGyKUo9OJDQpD2raTzQu0XaxZrr8YJTgCksBjY453WtdOz3wQFtK8AEK4O6l5X5w7ky3/Z/uHAeYJWG1/WZKc0jO+wLaA087O7eeD+sY+oHf1bhloqtTsBVwAzv2n3ITxs1stUrT3C+6ZF4/wRyhwsn4FCGFdPk6Jsm0G2GOPtn3+SRgFcdd30N9timxDneXpUdqV0s+1+V/rN5TJyFqhCMrB+s88lZxM/5pB1kWKA+yIKv4KuHydFLqN+FmmztjPuM3J0UhqYvAOKjtHRpXO5pWwIrpcEj4HHereovCaV8mae1tXgcwi9igfCo219Vh/llIuxIB2mmwTNmWxom90BwkEXe25S8t7bMOE5EriW05KkH4vBTtZOxhBMBGIfmUN5VZNSdnBXOjo+0N9odGdhTAl2DE6lHhbIpWzIvWZsWTKWhV0Y4urb+Cl7JUrfCG+zxyI87uJl4xkIMzkMpp/33MT228xJOANuCV6C9b8YxDVckSFkgz0=
2021-03-07T06:03:23.975 INFO:teuthology.kill:  smithi129.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNTcZEGKRMthk45fJ2Sj693upA00mMhqMyKS2T7I9uHnScweUvGCuH0UM0HVFiaFoOaSDWFTvZ+eJcGxEUM25sti1v+Rbs91JW5VHfbNKNNvGPktmTkSpmLkshSPGtdBWVM2ACgYVuo0oYE/06BNkHaYt/DOmrRcssXtP/4sjyDH+UhLoPo1UbeGLmX2qEUdCixNWc3xG/yXTi8Lo69k6sBoJcJOk4tNV9ZcJWl6a9FJEmEaKgDfcm75z4umUcKRi0fEEQ3XTLBRP3f//689CbCok6D7wuiou2eGtRu/IBiConH4XtyCaXWBQf7fP5mMqlhSdA9HdpW1+8sDR7JBzpUFR9bQ7JH/UsY9kvndQ84u0vkyUBfXjZGPFrntPhkHLGGdTyYspxXhu9eUZ2/Pa//HM1/zRir7sKpW53VMSo8CDYqmvbwGEpONnchlmFrph5XgcswzAI7NheF0Vvyu3AdDOg86b45P/mGQHC5jzJMXAjwq1Na2Fj+P6AcAKnync=
2021-03-07T06:03:23.995 INFO:teuthology.kill:2021-03-07 06:03:23,995.995 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-07T06:03:23.999 INFO:teuthology.kill:2021-03-07 06:03:23,999.999 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-07T06:03:24.072 INFO:teuthology.kill:2021-03-07 06:03:24,072.072 INFO:teuthology.orchestra.console:Power off smithi117
2021-03-07T06:03:24.108 INFO:teuthology.kill:2021-03-07 06:03:24,108.108 INFO:teuthology.orchestra.console:Power off smithi129
2021-03-07T06:03:24.268 INFO:teuthology.kill:2021-03-07 06:03:24,267.267 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2021-03-07T06:03:24.270 INFO:teuthology.kill:2021-03-07 06:03:24,270.270 INFO:teuthology.orchestra.console:Power off for smithi129 completed
2021-03-07T06:03:24.416 INFO:teuthology.kill:2021-03-07 06:03:24,416.416 INFO:teuthology.lock.ops:unlocked smithi117.front.sepia.ceph.com
2021-03-07T06:03:24.420 INFO:teuthology.kill:2021-03-07 06:03:24,420.420 INFO:teuthology.lock.ops:unlocked smithi129.front.sepia.ceph.com
2021-03-07T06:05:24.779 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-07T06:05:24.896 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-07T06:05:24.897 INFO:teuthology.nuke:Checking targets against current locks
2021-03-07T06:05:24.978 INFO:teuthology.nuke:Not nuking smithi117.front.sepia.ceph.com because description doesn't match
2021-03-07T06:05:24.979 INFO:teuthology.nuke:Not nuking smithi129.front.sepia.ceph.com because description doesn't match