2021-02-27T16:03:11.046 INFO:root:teuthology version: 1.1.0-7a21eca3
2021-02-27T16:03:11.266 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi039.front.sepia.ceph.com' reimaging
2021-02-27T16:03:11.271 INFO:teuthology.lock.ops:Updating [ubuntu@smithi039.front.sepia.ceph.com]: reset os type and version on server
2021-02-27T16:03:11.271 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2021-02-27T16:03:11.289 INFO:teuthology.lock.ops:Node 'ubuntu@smithi039.front.sepia.ceph.com' reimaging is complete
2021-02-27T16:03:11.290 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi115.front.sepia.ceph.com' reimaging
2021-02-27T16:03:11.291 INFO:teuthology.lock.ops:Updating [ubuntu@smithi115.front.sepia.ceph.com]: reset os type and version on server
2021-02-27T16:03:11.291 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2021-02-27T16:03:11.312 INFO:teuthology.lock.ops:Node 'ubuntu@smithi115.front.sepia.ceph.com' reimaging is complete
2021-02-27T16:03:11.503 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 8.2
2021-02-27T16:03:11.536 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 8.2
2021-02-27T16:03:11.897 INFO:teuthology.orchestra.console:Power off smithi039
2021-02-27T16:03:11.984 INFO:teuthology.orchestra.console:Power off smithi115
2021-02-27T16:03:12.192 INFO:teuthology.orchestra.console:Power off for smithi039 completed
2021-02-27T16:03:12.203 INFO:teuthology.orchestra.console:Power off for smithi115 completed
2021-02-27T16:03:12.294 INFO:teuthology.orchestra.console:Power on smithi039
2021-02-27T16:03:12.304 INFO:teuthology.orchestra.console:Power on smithi115
2021-02-27T16:03:16.564 INFO:teuthology.orchestra.console:Power on for smithi039 completed
2021-02-27T16:03:16.665 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish
2021-02-27T16:03:20.684 INFO:teuthology.orchestra.console:Power on for smithi115 completed
2021-02-27T16:03:20.786 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish
2021-02-27T16:05:51.998 ERROR:teuthology.orchestra.connection:Error authenticating with smithi115.front.sepia.ceph.com: Authentication failed.
2021-02-27T16:08:05.592 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-27T16:08:05.881 INFO:teuthology.provision.fog.smithi115:Node is ready
2021-02-27T16:08:05.896 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com
2021-02-27T16:08:05.951 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115
2021-02-27T16:08:06.274 INFO:teuthology.provision.fog.smithi115:Deploy complete!
2021-02-27T16:08:45.788 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-27T16:08:46.094 INFO:teuthology.provision.fog.smithi039:Node is ready
2021-02-27T16:08:46.109 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com
2021-02-27T16:08:46.166 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039
2021-02-27T16:08:46.495 INFO:teuthology.provision.fog.smithi039:Deploy complete!
2021-02-27T16:08:46.697 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com
2021-02-27T16:08:46.707 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-27T16:08:46.729 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com
2021-02-27T16:08:46.730 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-27T16:08:46.749 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server
2021-02-27T16:08:46.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-27T16:08:47.020 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64
2021-02-27T16:08:47.074 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Linux"
2021-02-27T16:08:47.075 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8 (Core)"
2021-02-27T16:08:47.075 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos"
2021-02-27T16:08:47.075 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora"
2021-02-27T16:08:47.075 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8"
2021-02-27T16:08:47.076 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8"
2021-02-27T16:08:47.076 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-02-27T16:08:47.076 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31"
2021-02-27T16:08:47.076 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-02-27T16:08:47.076 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.centos.org/"
2021-02-27T16:08:47.077 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-02-27T16:08:47.077 INFO:teuthology.orchestra.run.smithi039.stdout:
2021-02-27T16:08:47.077 INFO:teuthology.orchestra.run.smithi039.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-02-27T16:08:47.077 INFO:teuthology.orchestra.run.smithi039.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-02-27T16:08:47.078 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-02-27T16:08:47.078 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-02-27T16:08:47.078 INFO:teuthology.orchestra.run.smithi039.stdout:
2021-02-27T16:08:47.081 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2021-02-27T16:08:47.100 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server
2021-02-27T16:08:47.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-27T16:08:47.393 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64
2021-02-27T16:08:47.448 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Linux"
2021-02-27T16:08:47.448 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8 (Core)"
2021-02-27T16:08:47.448 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2021-02-27T16:08:47.448 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2021-02-27T16:08:47.449 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8"
2021-02-27T16:08:47.449 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8"
2021-02-27T16:08:47.449 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-02-27T16:08:47.449 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2021-02-27T16:08:47.450 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-02-27T16:08:47.450 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.centos.org/"
2021-02-27T16:08:47.450 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-02-27T16:08:47.450 INFO:teuthology.orchestra.run.smithi115.stdout:
2021-02-27T16:08:47.451 INFO:teuthology.orchestra.run.smithi115.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-02-27T16:08:47.451 INFO:teuthology.orchestra.run.smithi115.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-02-27T16:08:47.451 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-02-27T16:08:47.451 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-02-27T16:08:47.452 INFO:teuthology.orchestra.run.smithi115.stdout:
2021-02-27T16:08:47.452 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2021-02-27T16:08:47.572 INFO:teuthology.dispatcher.supervisor:Running job 5918490
2021-02-27T16:08:47.573 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-02-27_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5918490 --name teuthology-2021-02-27_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi --description upgrade:octopus-x/stress-split/{0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench distro$/{centos_latest} mon_election/classic} -- /home/teuthworker/archive/teuthology-2021-02-27_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5918490/orig.config.yaml
2021-02-27T16:08:47.584 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-02-27_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5918490
2021-02-27T16:08:47.585 INFO:teuthology.dispatcher.supervisor:Job PID: 15429
2021-02-27T16:08:47.586 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-02-28T04:09:03.419 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-02-28T04:09:03.696 INFO:teuthology.kill:Killing Pids: {15429}
2021-02-28T04:09:04.821 INFO:teuthology.kill:Nuking machines: ['smithi039', 'smithi115']
2021-02-28T04:09:05.752 INFO:teuthology.kill:2021-02-28 04:09:05,752.752 INFO:teuthology.nuke:targets:
2021-02-28T04:09:05.753 INFO:teuthology.kill:  smithi039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtVbPJvi4a4jxZDHkg7YM4WzgkGmwRN7HmfUCm243+3N1EKSSp5oQhqZWA0NggM8K+XW3FiTnIDS4wS44YGrgxvAWumOmbmnW/7gRMYLH37cWJ4ZzaBM6JZIm22B/TSQkYTqDinUOxZIDLoRIk4gZkmBb2JZIkNYMQUGN6E8WY7oEhtp1hmmmTncBIsRhLUpdh5dX6o+YjGHvR1HGxFFKkdmX4/Kt+r4b8rzkWZkbOG7k4eLyS2VXGJiFr44Lt+DrnlBWuA8KLxWaNPpmi0ZgGz5KQV/ut295SClfNcb3VgQTEVYj5O6ekdpRuBJg8QqGnOWqGDsjbB2nuo9kaPDUKZZu4Q+504ANRDYIdB4oKqUQVmt0Tnn8s8u/BGRrzGyeG8RxCeMqbgQV/NuK2o5+QeS0riDj8spp5p4IubZo5Smn50PfVq19xZXJiOeDqmOcfwkT3AdB60cgDFsCUD684MDhcHWR7xxxnHDOutNaw0QMVzlWml9CVUTC5sbrbUaE=
2021-02-28T04:09:05.754 INFO:teuthology.kill:  smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXOT8seT828O4utlbd8rYBDGM7pe+7TJTxM/DIt9+qRvk9Mo8gmy5uXrpLD7V8eEbSr+KtQxFGLI/TDTWCKgTvVW3W8vwrjfCvctLKi9RmAfTipMv4SBbDbCHoKz/DHHak7s71RwEELFU8bZugW93ivSSHx6XNYnqLVzXWx1ex6Ma5a3UMnNzbo0DY6J+NYttBeBrrBL5d4ZaSj5ARqeazaREI7lUjwEk1FxLvgs+VzjSIbUTjuwaLvpVLyIXB/RS9CH/lyueVMNSfSHWxh9fyRJoon7bJJuG6EWGDUuPVUec5C+hJgHjCrXpZ76IyhPZMrYejKx/IKzhcJPyAVNz2ZQitYV1Bx/PgvGwVdRyYD/+NT6wFbvRut0WkDs9xBXw/MglZEa5L5GG5uVLIVpMmNv3LPh10v22sWcaHWhBfri5j4ncWzks3nRhfdFRI1H8hRAOxr+Nuuad1boHKwu836a/v/lCileyWHKXnzDtPki9nxemouAGiJPLcnISOsIE=
2021-02-28T04:09:05.754 INFO:teuthology.kill:2021-02-28 04:09:05,752.752 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-28T04:09:05.755 INFO:teuthology.kill:2021-02-28 04:09:05,755.755 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-28T04:09:05.815 INFO:teuthology.kill:2021-02-28 04:09:05,815.815 INFO:teuthology.orchestra.console:Power off smithi115
2021-02-28T04:09:05.829 INFO:teuthology.kill:2021-02-28 04:09:05,828.828 INFO:teuthology.orchestra.console:Power off smithi039
2021-02-28T04:09:14.182 INFO:teuthology.kill:2021-02-28 04:09:14,181.181 INFO:teuthology.orchestra.console:Power off for smithi115 completed
2021-02-28T04:09:14.203 INFO:teuthology.kill:2021-02-28 04:09:14,203.203 INFO:teuthology.orchestra.console:Power off for smithi039 completed
2021-02-28T04:09:14.458 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2021-02-28T04:09:14.459 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2021-02-28T04:09:14.459 INFO:teuthology.misc:Compressing logs...
2021-02-28T04:09:14.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-28T04:10:14.463 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-02-28T04:10:14.552 INFO:teuthology.kill:No teuthology processes running
2021-02-28T04:10:15.706 INFO:teuthology.kill:Nuking machines: ['smithi039', 'smithi115']
2021-02-28T04:10:16.637 INFO:teuthology.kill:2021-02-28 04:10:16,637.637 INFO:teuthology.nuke:targets:
2021-02-28T04:10:16.638 INFO:teuthology.kill:  smithi039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtVbPJvi4a4jxZDHkg7YM4WzgkGmwRN7HmfUCm243+3N1EKSSp5oQhqZWA0NggM8K+XW3FiTnIDS4wS44YGrgxvAWumOmbmnW/7gRMYLH37cWJ4ZzaBM6JZIm22B/TSQkYTqDinUOxZIDLoRIk4gZkmBb2JZIkNYMQUGN6E8WY7oEhtp1hmmmTncBIsRhLUpdh5dX6o+YjGHvR1HGxFFKkdmX4/Kt+r4b8rzkWZkbOG7k4eLyS2VXGJiFr44Lt+DrnlBWuA8KLxWaNPpmi0ZgGz5KQV/ut295SClfNcb3VgQTEVYj5O6ekdpRuBJg8QqGnOWqGDsjbB2nuo9kaPDUKZZu4Q+504ANRDYIdB4oKqUQVmt0Tnn8s8u/BGRrzGyeG8RxCeMqbgQV/NuK2o5+QeS0riDj8spp5p4IubZo5Smn50PfVq19xZXJiOeDqmOcfwkT3AdB60cgDFsCUD684MDhcHWR7xxxnHDOutNaw0QMVzlWml9CVUTC5sbrbUaE=
2021-02-28T04:10:16.639 INFO:teuthology.kill:  smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXOT8seT828O4utlbd8rYBDGM7pe+7TJTxM/DIt9+qRvk9Mo8gmy5uXrpLD7V8eEbSr+KtQxFGLI/TDTWCKgTvVW3W8vwrjfCvctLKi9RmAfTipMv4SBbDbCHoKz/DHHak7s71RwEELFU8bZugW93ivSSHx6XNYnqLVzXWx1ex6Ma5a3UMnNzbo0DY6J+NYttBeBrrBL5d4ZaSj5ARqeazaREI7lUjwEk1FxLvgs+VzjSIbUTjuwaLvpVLyIXB/RS9CH/lyueVMNSfSHWxh9fyRJoon7bJJuG6EWGDUuPVUec5C+hJgHjCrXpZ76IyhPZMrYejKx/IKzhcJPyAVNz2ZQitYV1Bx/PgvGwVdRyYD/+NT6wFbvRut0WkDs9xBXw/MglZEa5L5GG5uVLIVpMmNv3LPh10v22sWcaHWhBfri5j4ncWzks3nRhfdFRI1H8hRAOxr+Nuuad1boHKwu836a/v/lCileyWHKXnzDtPki9nxemouAGiJPLcnISOsIE=
2021-02-28T04:10:16.659 INFO:teuthology.kill:2021-02-28 04:10:16,659.659 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-28T04:10:16.662 INFO:teuthology.kill:2021-02-28 04:10:16,662.662 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-28T04:10:16.722 INFO:teuthology.kill:2021-02-28 04:10:16,722.722 INFO:teuthology.orchestra.console:Power off smithi039
2021-02-28T04:10:16.736 INFO:teuthology.kill:2021-02-28 04:10:16,735.735 INFO:teuthology.orchestra.console:Power off smithi115
2021-02-28T04:10:16.866 INFO:teuthology.kill:2021-02-28 04:10:16,865.865 INFO:teuthology.orchestra.console:Power off for smithi039 completed
2021-02-28T04:10:16.879 INFO:teuthology.kill:2021-02-28 04:10:16,879.879 INFO:teuthology.orchestra.console:Power off for smithi115 completed
2021-02-28T04:10:17.012 INFO:teuthology.kill:2021-02-28 04:10:17,011.011 INFO:teuthology.lock.ops:unlocked smithi039.front.sepia.ceph.com
2021-02-28T04:10:17.020 INFO:teuthology.kill:2021-02-28 04:10:17,019.019 INFO:teuthology.lock.ops:unlocked smithi115.front.sepia.ceph.com
2021-02-28T04:12:17.234 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-02-28T04:12:17.372 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-02-28T04:12:17.373 INFO:teuthology.nuke:Checking targets against current locks
2021-02-28T04:12:17.445 INFO:teuthology.nuke:Not nuking smithi115.front.sepia.ceph.com because description doesn't match
2021-02-28T04:12:17.445 INFO:teuthology.nuke:Not nuking smithi039.front.sepia.ceph.com because description doesn't match