2021-05-25T06:42:09.768 INFO:root:teuthology version: 1.1.0-d92ec140
2021-05-25T06:42:09.872 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi100.front.sepia.ceph.com' reimaging
2021-05-25T06:42:09.873 INFO:teuthology.lock.ops:Updating [ubuntu@smithi100.front.sepia.ceph.com]: reset os type and version on server
2021-05-25T06:42:09.874 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2021-05-25T06:42:09.892 INFO:teuthology.lock.ops:Node 'ubuntu@smithi100.front.sepia.ceph.com' reimaging is complete
2021-05-25T06:42:09.893 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi106.front.sepia.ceph.com' reimaging
2021-05-25T06:42:09.894 INFO:teuthology.lock.ops:Updating [ubuntu@smithi106.front.sepia.ceph.com]: reset os type and version on server
2021-05-25T06:42:09.894 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2021-05-25T06:42:09.908 INFO:teuthology.lock.ops:Node 'ubuntu@smithi106.front.sepia.ceph.com' reimaging is complete
2021-05-25T06:42:10.104 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of centos 8.3
2021-05-25T06:42:10.115 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of centos 8.3
2021-05-25T06:42:10.472 INFO:teuthology.orchestra.console:Power off smithi100
2021-05-25T06:42:10.514 INFO:teuthology.orchestra.console:Power off smithi106
2021-05-25T06:42:18.853 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2021-05-25T06:42:18.878 INFO:teuthology.orchestra.console:Power off for smithi106 completed
2021-05-25T06:42:18.955 INFO:teuthology.orchestra.console:Power on smithi100
2021-05-25T06:42:18.988 INFO:teuthology.orchestra.console:Power on smithi106
2021-05-25T06:42:27.329 INFO:teuthology.orchestra.console:Power on for smithi100 completed
2021-05-25T06:42:27.356 INFO:teuthology.orchestra.console:Power on for smithi106 completed
2021-05-25T06:42:27.431 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2021-05-25T06:42:27.458 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish
2021-05-25T06:46:59.419 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-25T06:46:59.505 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-25T06:46:59.725 INFO:teuthology.provision.fog.smithi100:Node is ready
2021-05-25T06:46:59.740 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com
2021-05-25T06:46:59.795 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100
2021-05-25T06:46:59.821 INFO:teuthology.provision.fog.smithi106:Node is ready
2021-05-25T06:46:59.835 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com
2021-05-25T06:46:59.889 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106
2021-05-25T06:47:00.116 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2021-05-25T06:47:00.196 INFO:teuthology.provision.fog.smithi106:Deploy complete!
2021-05-25T06:47:00.313 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com
2021-05-25T06:47:00.314 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-25T06:47:00.329 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com
2021-05-25T06:47:00.330 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-25T06:47:00.345 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server
2021-05-25T06:47:00.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-25T06:47:00.622 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64
2021-05-25T06:47:00.676 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Linux"
2021-05-25T06:47:00.677 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8"
2021-05-25T06:47:00.677 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos"
2021-05-25T06:47:00.677 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora"
2021-05-25T06:47:00.677 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8"
2021-05-25T06:47:00.678 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8"
2021-05-25T06:47:00.678 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Linux 8"
2021-05-25T06:47:00.678 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2021-05-25T06:47:00.678 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-05-25T06:47:00.679 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/"
2021-05-25T06:47:00.679 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-05-25T06:47:00.679 INFO:teuthology.orchestra.run.smithi100.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-05-25T06:47:00.680 INFO:teuthology.orchestra.run.smithi100.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-05-25T06:47:00.681 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2021-05-25T06:47:00.696 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server
2021-05-25T06:47:00.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-25T06:47:00.977 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64
2021-05-25T06:47:01.032 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Linux"
2021-05-25T06:47:01.032 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8"
2021-05-25T06:47:01.033 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos"
2021-05-25T06:47:01.033 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora"
2021-05-25T06:47:01.033 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8"
2021-05-25T06:47:01.034 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8"
2021-05-25T06:47:01.034 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Linux 8"
2021-05-25T06:47:01.035 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31"
2021-05-25T06:47:01.035 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-05-25T06:47:01.035 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/"
2021-05-25T06:47:01.036 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-05-25T06:47:01.036 INFO:teuthology.orchestra.run.smithi106.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-05-25T06:47:01.038 INFO:teuthology.orchestra.run.smithi106.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-05-25T06:47:01.038 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2021-05-25T06:47:01.118 INFO:teuthology.dispatcher.supervisor:Running job 6133763
2021-05-25T06:47:01.119 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/virtualenv/bin/teuthology -v --owner scheduled_xiubli@teuthology --archive /home/teuthworker/archive/xiubli-2021-05-25_06:39:49-fs:functional:-wip-lxb-20210525-45434-pg-num-distro-basic-smithi/6133763 --name xiubli-2021-05-25_06:39:49-fs:functional:-wip-lxb-20210525-45434-pg-num-distro-basic-smithi --description fs:functional:/{begin.yaml clusters/1a3s-mds-4c-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} distro/{centos_8.yaml} mount/kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml} -- /home/teuthworker/archive/xiubli-2021-05-25_06:39:49-fs:functional:-wip-lxb-20210525-45434-pg-num-distro-basic-smithi/6133763/orig.config.yaml
2021-05-25T06:47:01.123 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/xiubli-2021-05-25_06:39:49-fs:functional:-wip-lxb-20210525-45434-pg-num-distro-basic-smithi/6133763
2021-05-25T06:47:01.124 INFO:teuthology.dispatcher.supervisor:Job PID: 23767
2021-05-25T06:47:01.124 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-05-25T18:47:48.416 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-05-25T18:47:48.595 INFO:teuthology.kill:Killing Pids: {23767}
2021-05-25T18:47:49.703 INFO:teuthology.kill:Nuking machines: ['smithi100', 'smithi106']
2021-05-25T18:47:50.607 INFO:teuthology.kill:2021-05-25 18:47:50,606.606 INFO:teuthology.nuke:targets:
2021-05-25T18:47:50.607 INFO:teuthology.kill:  smithi100.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEvtDZjctjsSk9N/aI4oV+StcQ5Am5tLghptLtQyekxuBzugYOj8qDQjNKCB1h/I8eEb9Td4iQpQ7/gJyS2v+JsS4p0dZwbfgOVYgrAuMs99OAwIBv/SSG3Nj78T9VmPljmaG2Bm4eUb+ISY4pTA/1mwGLghH8M+BM9c8bAw/sjWm9qPuzooO9ORHzeEPVE7AAe+/QEOI4Vn+0bbkKnTIMrdCkfqxRZ2scaz8ftXBmW5Y95Ieoo0i8QNK883sE4RUicqyxe0HPXjuI+QxKpzO6TKIY5yb52s9RdCwxRzSsvpzLnhwtohXC7tm46H9CzwowmhltvsoA7yPoqXmrYw4mTH0OcSTXckQg8zji7Hc9WHjeUY6KNAs3H0diuDV1hbO6s7NYQM2+07ldXpH/+Qpo1XWz+Lx/CySfGlKa3zBAgzvoy9gyFPcmiPjrlbv4nG+Q8g+n6Hnot95s0YDkilRvxtfZGz11G67MjZBjMhx0Z46Rn2M2hvtxLKxUCoobyJU=
2021-05-25T18:47:50.608 INFO:teuthology.kill:  smithi106.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVTING7j9/0E4KVBTku3XnvLXqlyjKe7wqs0+x/L4NDKoK3JPTBstkE+Oj1JtJQNZ/qVJTmaUunvuVMMe6bX/nyVuIMBBrxv0VYOy6LTHnki+i5JZ6cniGsayB8U29nRQIBLXjuL1I7OyE7f332B9wEuZ+w0TlJXvu9ROKsJ2UOstCuXaSxG8ZEuRllrwZc0ZokZR04RdHFDXR1QSKhlN5jvExvVNhnHlNCUnjm800Y7uvmu+7Cfjqe/oelEXFA134ensezie3sth1XKjCRI73xuCJT/krVjUwGoUKcG2MwVUZfvBcY7gf+0xwCq/njuxzRqZ9s8mfPrbMp+ndW11kgcCmtWYpL3dr4tlLCzLjt90bLkzey+Jmqh0sIhrCttpUDL516ETPeGLGSCdBTQWQuYkuu8QMvtI3LoNfQIMX5F5SBMKfSw4LEzounj59i5dKpn83FNd3SOCcHPr5dZHfYTLd2lpQ7nGMrG/9gU7Gegz4xye0LbgiYezS9DAdbn8=
2021-05-25T18:47:50.608 INFO:teuthology.kill:2021-05-25 18:47:50,607.607 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-25T18:47:50.609 INFO:teuthology.kill:2021-05-25 18:47:50,609.609 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-25T18:47:50.667 INFO:teuthology.kill:2021-05-25 18:47:50,666.666 INFO:teuthology.orchestra.console:Power off smithi100
2021-05-25T18:47:50.679 INFO:teuthology.kill:2021-05-25 18:47:50,679.679 INFO:teuthology.orchestra.console:Power off smithi106
2021-05-25T18:47:59.033 INFO:teuthology.kill:2021-05-25 18:47:59,032.032 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2021-05-25T18:47:59.038 INFO:teuthology.kill:2021-05-25 18:47:59,038.038 INFO:teuthology.orchestra.console:Power off for smithi106 completed
2021-05-25T18:47:59.246 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2']
2021-05-25T18:47:59.247 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']
2021-05-25T18:47:59.247 INFO:teuthology.misc:Compressing logs...
2021-05-25T18:47:59.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-25T18:48:33.739 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-05-25T18:48:33.805 INFO:teuthology.kill:No teuthology processes running
2021-05-25T18:48:34.839 INFO:teuthology.kill:Nuking machines: ['smithi100', 'smithi106']
2021-05-25T18:48:35.739 INFO:teuthology.kill:2021-05-25 18:48:35,739.739 INFO:teuthology.nuke:targets:
2021-05-25T18:48:35.740 INFO:teuthology.kill:  smithi100.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEvtDZjctjsSk9N/aI4oV+StcQ5Am5tLghptLtQyekxuBzugYOj8qDQjNKCB1h/I8eEb9Td4iQpQ7/gJyS2v+JsS4p0dZwbfgOVYgrAuMs99OAwIBv/SSG3Nj78T9VmPljmaG2Bm4eUb+ISY4pTA/1mwGLghH8M+BM9c8bAw/sjWm9qPuzooO9ORHzeEPVE7AAe+/QEOI4Vn+0bbkKnTIMrdCkfqxRZ2scaz8ftXBmW5Y95Ieoo0i8QNK883sE4RUicqyxe0HPXjuI+QxKpzO6TKIY5yb52s9RdCwxRzSsvpzLnhwtohXC7tm46H9CzwowmhltvsoA7yPoqXmrYw4mTH0OcSTXckQg8zji7Hc9WHjeUY6KNAs3H0diuDV1hbO6s7NYQM2+07ldXpH/+Qpo1XWz+Lx/CySfGlKa3zBAgzvoy9gyFPcmiPjrlbv4nG+Q8g+n6Hnot95s0YDkilRvxtfZGz11G67MjZBjMhx0Z46Rn2M2hvtxLKxUCoobyJU=
2021-05-25T18:48:35.741 INFO:teuthology.kill:  smithi106.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVTING7j9/0E4KVBTku3XnvLXqlyjKe7wqs0+x/L4NDKoK3JPTBstkE+Oj1JtJQNZ/qVJTmaUunvuVMMe6bX/nyVuIMBBrxv0VYOy6LTHnki+i5JZ6cniGsayB8U29nRQIBLXjuL1I7OyE7f332B9wEuZ+w0TlJXvu9ROKsJ2UOstCuXaSxG8ZEuRllrwZc0ZokZR04RdHFDXR1QSKhlN5jvExvVNhnHlNCUnjm800Y7uvmu+7Cfjqe/oelEXFA134ensezie3sth1XKjCRI73xuCJT/krVjUwGoUKcG2MwVUZfvBcY7gf+0xwCq/njuxzRqZ9s8mfPrbMp+ndW11kgcCmtWYpL3dr4tlLCzLjt90bLkzey+Jmqh0sIhrCttpUDL516ETPeGLGSCdBTQWQuYkuu8QMvtI3LoNfQIMX5F5SBMKfSw4LEzounj59i5dKpn83FNd3SOCcHPr5dZHfYTLd2lpQ7nGMrG/9gU7Gegz4xye0LbgiYezS9DAdbn8=
2021-05-25T18:48:35.760 INFO:teuthology.kill:2021-05-25 18:48:35,759.759 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-25T18:48:35.762 INFO:teuthology.kill:2021-05-25 18:48:35,762.762 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-25T18:48:35.816 INFO:teuthology.kill:2021-05-25 18:48:35,815.815 INFO:teuthology.orchestra.console:Power off smithi100
2021-05-25T18:48:35.828 INFO:teuthology.kill:2021-05-25 18:48:35,828.828 INFO:teuthology.orchestra.console:Power off smithi106
2021-05-25T18:48:35.955 INFO:teuthology.kill:2021-05-25 18:48:35,954.954 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2021-05-25T18:48:35.965 INFO:teuthology.kill:2021-05-25 18:48:35,965.965 INFO:teuthology.orchestra.console:Power off for smithi106 completed
2021-05-25T18:48:36.097 INFO:teuthology.kill:2021-05-25 18:48:36,096.096 INFO:teuthology.lock.ops:unlocked smithi100.front.sepia.ceph.com
2021-05-25T18:48:36.099 INFO:teuthology.kill:2021-05-25 18:48:36,098.098 ERROR:teuthology.lock.ops:failed to unlock smithi106.front.sepia.ceph.com. reason: 500
2021-05-25T18:50:36.384 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-05-25T18:50:36.479 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-05-25T18:50:36.480 INFO:teuthology.nuke:Checking targets against current locks
2021-05-25T18:50:36.549 INFO:teuthology.nuke:Not nuking smithi100.front.sepia.ceph.com because description doesn't match
2021-05-25T18:50:36.566 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-25T18:50:36.617 INFO:teuthology.orchestra.console:Power off smithi106
2021-05-25T18:50:36.759 INFO:teuthology.orchestra.console:Power off for smithi106 completed
2021-05-25T18:50:36.898 INFO:teuthology.lock.ops:unlocked smithi106.front.sepia.ceph.com