2021-02-27T02:50:30.988 INFO:root:teuthology version: 1.1.0-7a21eca3
2021-02-27T02:50:31.096 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi137.front.sepia.ceph.com' reimaging
2021-02-27T02:50:31.098 INFO:teuthology.lock.ops:Updating [ubuntu@smithi137.front.sepia.ceph.com]: reset os type and version on server
2021-02-27T02:50:31.098 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2021-02-27T02:50:31.114 INFO:teuthology.lock.ops:Node 'ubuntu@smithi137.front.sepia.ceph.com' reimaging is complete
2021-02-27T02:50:31.114 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi145.front.sepia.ceph.com' reimaging
2021-02-27T02:50:31.115 INFO:teuthology.lock.ops:Updating [ubuntu@smithi145.front.sepia.ceph.com]: reset os type and version on server
2021-02-27T02:50:31.115 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2021-02-27T02:50:31.132 INFO:teuthology.lock.ops:Node 'ubuntu@smithi145.front.sepia.ceph.com' reimaging is complete
2021-02-27T02:50:31.307 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of rhel 8.3
2021-02-27T02:50:31.342 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of rhel 8.3
2021-02-27T02:50:31.640 INFO:teuthology.orchestra.console:Power off smithi137
2021-02-27T02:50:31.666 INFO:teuthology.orchestra.console:Power off smithi145
2021-02-27T02:50:40.022 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2021-02-27T02:50:40.028 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2021-02-27T02:50:40.124 INFO:teuthology.orchestra.console:Power on smithi137
2021-02-27T02:50:40.131 INFO:teuthology.orchestra.console:Power on smithi145
2021-02-27T02:50:48.502 INFO:teuthology.orchestra.console:Power on for smithi137 completed
2021-02-27T02:50:48.507 INFO:teuthology.orchestra.console:Power on for smithi145 completed
2021-02-27T02:50:48.604 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish
2021-02-27T02:50:48.608 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish
2021-02-27T02:55:20.529 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-27T02:55:20.851 INFO:teuthology.provision.fog.smithi137:Node is ready
2021-02-27T02:55:20.866 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com
2021-02-27T02:55:20.921 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137
2021-02-27T02:55:21.242 INFO:teuthology.provision.fog.smithi137:Deploy complete!
2021-02-27T02:55:29.537 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-27T02:55:29.842 INFO:teuthology.provision.fog.smithi145:Node is ready
2021-02-27T02:55:29.857 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com
2021-02-27T02:55:29.911 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145
2021-02-27T02:55:30.237 INFO:teuthology.provision.fog.smithi145:Deploy complete!
2021-02-27T02:55:30.368 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com
2021-02-27T02:55:30.370 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-27T02:55:30.386 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com
2021-02-27T02:55:30.386 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-27T02:55:30.401 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server
2021-02-27T02:55:30.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-27T02:55:30.690 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64
2021-02-27T02:55:30.744 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Red Hat Enterprise Linux"
2021-02-27T02:55:30.745 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8.3 (Ootpa)"
2021-02-27T02:55:30.745 INFO:teuthology.orchestra.run.smithi137.stdout:ID="rhel"
2021-02-27T02:55:30.745 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="fedora"
2021-02-27T02:55:30.745 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8.3"
2021-02-27T02:55:30.746 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8"
2021-02-27T02:55:30.746 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-02-27T02:55:30.746 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31"
2021-02-27T02:55:30.746 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-02-27T02:55:30.747 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.redhat.com/"
2021-02-27T02:55:30.747 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-02-27T02:55:30.747 INFO:teuthology.orchestra.run.smithi137.stdout:
2021-02-27T02:55:30.747 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-02-27T02:55:30.748 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-02-27T02:55:30.748 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-02-27T02:55:30.748 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-02-27T02:55:30.749 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2021-02-27T02:55:30.766 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server
2021-02-27T02:55:30.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-27T02:55:31.042 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64
2021-02-27T02:55:31.096 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux"
2021-02-27T02:55:31.096 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.3 (Ootpa)"
2021-02-27T02:55:31.097 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel"
2021-02-27T02:55:31.097 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora"
2021-02-27T02:55:31.097 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.3"
2021-02-27T02:55:31.097 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8"
2021-02-27T02:55:31.098 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-02-27T02:55:31.098 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2021-02-27T02:55:31.098 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-02-27T02:55:31.098 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/"
2021-02-27T02:55:31.098 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-02-27T02:55:31.099 INFO:teuthology.orchestra.run.smithi145.stdout:
2021-02-27T02:55:31.099 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-02-27T02:55:31.099 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-02-27T02:55:31.099 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-02-27T02:55:31.100 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-02-27T02:55:31.100 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2021-02-27T02:55:31.181 INFO:teuthology.dispatcher.supervisor:Running job 5917478
2021-02-27T02:55:31.182 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2021-02-26_23:40:39-fs-wip-pdonnell-testing-20210226.181017-distro-basic-smithi/5917478 --name pdonnell-2021-02-26_23:40:39-fs-wip-pdonnell-testing-20210226.181017-distro-basic-smithi --description fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} -- /home/teuthworker/archive/pdonnell-2021-02-26_23:40:39-fs-wip-pdonnell-testing-20210226.181017-distro-basic-smithi/5917478/orig.config.yaml
2021-02-27T02:55:31.186 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2021-02-26_23:40:39-fs-wip-pdonnell-testing-20210226.181017-distro-basic-smithi/5917478
2021-02-27T02:55:31.186 INFO:teuthology.dispatcher.supervisor:Job PID: 29664
2021-02-27T02:55:31.187 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-02-27T14:56:21.811 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-02-27T14:56:22.042 INFO:teuthology.kill:Killing Pids: {29664}
2021-02-27T14:56:23.170 INFO:teuthology.kill:Nuking machines: ['smithi137', 'smithi145']
2021-02-27T14:56:24.136 INFO:teuthology.kill:2021-02-27 14:56:24,136.136 INFO:teuthology.nuke:targets:
2021-02-27T14:56:24.137 INFO:teuthology.kill:  smithi137.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCq5LCIhKg3l8ExKhBSAgjQ2SN493J3FhYc2CcrTzD1vfLlamP0Ki50/k8v40VUHwkL4srhz4ocmzaOhyWwdKT6wt3zig6Kqml2B+CmhonXDNEafSyY3O7ZDfVuFxWgrxUVUMVknyY2lRdKNHRWBo0AfUUrYmJMcz+4fhGTXR+GpmYQhyZjmMedNgCq4njQTEIXVVG+IHzTxFlK6yyQSUWaHKpR/GmSdC+h/NfD22wdzFGRxV975XM/pmThRF4K0aKspCwqMqxc/xxasmHCYGAtkVtxxaPZwSTAEkQArHJavOmOWqtr6Nd926V2AxgNlCaxa6TA+AVQjzzhiSSBoXqeEegn26NwgRF64ucnuwLoxau0NXS8rok9Pgf0TFWJXczEk79nAcRuNRxmBsZMORINU+0rTPq3O6Bi6QfmZ//IErQlEijB0cdbSq9y8PlruIOS7rNM8KYHnVvqxsg7JS5LG8Ws53GxuCPbRd7/Q+SLakFk/uMgFgVY3fwU2Mz6BEU=
2021-02-27T14:56:24.137 INFO:teuthology.kill:  smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvhtczyZy3kX5xZqrOg3rcLJoMU7ac0Ih+ic4rofDJj5oTZw2Si/r4U+5EhFr0R93CCdFx+t4y5CyqDbKiFJLSjbJnBD8hrxTKdRvIcEf8HlnrhnYFDn3IafcHFwz/FWKopmKU3WkzzokVsdPrzFUwYag6kRqlgWOK8ACBQQJehJuCrJXDkIyHNzuB3Ykb5FEVxu1BZETdGICvsjI55YETO2+ame5xZkvpj88zphK3YfyGS9VjPk78aom6SR8Mr+fK4ZfSI4tGbiIqXUTc7NNlysoUN6k2kKPXa55x6/PPeBSUUvinQYKBRUqlbigxvVjAhfDNvik4b9cxB8zsDQ5RUNQr1ynQxo73PfMYu2LeyEzKFxn6fV+c1bDcPd39oHBa/K7asUSy5sBOv8yNNlPezVqIcgfign7ZMu0fPTpIaUrrgAf0UZcxsJ/h7kevci8c7/uP/OH5C/qyROYiyn1KV3S9Btx2rgQKGsHke6DMYVV8qpvGVIeb+CKChg8GIVs=
2021-02-27T14:56:24.138 INFO:teuthology.kill:2021-02-27 14:56:24,138.138 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-27T14:56:24.141 INFO:teuthology.kill:2021-02-27 14:56:24,140.140 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-27T14:56:24.208 INFO:teuthology.kill:2021-02-27 14:56:24,207.207 INFO:teuthology.orchestra.console:Power off smithi145
2021-02-27T14:56:24.275 INFO:teuthology.kill:2021-02-27 14:56:24,275.275 INFO:teuthology.orchestra.console:Power off smithi137
2021-02-27T14:56:32.621 INFO:teuthology.kill:2021-02-27 14:56:32,620.620 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2021-02-27T14:56:32.670 INFO:teuthology.kill:2021-02-27 14:56:32,670.670 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2021-02-27T14:56:32.935 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-02-27T14:56:32.935 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']
2021-02-27T14:56:32.936 INFO:teuthology.misc:Compressing logs...
2021-02-27T14:56:32.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-27T14:57:07.523 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_7a21eca3942b97058be0400a6c70d71b16304bdb/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-02-27T14:57:07.596 INFO:teuthology.kill:No teuthology processes running
2021-02-27T14:57:08.663 INFO:teuthology.kill:Nuking machines: ['smithi137', 'smithi145']
2021-02-27T14:57:09.591 INFO:teuthology.kill:2021-02-27 14:57:09,591.591 INFO:teuthology.nuke:targets:
2021-02-27T14:57:09.592 INFO:teuthology.kill:  smithi137.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCq5LCIhKg3l8ExKhBSAgjQ2SN493J3FhYc2CcrTzD1vfLlamP0Ki50/k8v40VUHwkL4srhz4ocmzaOhyWwdKT6wt3zig6Kqml2B+CmhonXDNEafSyY3O7ZDfVuFxWgrxUVUMVknyY2lRdKNHRWBo0AfUUrYmJMcz+4fhGTXR+GpmYQhyZjmMedNgCq4njQTEIXVVG+IHzTxFlK6yyQSUWaHKpR/GmSdC+h/NfD22wdzFGRxV975XM/pmThRF4K0aKspCwqMqxc/xxasmHCYGAtkVtxxaPZwSTAEkQArHJavOmOWqtr6Nd926V2AxgNlCaxa6TA+AVQjzzhiSSBoXqeEegn26NwgRF64ucnuwLoxau0NXS8rok9Pgf0TFWJXczEk79nAcRuNRxmBsZMORINU+0rTPq3O6Bi6QfmZ//IErQlEijB0cdbSq9y8PlruIOS7rNM8KYHnVvqxsg7JS5LG8Ws53GxuCPbRd7/Q+SLakFk/uMgFgVY3fwU2Mz6BEU=
2021-02-27T14:57:09.592 INFO:teuthology.kill:  smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvhtczyZy3kX5xZqrOg3rcLJoMU7ac0Ih+ic4rofDJj5oTZw2Si/r4U+5EhFr0R93CCdFx+t4y5CyqDbKiFJLSjbJnBD8hrxTKdRvIcEf8HlnrhnYFDn3IafcHFwz/FWKopmKU3WkzzokVsdPrzFUwYag6kRqlgWOK8ACBQQJehJuCrJXDkIyHNzuB3Ykb5FEVxu1BZETdGICvsjI55YETO2+ame5xZkvpj88zphK3YfyGS9VjPk78aom6SR8Mr+fK4ZfSI4tGbiIqXUTc7NNlysoUN6k2kKPXa55x6/PPeBSUUvinQYKBRUqlbigxvVjAhfDNvik4b9cxB8zsDQ5RUNQr1ynQxo73PfMYu2LeyEzKFxn6fV+c1bDcPd39oHBa/K7asUSy5sBOv8yNNlPezVqIcgfign7ZMu0fPTpIaUrrgAf0UZcxsJ/h7kevci8c7/uP/OH5C/qyROYiyn1KV3S9Btx2rgQKGsHke6DMYVV8qpvGVIeb+CKChg8GIVs=
2021-02-27T14:57:09.613 INFO:teuthology.kill:2021-02-27 14:57:09,612.612 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-27T14:57:09.615 INFO:teuthology.kill:2021-02-27 14:57:09,615.615 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-27T14:57:09.674 INFO:teuthology.kill:2021-02-27 14:57:09,674.674 INFO:teuthology.orchestra.console:Power off smithi145
2021-02-27T14:57:09.689 INFO:teuthology.kill:2021-02-27 14:57:09,688.688 INFO:teuthology.orchestra.console:Power off smithi137
2021-02-27T14:57:09.820 INFO:teuthology.kill:2021-02-27 14:57:09,819.819 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2021-02-27T14:57:09.831 INFO:teuthology.kill:2021-02-27 14:57:09,831.831 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2021-02-27T14:57:09.965 INFO:teuthology.kill:2021-02-27 14:57:09,964.964 INFO:teuthology.lock.ops:unlocked smithi145.front.sepia.ceph.com
2021-02-27T14:57:09.971 INFO:teuthology.kill:2021-02-27 14:57:09,971.971 INFO:teuthology.lock.ops:unlocked smithi137.front.sepia.ceph.com
2021-02-27T14:59:10.258 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-02-27T14:59:10.359 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-02-27T14:59:10.360 INFO:teuthology.nuke:Checking targets against current locks
2021-02-27T14:59:10.427 INFO:teuthology.nuke:Not nuking smithi137.front.sepia.ceph.com because description doesn't match
2021-02-27T14:59:10.427 INFO:teuthology.nuke:Not nuking smithi145.front.sepia.ceph.com because description doesn't match