2021-05-12T04:41:21.680 INFO:root:teuthology version: 1.1.0-19220a3b
2021-05-12T04:41:21.783 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi070.front.sepia.ceph.com' reimaging
2021-05-12T04:41:21.784 INFO:teuthology.lock.ops:Updating [ubuntu@smithi070.front.sepia.ceph.com]: reset os type and version on server
2021-05-12T04:41:21.785 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server
2021-05-12T04:41:21.800 INFO:teuthology.lock.ops:Node 'ubuntu@smithi070.front.sepia.ceph.com' reimaging is complete
2021-05-12T04:41:21.801 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging
2021-05-12T04:41:21.801 INFO:teuthology.lock.ops:Updating [ubuntu@smithi170.front.sepia.ceph.com]: reset os type and version on server
2021-05-12T04:41:21.801 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2021-05-12T04:41:21.825 INFO:teuthology.lock.ops:Node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging is complete
2021-05-12T04:41:22.030 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of rhel 8.3
2021-05-12T04:41:22.060 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of rhel 8.3
2021-05-12T04:41:22.409 INFO:teuthology.orchestra.console:Power off smithi070
2021-05-12T04:41:22.451 INFO:teuthology.orchestra.console:Power off smithi170
2021-05-12T04:41:30.784 INFO:teuthology.orchestra.console:Power off for smithi070 completed
2021-05-12T04:41:30.828 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2021-05-12T04:41:30.886 INFO:teuthology.orchestra.console:Power on smithi070
2021-05-12T04:41:30.930 INFO:teuthology.orchestra.console:Power on smithi170
2021-05-12T04:41:39.394 INFO:teuthology.orchestra.console:Power on for smithi070 completed
2021-05-12T04:41:39.399 INFO:teuthology.orchestra.console:Power on for smithi170 completed
2021-05-12T04:41:39.496 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish
2021-05-12T04:41:39.500 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish
2021-05-12T04:46:11.753 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-12T04:46:11.820 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-12T04:46:12.050 INFO:teuthology.provision.fog.smithi070:Node is ready
2021-05-12T04:46:12.068 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com
2021-05-12T04:46:12.122 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070
2021-05-12T04:46:12.125 INFO:teuthology.provision.fog.smithi170:Node is ready
2021-05-12T04:46:12.139 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com
2021-05-12T04:46:12.195 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170
2021-05-12T04:46:12.473 INFO:teuthology.provision.fog.smithi070:Deploy complete!
2021-05-12T04:46:12.536 INFO:teuthology.provision.fog.smithi170:Deploy complete!
2021-05-12T04:46:12.662 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com
2021-05-12T04:46:12.663 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-12T04:46:12.684 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com
2021-05-12T04:46:12.685 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-12T04:46:12.713 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server
2021-05-12T04:46:12.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-12T04:46:13.047 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64
2021-05-12T04:46:13.101 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Red Hat Enterprise Linux"
2021-05-12T04:46:13.102 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8.3 (Ootpa)"
2021-05-12T04:46:13.102 INFO:teuthology.orchestra.run.smithi070.stdout:ID="rhel"
2021-05-12T04:46:13.102 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="fedora"
2021-05-12T04:46:13.102 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8.3"
2021-05-12T04:46:13.103 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8"
2021-05-12T04:46:13.103 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-05-12T04:46:13.103 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31"
2021-05-12T04:46:13.103 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-05-12T04:46:13.103 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.redhat.com/"
2021-05-12T04:46:13.104 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-05-12T04:46:13.104 INFO:teuthology.orchestra.run.smithi070.stdout:
2021-05-12T04:46:13.109 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-05-12T04:46:13.109 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-05-12T04:46:13.110 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-05-12T04:46:13.110 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-05-12T04:46:13.111 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server
2021-05-12T04:46:13.127 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server
2021-05-12T04:46:13.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-12T04:46:13.409 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64
2021-05-12T04:46:13.463 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux"
2021-05-12T04:46:13.463 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.3 (Ootpa)"
2021-05-12T04:46:13.463 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel"
2021-05-12T04:46:13.464 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora"
2021-05-12T04:46:13.464 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.3"
2021-05-12T04:46:13.464 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8"
2021-05-12T04:46:13.464 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-05-12T04:46:13.465 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2021-05-12T04:46:13.465 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-05-12T04:46:13.465 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/"
2021-05-12T04:46:13.465 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-05-12T04:46:13.465 INFO:teuthology.orchestra.run.smithi170.stdout:
2021-05-12T04:46:13.466 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-05-12T04:46:13.466 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-05-12T04:46:13.466 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-05-12T04:46:13.466 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-05-12T04:46:13.467 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2021-05-12T04:46:14.597 INFO:teuthology.dispatcher.supervisor:Running job 6110703
2021-05-12T04:46:14.598 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2021-05-12_04:01:31-fs-wip-pdonnell-testing-20210511.232042-distro-basic-smithi/6110703 --name pdonnell-2021-05-12_04:01:31-fs-wip-pdonnell-testing-20210511.232042-distro-basic-smithi --description fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/snaps}} -- /home/teuthworker/archive/pdonnell-2021-05-12_04:01:31-fs-wip-pdonnell-testing-20210511.232042-distro-basic-smithi/6110703/orig.config.yaml
2021-05-12T04:46:14.602 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2021-05-12_04:01:31-fs-wip-pdonnell-testing-20210511.232042-distro-basic-smithi/6110703
2021-05-12T04:46:14.603 INFO:teuthology.dispatcher.supervisor:Job PID: 12082
2021-05-12T04:46:14.603 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-05-12T16:47:04.191 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-05-12T16:47:04.370 INFO:teuthology.kill:Killing Pids: {12082}
2021-05-12T16:47:05.385 INFO:teuthology.kill:Nuking machines: ['smithi070', 'smithi170']
2021-05-12T16:47:06.258 INFO:teuthology.kill:2021-05-12 16:47:06,258.258 INFO:teuthology.nuke:targets:
2021-05-12T16:47:06.259 INFO:teuthology.kill:  smithi070.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ1PgXIAkHwcR3Etx1waqufdY3YYb8VVpEs4F2cYSAHxmDVNA6hwuH10lkFnqQu/e/74CvtjnrNIun5jylIVeL+gS5CgSpmbUWDDsU4QHdyzaYt8R9f73PhjV7HT8SR5OuViNJFmrAVHEJMq/fd9WJCWia5eEigNXVys0DNHs4n9/xtZmTx34gzKKVJ3sn1kuPiwUB7g1W/rysS8Jck0x63C5OoEhq3EPvy4UcZxRIRIHsfYFxIxwcGYB+J6Je6vJHv2dCEIwX+3NSAkLC/Oa7iZIhUpTO+44Se5TnRthlXIZwewR66/ID+Ym4SaYu8TBDgCojbp3gr0M+0JFwkbdXIfGYGwO3aHGEjJ83BjMdhV9eFsZxcn8sUYDN1eogTyfRTo0yPxDXQaBg/+JQbHaEXtKXPVeU6X6Q+S+k9AwLqbXrncf/Y2MozUCr1iObmtO0Uq9qp326EFw7JbIiVsNoasBOyIyboPjTOrgELVVR61EfbLiXJ85C4ewVTQkBkN0=
2021-05-12T16:47:06.259 INFO:teuthology.kill:  smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC67rRvHqvCBYWSR7//CdY+71SuSbZ4vr6hcOIpAKdmSxLgpzrI36S15Zg+LyLxJexHTWZHM57J3K2Y6FQpdpgn3QBwmbZWu/WexyFV5l7yEiZVjgLHUSm8Viuh4oAEi6xS8Kxxg2xOoFXJ42LMNqDnCmMABo3qpJniRfDfBLcdb/3fSMib+zybkwAictym0c0pphdcEDf1eEg9jFXPr9PY7uh2MUm8iDIchTpISp9tlmLsCKUnmJ7geZ30qq2hviY5g/6jXf3B2LHrqH7cuqPWhGTRY3UNhYfV/OmUUlTFqWDlhYpDenrEHHS9k1x7192yLHqd/zWQ41ptovONlU71nc5szyJd90tY8MPozsIcE7KJ90sFEEQButG9Ceq/+/oUgVlsXrPm44TnSv/udwICRNurWfbEs6RJq5/mo0ZUjif1haS6TSfwyvQykAzLrEGtbXNE82o0PaiPjXGsfHY5kzARmhyqIIGuIZHuIR49lvc8VgUuLePwrWlo+2m89xk=
2021-05-12T16:47:06.260 INFO:teuthology.kill:2021-05-12 16:47:06,258.258 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-12T16:47:06.260 INFO:teuthology.kill:2021-05-12 16:47:06,260.260 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-12T16:47:06.319 INFO:teuthology.kill:2021-05-12 16:47:06,319.319 INFO:teuthology.orchestra.console:Power off smithi170
2021-05-12T16:47:06.332 INFO:teuthology.kill:2021-05-12 16:47:06,332.332 INFO:teuthology.orchestra.console:Power off smithi070
2021-05-12T16:47:14.708 INFO:teuthology.kill:2021-05-12 16:47:14,708.708 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2021-05-12T16:47:18.811 INFO:teuthology.kill:2021-05-12 16:47:18,810.810 INFO:teuthology.orchestra.console:Power off for smithi070 completed
2021-05-12T16:47:19.016 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-05-12T16:47:19.016 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-05-12T16:47:19.017 INFO:teuthology.misc:Compressing logs...
2021-05-12T16:47:19.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-12T16:47:53.547 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-05-12T16:47:53.611 INFO:teuthology.kill:No teuthology processes running
2021-05-12T16:47:54.574 INFO:teuthology.kill:Nuking machines: ['smithi070', 'smithi170']
2021-05-12T16:47:55.440 INFO:teuthology.kill:2021-05-12 16:47:55,439.439 INFO:teuthology.nuke:targets:
2021-05-12T16:47:55.441 INFO:teuthology.kill:  smithi070.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ1PgXIAkHwcR3Etx1waqufdY3YYb8VVpEs4F2cYSAHxmDVNA6hwuH10lkFnqQu/e/74CvtjnrNIun5jylIVeL+gS5CgSpmbUWDDsU4QHdyzaYt8R9f73PhjV7HT8SR5OuViNJFmrAVHEJMq/fd9WJCWia5eEigNXVys0DNHs4n9/xtZmTx34gzKKVJ3sn1kuPiwUB7g1W/rysS8Jck0x63C5OoEhq3EPvy4UcZxRIRIHsfYFxIxwcGYB+J6Je6vJHv2dCEIwX+3NSAkLC/Oa7iZIhUpTO+44Se5TnRthlXIZwewR66/ID+Ym4SaYu8TBDgCojbp3gr0M+0JFwkbdXIfGYGwO3aHGEjJ83BjMdhV9eFsZxcn8sUYDN1eogTyfRTo0yPxDXQaBg/+JQbHaEXtKXPVeU6X6Q+S+k9AwLqbXrncf/Y2MozUCr1iObmtO0Uq9qp326EFw7JbIiVsNoasBOyIyboPjTOrgELVVR61EfbLiXJ85C4ewVTQkBkN0=
2021-05-12T16:47:55.441 INFO:teuthology.kill:  smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC67rRvHqvCBYWSR7//CdY+71SuSbZ4vr6hcOIpAKdmSxLgpzrI36S15Zg+LyLxJexHTWZHM57J3K2Y6FQpdpgn3QBwmbZWu/WexyFV5l7yEiZVjgLHUSm8Viuh4oAEi6xS8Kxxg2xOoFXJ42LMNqDnCmMABo3qpJniRfDfBLcdb/3fSMib+zybkwAictym0c0pphdcEDf1eEg9jFXPr9PY7uh2MUm8iDIchTpISp9tlmLsCKUnmJ7geZ30qq2hviY5g/6jXf3B2LHrqH7cuqPWhGTRY3UNhYfV/OmUUlTFqWDlhYpDenrEHHS9k1x7192yLHqd/zWQ41ptovONlU71nc5szyJd90tY8MPozsIcE7KJ90sFEEQButG9Ceq/+/oUgVlsXrPm44TnSv/udwICRNurWfbEs6RJq5/mo0ZUjif1haS6TSfwyvQykAzLrEGtbXNE82o0PaiPjXGsfHY5kzARmhyqIIGuIZHuIR49lvc8VgUuLePwrWlo+2m89xk=
2021-05-12T16:47:55.459 INFO:teuthology.kill:2021-05-12 16:47:55,459.459 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-12T16:47:55.462 INFO:teuthology.kill:2021-05-12 16:47:55,462.462 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-12T16:47:55.516 INFO:teuthology.kill:2021-05-12 16:47:55,516.516 INFO:teuthology.orchestra.console:Power off smithi170
2021-05-12T16:47:55.550 INFO:teuthology.kill:2021-05-12 16:47:55,550.550 INFO:teuthology.orchestra.console:Power off smithi070
2021-05-12T16:47:55.661 INFO:teuthology.kill:2021-05-12 16:47:55,660.660 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2021-05-12T16:47:55.686 INFO:teuthology.kill:2021-05-12 16:47:55,686.686 INFO:teuthology.orchestra.console:Power off for smithi070 completed
2021-05-12T16:47:55.798 INFO:teuthology.kill:2021-05-12 16:47:55,798.798 INFO:teuthology.lock.ops:unlocked smithi170.front.sepia.ceph.com
2021-05-12T16:47:55.820 INFO:teuthology.kill:2021-05-12 16:47:55,820.820 INFO:teuthology.lock.ops:unlocked smithi070.front.sepia.ceph.com
2021-05-12T16:49:56.065 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-05-12T16:49:56.160 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-05-12T16:49:56.161 INFO:teuthology.nuke:Checking targets against current locks
2021-05-12T16:49:56.229 INFO:teuthology.nuke:Not nuking smithi170.front.sepia.ceph.com because description doesn't match
2021-05-12T16:49:56.229 INFO:teuthology.nuke:Not nuking smithi070.front.sepia.ceph.com because description doesn't match