2021-05-26T23:43:01.193 INFO:root:teuthology version: 1.1.0-d92ec140
2021-05-26T23:43:01.288 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging
2021-05-26T23:43:01.289 INFO:teuthology.lock.ops:Updating [ubuntu@smithi105.front.sepia.ceph.com]: reset os type and version on server
2021-05-26T23:43:01.290 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2021-05-26T23:43:01.309 INFO:teuthology.lock.ops:Node 'ubuntu@smithi105.front.sepia.ceph.com' reimaging is complete
2021-05-26T23:43:01.309 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi148.front.sepia.ceph.com' reimaging
2021-05-26T23:43:01.309 INFO:teuthology.lock.ops:Updating [ubuntu@smithi148.front.sepia.ceph.com]: reset os type and version on server
2021-05-26T23:43:01.310 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2021-05-26T23:43:01.324 INFO:teuthology.lock.ops:Node 'ubuntu@smithi148.front.sepia.ceph.com' reimaging is complete
2021-05-26T23:43:01.521 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of rhel 8.3
2021-05-26T23:43:01.529 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of rhel 8.3
2021-05-26T23:43:01.886 INFO:teuthology.orchestra.console:Power off smithi105
2021-05-26T23:43:01.900 INFO:teuthology.orchestra.console:Power off smithi148
2021-05-26T23:43:10.256 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2021-05-26T23:43:10.270 INFO:teuthology.orchestra.console:Power off for smithi148 completed
2021-05-26T23:43:10.358 INFO:teuthology.orchestra.console:Power on smithi105
2021-05-26T23:43:10.371 INFO:teuthology.orchestra.console:Power on smithi148
2021-05-26T23:43:18.724 INFO:teuthology.orchestra.console:Power on for smithi105 completed
2021-05-26T23:43:18.733 INFO:teuthology.orchestra.console:Power on for smithi148 completed
2021-05-26T23:43:18.826 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2021-05-26T23:43:18.835 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish
2021-05-26T23:45:50.033 ERROR:teuthology.orchestra.connection:Error authenticating with smithi148.front.sepia.ceph.com: Authentication failed.
2021-05-26T23:47:50.657 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-26T23:47:50.962 INFO:teuthology.provision.fog.smithi105:Node is ready
2021-05-26T23:47:50.976 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2021-05-26T23:47:51.031 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2021-05-26T23:47:51.362 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2021-05-26T23:48:03.272 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-26T23:48:03.590 INFO:teuthology.provision.fog.smithi148:Node is ready
2021-05-26T23:48:03.605 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com
2021-05-26T23:48:03.659 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148
2021-05-26T23:48:03.997 INFO:teuthology.provision.fog.smithi148:Deploy complete!
2021-05-26T23:48:04.117 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2021-05-26T23:48:04.118 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-26T23:48:04.135 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com
2021-05-26T23:48:04.136 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-26T23:48:04.150 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2021-05-26T23:48:04.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-26T23:48:04.435 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2021-05-26T23:48:04.489 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux"
2021-05-26T23:48:04.489 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.3 (Ootpa)"
2021-05-26T23:48:04.489 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel"
2021-05-26T23:48:04.489 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora"
2021-05-26T23:48:04.490 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.3"
2021-05-26T23:48:04.490 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2021-05-26T23:48:04.490 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-05-26T23:48:04.490 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2021-05-26T23:48:04.491 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-05-26T23:48:04.491 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/"
2021-05-26T23:48:04.491 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-05-26T23:48:04.491 INFO:teuthology.orchestra.run.smithi105.stdout:
2021-05-26T23:48:04.492 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-05-26T23:48:04.492 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-05-26T23:48:04.492 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-05-26T23:48:04.492 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-05-26T23:48:04.493 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2021-05-26T23:48:04.509 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server
2021-05-26T23:48:04.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-26T23:48:04.787 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64
2021-05-26T23:48:04.840 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux"
2021-05-26T23:48:04.840 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.3 (Ootpa)"
2021-05-26T23:48:04.840 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel"
2021-05-26T23:48:04.841 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora"
2021-05-26T23:48:04.841 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.3"
2021-05-26T23:48:04.841 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8"
2021-05-26T23:48:04.841 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-05-26T23:48:04.841 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31"
2021-05-26T23:48:04.842 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-05-26T23:48:04.842 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/"
2021-05-26T23:48:04.842 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-05-26T23:48:04.842 INFO:teuthology.orchestra.run.smithi148.stdout:
2021-05-26T23:48:04.843 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-05-26T23:48:04.843 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-05-26T23:48:04.843 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-05-26T23:48:04.843 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-05-26T23:48:04.844 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2021-05-26T23:48:04.931 INFO:teuthology.dispatcher.supervisor:Running job 6133110
2021-05-26T23:48:04.931 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-05-25_04:17:02-fs-pacific-distro-basic-smithi/6133110 --name teuthology-2021-05-25_04:17:02-fs-pacific-distro-basic-smithi --description fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} -- /home/teuthworker/archive/teuthology-2021-05-25_04:17:02-fs-pacific-distro-basic-smithi/6133110/orig.config.yaml
2021-05-26T23:48:04.934 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-05-25_04:17:02-fs-pacific-distro-basic-smithi/6133110
2021-05-26T23:48:04.935 INFO:teuthology.dispatcher.supervisor:Job PID: 3088
2021-05-26T23:48:04.935 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-05-27T11:48:20.653 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-05-27T11:48:20.856 INFO:teuthology.kill:Killing Pids: {3088}
2021-05-27T11:48:21.845 INFO:teuthology.kill:Nuking machines: ['smithi105', 'smithi148']
2021-05-27T11:48:22.661 INFO:teuthology.kill:2021-05-27 11:48:22,661.661 INFO:teuthology.nuke:targets:
2021-05-27T11:48:22.662 INFO:teuthology.kill:  smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzWtVDZG6rojIBajZnM1/wwuEzvYoETlataWF5MmBav5M0+8WgoPaySDSj6cobgosc1mjltxD5HdQU4/7kOKB5sm/FAm1d5Nc43DHRaBot18HWeEZ6TpHWAgzHTCtJLtFA+ngXTjR4W4JQ8Aanfn32MJ8vWmeDzuV+90MLK3AAZ/+R8GabtEZOyV2CiJWerwcDU4Bk9Drf2S7hLzl1De8y1eE/ODGlqtYSn+UGLX4uq6ihaLk8eL9uNoIg1XtZJfEIrOTsEZjCDqvpguNDPb7jx4mHoNC1wG3AG+Nke0S7pTzjpMxTl76HOp9XC3nV+U40p6nVmjfL4A1LD82w+NXf3+fKCocwB/lkergBT+MuvenzBEEi1UBDkMkD3Bb/4ISxwADhaozVyiSu5v868H6Z89oxvw8cH34YanEu5SYkDkxgbs+PDliItkeExDVME3PAdLZ0wgpG3Fu5XqyXsGiLZHr3PYLi9f9/g6eXX4Ity9/2IPcVhZhYvFFyenWlSH0=
2021-05-27T11:48:22.663 INFO:teuthology.kill:  smithi148.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYvJUUNGC9cWApuWs9btcIk5NyC4rQLqTHZD37fyq+3L2dnony3kTKJkJgH10cf237TL0lJJsvEXtWoGANKfBQE3lWzQ3zB0TsFaXa1vVkjHwWG+keaHvNxN+DDZIGZX8AcQfBA7uBI1y9eJ8PIT0OyJm22kAY3IZ6EddMAt7kAcVYFsqXzQTYKU01ZiYAar8gJu7drrVE+xCnDoQNdzVukErNPvPsXsLSC2GWWxSwCawZDj1YtqT+1+IwM0YjlQ8SjceZi8dwEqgGGUNRS1FqmxT1cp5I4yUKptI3RkcWt8RsO6LIw3BuF65sd7jveUeDRnJkylj1HTNFJhgKzS/oaS1GY+RqV9dfY5Y+lpM1b+r5K/9asLCbk+taxqAzcGV4BGEeHythfyA+kYgQsSSejQINEJAtBixBaILPqRvM2uCnbpJpY075/FbKtXvGo0b1v3F8iMyRXe/WJ6F8AemUmnEf+Z1ik7jK0htT1T0BfH4gqjA4O4I3E5/8jnlT3N8=
2021-05-27T11:48:22.663 INFO:teuthology.kill:2021-05-27 11:48:22,662.662 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-27T11:48:22.664 INFO:teuthology.kill:2021-05-27 11:48:22,664.664 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-27T11:48:22.718 INFO:teuthology.kill:2021-05-27 11:48:22,717.717 INFO:teuthology.orchestra.console:Power off smithi148
2021-05-27T11:48:22.729 INFO:teuthology.kill:2021-05-27 11:48:22,729.729 INFO:teuthology.orchestra.console:Power off smithi105
2021-05-27T11:48:31.086 INFO:teuthology.kill:2021-05-27 11:48:31,086.086 INFO:teuthology.orchestra.console:Power off for smithi148 completed
2021-05-27T11:48:35.206 INFO:teuthology.kill:2021-05-27 11:48:35,206.206 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2021-05-27T11:48:35.428 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-05-27T11:48:35.428 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-05-27T11:48:35.429 INFO:teuthology.misc:Compressing logs...
2021-05-27T11:48:35.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-27T11:49:35.434 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d92ec1407c30d60262a45a2844110a5c94d567cc/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-05-27T11:49:35.503 INFO:teuthology.kill:No teuthology processes running
2021-05-27T11:49:36.457 INFO:teuthology.kill:Nuking machines: ['smithi105', 'smithi148']
2021-05-27T11:49:37.273 INFO:teuthology.kill:2021-05-27 11:49:37,272.272 INFO:teuthology.nuke:targets:
2021-05-27T11:49:37.274 INFO:teuthology.kill:  smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzWtVDZG6rojIBajZnM1/wwuEzvYoETlataWF5MmBav5M0+8WgoPaySDSj6cobgosc1mjltxD5HdQU4/7kOKB5sm/FAm1d5Nc43DHRaBot18HWeEZ6TpHWAgzHTCtJLtFA+ngXTjR4W4JQ8Aanfn32MJ8vWmeDzuV+90MLK3AAZ/+R8GabtEZOyV2CiJWerwcDU4Bk9Drf2S7hLzl1De8y1eE/ODGlqtYSn+UGLX4uq6ihaLk8eL9uNoIg1XtZJfEIrOTsEZjCDqvpguNDPb7jx4mHoNC1wG3AG+Nke0S7pTzjpMxTl76HOp9XC3nV+U40p6nVmjfL4A1LD82w+NXf3+fKCocwB/lkergBT+MuvenzBEEi1UBDkMkD3Bb/4ISxwADhaozVyiSu5v868H6Z89oxvw8cH34YanEu5SYkDkxgbs+PDliItkeExDVME3PAdLZ0wgpG3Fu5XqyXsGiLZHr3PYLi9f9/g6eXX4Ity9/2IPcVhZhYvFFyenWlSH0=
2021-05-27T11:49:37.274 INFO:teuthology.kill:  smithi148.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYvJUUNGC9cWApuWs9btcIk5NyC4rQLqTHZD37fyq+3L2dnony3kTKJkJgH10cf237TL0lJJsvEXtWoGANKfBQE3lWzQ3zB0TsFaXa1vVkjHwWG+keaHvNxN+DDZIGZX8AcQfBA7uBI1y9eJ8PIT0OyJm22kAY3IZ6EddMAt7kAcVYFsqXzQTYKU01ZiYAar8gJu7drrVE+xCnDoQNdzVukErNPvPsXsLSC2GWWxSwCawZDj1YtqT+1+IwM0YjlQ8SjceZi8dwEqgGGUNRS1FqmxT1cp5I4yUKptI3RkcWt8RsO6LIw3BuF65sd7jveUeDRnJkylj1HTNFJhgKzS/oaS1GY+RqV9dfY5Y+lpM1b+r5K/9asLCbk+taxqAzcGV4BGEeHythfyA+kYgQsSSejQINEJAtBixBaILPqRvM2uCnbpJpY075/FbKtXvGo0b1v3F8iMyRXe/WJ6F8AemUmnEf+Z1ik7jK0htT1T0BfH4gqjA4O4I3E5/8jnlT3N8=
2021-05-27T11:49:37.291 INFO:teuthology.kill:2021-05-27 11:49:37,291.291 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-27T11:49:37.293 INFO:teuthology.kill:2021-05-27 11:49:37,293.293 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-27T11:49:37.346 INFO:teuthology.kill:2021-05-27 11:49:37,345.345 INFO:teuthology.orchestra.console:Power off smithi148
2021-05-27T11:49:37.357 INFO:teuthology.kill:2021-05-27 11:49:37,357.357 INFO:teuthology.orchestra.console:Power off smithi105
2021-05-27T11:49:37.487 INFO:teuthology.kill:2021-05-27 11:49:37,487.487 INFO:teuthology.orchestra.console:Power off for smithi148 completed
2021-05-27T11:49:37.492 INFO:teuthology.kill:2021-05-27 11:49:37,492.492 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2021-05-27T11:49:37.625 INFO:teuthology.kill:2021-05-27 11:49:37,624.624 INFO:teuthology.lock.ops:unlocked smithi148.front.sepia.ceph.com
2021-05-27T11:49:37.630 INFO:teuthology.kill:2021-05-27 11:49:37,630.630 INFO:teuthology.lock.ops:unlocked smithi105.front.sepia.ceph.com
2021-05-27T11:51:37.782 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15