2021-04-16T23:20:37.251 INFO:root:teuthology version: 1.1.0-2713a3cd
2021-04-16T23:20:37.383 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi106.front.sepia.ceph.com' reimaging
2021-04-16T23:20:37.384 INFO:teuthology.lock.ops:Updating [ubuntu@smithi106.front.sepia.ceph.com]: reset os type and version on server
2021-04-16T23:20:37.384 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2021-04-16T23:20:37.399 INFO:teuthology.lock.ops:Node 'ubuntu@smithi106.front.sepia.ceph.com' reimaging is complete
2021-04-16T23:20:37.400 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging
2021-04-16T23:20:37.400 INFO:teuthology.lock.ops:Updating [ubuntu@smithi196.front.sepia.ceph.com]: reset os type and version on server
2021-04-16T23:20:37.400 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2021-04-16T23:20:37.422 INFO:teuthology.lock.ops:Node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging is complete
2021-04-16T23:20:37.617 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of rhel 8.3
2021-04-16T23:20:37.640 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of rhel 8.3
2021-04-16T23:20:37.985 INFO:teuthology.orchestra.console:Power off smithi106
2021-04-16T23:20:38.020 INFO:teuthology.orchestra.console:Power off smithi196
2021-04-16T23:20:38.160 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2021-04-16T23:20:38.262 INFO:teuthology.orchestra.console:Power on smithi196
2021-04-16T23:20:42.520 INFO:teuthology.orchestra.console:Power on for smithi196 completed
2021-04-16T23:20:42.621 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2021-04-16T23:20:46.351 INFO:teuthology.orchestra.console:Power off for smithi106 completed
2021-04-16T23:20:46.452 INFO:teuthology.orchestra.console:Power on smithi106
2021-04-16T23:20:50.708 INFO:teuthology.orchestra.console:Power on for smithi106 completed
2021-04-16T23:20:50.810 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish
2021-04-16T23:24:53.347 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-16T23:25:13.859 INFO:teuthology.provision.fog.smithi196:Node is ready
2021-04-16T23:25:13.880 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2021-04-16T23:25:13.937 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2021-04-16T23:25:14.302 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2021-04-16T23:25:37.975 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-16T23:25:38.292 INFO:teuthology.provision.fog.smithi106:Node is ready
2021-04-16T23:25:38.307 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com
2021-04-16T23:25:38.362 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106
2021-04-16T23:25:38.681 INFO:teuthology.provision.fog.smithi106:Deploy complete!
2021-04-16T23:25:38.822 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com
2021-04-16T23:25:38.823 INFO:teuthology.lock.ops:New key found. Updating...
2021-04-16T23:25:38.844 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2021-04-16T23:25:38.845 INFO:teuthology.lock.ops:New key found. Updating...
2021-04-16T23:25:38.860 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server
2021-04-16T23:25:38.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-16T23:25:39.151 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64
2021-04-16T23:25:39.206 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Red Hat Enterprise Linux"
2021-04-16T23:25:39.207 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8.3 (Ootpa)"
2021-04-16T23:25:39.207 INFO:teuthology.orchestra.run.smithi106.stdout:ID="rhel"
2021-04-16T23:25:39.208 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="fedora"
2021-04-16T23:25:39.208 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8.3"
2021-04-16T23:25:39.208 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8"
2021-04-16T23:25:39.209 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-04-16T23:25:39.209 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31"
2021-04-16T23:25:39.210 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-04-16T23:25:39.210 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.redhat.com/"
2021-04-16T23:25:39.211 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-04-16T23:25:39.211 INFO:teuthology.orchestra.run.smithi106.stdout:
2021-04-16T23:25:39.211 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-04-16T23:25:39.212 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-04-16T23:25:39.212 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-04-16T23:25:39.213 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-04-16T23:25:39.215 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2021-04-16T23:25:39.233 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2021-04-16T23:25:39.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-16T23:25:39.523 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2021-04-16T23:25:39.577 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux"
2021-04-16T23:25:39.578 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.3 (Ootpa)"
2021-04-16T23:25:39.578 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel"
2021-04-16T23:25:39.578 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora"
2021-04-16T23:25:39.578 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.3"
2021-04-16T23:25:39.579 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2021-04-16T23:25:39.579 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-04-16T23:25:39.579 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2021-04-16T23:25:39.579 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-04-16T23:25:39.579 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/"
2021-04-16T23:25:39.580 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-04-16T23:25:39.580 INFO:teuthology.orchestra.run.smithi196.stdout:
2021-04-16T23:25:39.580 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-04-16T23:25:39.580 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-04-16T23:25:39.581 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-04-16T23:25:39.581 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-04-16T23:25:39.581 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2021-04-16T23:25:39.692 INFO:teuthology.dispatcher.supervisor:Running job 6051053
2021-04-16T23:25:39.692 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-04-16_04:17:02-fs-pacific-distro-basic-smithi/6051053 --name teuthology-2021-04-16_04:17:02-fs-pacific-distro-basic-smithi --description fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} -- /home/teuthworker/archive/teuthology-2021-04-16_04:17:02-fs-pacific-distro-basic-smithi/6051053/orig.config.yaml
2021-04-16T23:25:39.698 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-04-16_04:17:02-fs-pacific-distro-basic-smithi/6051053
2021-04-16T23:25:39.699 INFO:teuthology.dispatcher.supervisor:Job PID: 26569
2021-04-16T23:25:39.699 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-04-17T11:27:40.648 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-04-17T11:27:40.905 INFO:teuthology.kill:Killing Pids: {26569}
2021-04-17T11:27:42.021 INFO:teuthology.kill:Nuking machines: ['smithi106', 'smithi196']
2021-04-17T11:27:42.948 INFO:teuthology.kill:2021-04-17 11:27:42,948.948 INFO:teuthology.nuke:targets:
2021-04-17T11:27:42.949 INFO:teuthology.kill:  smithi106.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSkHRi/nx5l+rLp60ahn6txLy24l8GrL8a1rDIhjxflgcWLy3Bw/qJGikfM+zpBun/RTKY/4TU10LZfM45ErgdEbUKcpOLJwpn1i+Xo7UpgQO9TAJuCHlxh+mmhhQpJVuRk/YQXG2PsODg8s973uWWp1fkMjMqGyZ5qfLcKXmbyTMNjSsEUiX47iBefuLrQ2lQRomCW6jxER+OE7XsFOA6DjRTnnTVj9zIFb9zesIZJCu5OjdphMqV62VLt+ibgbfgkmoHFTK8/4Dcva6r/xuGBN9IQ47zTuzjUhzlVhbTQ0TaJjd9qQsRqm7S3W68Ck0Ric/hdIsrxCuI8NU68K1VINZZfhTpx2RPwr3yeFiOj5YPOSLSqAoYlvFyhdQNttP1ILkeAG3HpvkKdi2yEqdu8WflntmqJkCcjrof9ugevnnlv8rFfJ91AI82WJUgPI9nN+2IIzuKTmEmhpT3o5YLZ06IsI41kseRRR1EqKV4ntKIf9toQAgi43i+vis6vSs=
2021-04-17T11:27:42.950 INFO:teuthology.kill:  smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxBKbs3aDrfBI7SJQyJdt8N3vdH/1PXLLU0qM/C6Nah9XKVaaGR3HHqfrvggLkuAjKFmydUAuBiJzbfI2NmhGzN4K5DKu/WERNPSCz4ljMtzjiNe3xasAAO55rD1WrVZliJNuC+dY2FBOGKyEfWz4x6TOGR2gMMbo+Jx5I4yKkzDNbsJb6vQ99uGKln5F+gXhE2ZMnAjSesTyz98ZJP1Jxevnv4mKe6KTjmCm0szRnCMmbetEvP77u4OTeVzdMvz74+RP1Wq7IOTVO0oyGFdczrLNwXZaj2hTRFJ1hkhe5NqxqcQMYyClq0zKE22/j7O9a1j/gky6R/8R8vokhlMpIvvJk8kje6zplfjbJ7zwf3dnIELl0b9Pfcu+CQJMPnTPESDE3/0Ii+QFCRHSA/gyQSLYY2+oMC0paNwtD3nYHFLwMlVa2Pc3g6LzkHvfS7R4v2IDcZ3cP3nh4V5KtVhDHmSElCQXY6Pkwt0Dt2RJdDJfhck59JpbSpKhcT5vzCJs=
2021-04-17T11:27:42.950 INFO:teuthology.kill:2021-04-17 11:27:42,949.949 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-17T11:27:42.951 INFO:teuthology.kill:2021-04-17 11:27:42,951.951 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-17T11:27:43.024 INFO:teuthology.kill:2021-04-17 11:27:43,024.024 INFO:teuthology.orchestra.console:Power off smithi106
2021-04-17T11:27:43.037 INFO:teuthology.kill:2021-04-17 11:27:43,036.036 INFO:teuthology.orchestra.console:Power off smithi196
2021-04-17T11:27:55.502 INFO:teuthology.kill:2021-04-17 11:27:55,502.502 INFO:teuthology.orchestra.console:Power off for smithi106 completed
2021-04-17T11:27:55.506 INFO:teuthology.kill:2021-04-17 11:27:55,506.506 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2021-04-17T11:27:55.744 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-04-17T11:27:55.745 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-04-17T11:27:55.745 INFO:teuthology.misc:Compressing logs...
2021-04-17T11:27:55.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-17T11:28:55.750 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-04-17T11:28:55.817 INFO:teuthology.kill:No teuthology processes running
2021-04-17T11:28:56.871 INFO:teuthology.kill:Nuking machines: ['smithi106', 'smithi196']
2021-04-17T11:28:57.774 INFO:teuthology.kill:2021-04-17 11:28:57,773.773 INFO:teuthology.nuke:targets:
2021-04-17T11:28:57.774 INFO:teuthology.kill:  smithi106.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSkHRi/nx5l+rLp60ahn6txLy24l8GrL8a1rDIhjxflgcWLy3Bw/qJGikfM+zpBun/RTKY/4TU10LZfM45ErgdEbUKcpOLJwpn1i+Xo7UpgQO9TAJuCHlxh+mmhhQpJVuRk/YQXG2PsODg8s973uWWp1fkMjMqGyZ5qfLcKXmbyTMNjSsEUiX47iBefuLrQ2lQRomCW6jxER+OE7XsFOA6DjRTnnTVj9zIFb9zesIZJCu5OjdphMqV62VLt+ibgbfgkmoHFTK8/4Dcva6r/xuGBN9IQ47zTuzjUhzlVhbTQ0TaJjd9qQsRqm7S3W68Ck0Ric/hdIsrxCuI8NU68K1VINZZfhTpx2RPwr3yeFiOj5YPOSLSqAoYlvFyhdQNttP1ILkeAG3HpvkKdi2yEqdu8WflntmqJkCcjrof9ugevnnlv8rFfJ91AI82WJUgPI9nN+2IIzuKTmEmhpT3o5YLZ06IsI41kseRRR1EqKV4ntKIf9toQAgi43i+vis6vSs=
2021-04-17T11:28:57.775 INFO:teuthology.kill:  smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxBKbs3aDrfBI7SJQyJdt8N3vdH/1PXLLU0qM/C6Nah9XKVaaGR3HHqfrvggLkuAjKFmydUAuBiJzbfI2NmhGzN4K5DKu/WERNPSCz4ljMtzjiNe3xasAAO55rD1WrVZliJNuC+dY2FBOGKyEfWz4x6TOGR2gMMbo+Jx5I4yKkzDNbsJb6vQ99uGKln5F+gXhE2ZMnAjSesTyz98ZJP1Jxevnv4mKe6KTjmCm0szRnCMmbetEvP77u4OTeVzdMvz74+RP1Wq7IOTVO0oyGFdczrLNwXZaj2hTRFJ1hkhe5NqxqcQMYyClq0zKE22/j7O9a1j/gky6R/8R8vokhlMpIvvJk8kje6zplfjbJ7zwf3dnIELl0b9Pfcu+CQJMPnTPESDE3/0Ii+QFCRHSA/gyQSLYY2+oMC0paNwtD3nYHFLwMlVa2Pc3g6LzkHvfS7R4v2IDcZ3cP3nh4V5KtVhDHmSElCQXY6Pkwt0Dt2RJdDJfhck59JpbSpKhcT5vzCJs=
2021-04-17T11:28:57.796 INFO:teuthology.kill:2021-04-17 11:28:57,796.796 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-17T11:28:57.808 INFO:teuthology.kill:2021-04-17 11:28:57,808.808 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-17T11:28:57.875 INFO:teuthology.kill:2021-04-17 11:28:57,875.875 INFO:teuthology.orchestra.console:Power off smithi106
2021-04-17T11:28:57.889 INFO:teuthology.kill:2021-04-17 11:28:57,888.888 INFO:teuthology.orchestra.console:Power off smithi196
2021-04-17T11:28:58.018 INFO:teuthology.kill:2021-04-17 11:28:58,018.018 INFO:teuthology.orchestra.console:Power off for smithi106 completed
2021-04-17T11:28:58.030 INFO:teuthology.kill:2021-04-17 11:28:58,029.029 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2021-04-17T11:28:58.183 INFO:teuthology.kill:2021-04-17 11:28:58,182.182 INFO:teuthology.lock.ops:unlocked smithi106.front.sepia.ceph.com
2021-04-17T11:28:58.198 INFO:teuthology.kill:2021-04-17 11:28:58,198.198 INFO:teuthology.lock.ops:unlocked smithi196.front.sepia.ceph.com
2021-04-17T11:31:05.396 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-04-17T11:31:05.506 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-04-17T11:31:05.507 INFO:teuthology.nuke:Checking targets against current locks
2021-04-17T11:31:05.589 INFO:teuthology.nuke:Not nuking smithi196.front.sepia.ceph.com because description doesn't match
2021-04-17T11:31:05.590 INFO:teuthology.nuke:Not nuking smithi106.front.sepia.ceph.com because description doesn't match