2021-04-18T07:35:05.981 INFO:root:teuthology version: 1.1.0-2713a3cd
2021-04-18T07:35:06.091 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi078.front.sepia.ceph.com' reimaging
2021-04-18T07:35:06.092 INFO:teuthology.lock.ops:Updating [ubuntu@smithi078.front.sepia.ceph.com]: reset os type and version on server
2021-04-18T07:35:06.093 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2021-04-18T07:35:06.108 INFO:teuthology.lock.ops:Node 'ubuntu@smithi078.front.sepia.ceph.com' reimaging is complete
2021-04-18T07:35:06.108 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi100.front.sepia.ceph.com' reimaging
2021-04-18T07:35:06.108 INFO:teuthology.lock.ops:Updating [ubuntu@smithi100.front.sepia.ceph.com]: reset os type and version on server
2021-04-18T07:35:06.109 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2021-04-18T07:35:06.125 INFO:teuthology.lock.ops:Node 'ubuntu@smithi100.front.sepia.ceph.com' reimaging is complete
2021-04-18T07:35:06.300 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.3
2021-04-18T07:35:06.316 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of rhel 8.3
2021-04-18T07:35:06.647 INFO:teuthology.orchestra.console:Power off smithi078
2021-04-18T07:35:06.669 INFO:teuthology.orchestra.console:Power off smithi100
2021-04-18T07:35:15.081 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2021-04-18T07:35:15.086 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2021-04-18T07:35:15.184 INFO:teuthology.orchestra.console:Power on smithi078
2021-04-18T07:35:15.192 INFO:teuthology.orchestra.console:Power on smithi100
2021-04-18T07:35:23.553 INFO:teuthology.orchestra.console:Power on for smithi078 completed
2021-04-18T07:35:23.559 INFO:teuthology.orchestra.console:Power on for smithi100 completed
2021-04-18T07:35:23.654 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish
2021-04-18T07:35:23.661 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2021-04-18T07:40:04.917 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-18T07:40:04.966 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-18T07:40:05.204 INFO:teuthology.provision.fog.smithi078:Node is ready
2021-04-18T07:40:05.218 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com
2021-04-18T07:40:05.273 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078
2021-04-18T07:40:05.307 INFO:teuthology.provision.fog.smithi100:Node is ready
2021-04-18T07:40:05.324 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com
2021-04-18T07:40:05.380 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100
2021-04-18T07:40:05.592 INFO:teuthology.provision.fog.smithi078:Deploy complete!
2021-04-18T07:40:05.724 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2021-04-18T07:40:47.437 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com
2021-04-18T07:40:47.465 INFO:teuthology.lock.ops:New key found. Updating...
2021-04-18T07:40:48.334 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com
2021-04-18T07:40:48.334 INFO:teuthology.lock.ops:New key found. Updating...
2021-04-18T07:40:48.695 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server
2021-04-18T07:40:48.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-18T07:40:48.989 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64
2021-04-18T07:40:49.044 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux"
2021-04-18T07:40:49.044 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.3 (Ootpa)"
2021-04-18T07:40:49.045 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel"
2021-04-18T07:40:49.046 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora"
2021-04-18T07:40:49.046 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.3"
2021-04-18T07:40:49.046 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8"
2021-04-18T07:40:49.047 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-04-18T07:40:49.047 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2021-04-18T07:40:49.047 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-04-18T07:40:49.048 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/"
2021-04-18T07:40:49.048 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-04-18T07:40:49.048 INFO:teuthology.orchestra.run.smithi078.stdout:
2021-04-18T07:40:49.049 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-04-18T07:40:49.049 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-04-18T07:40:49.049 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-04-18T07:40:49.050 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-04-18T07:40:49.052 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2021-04-18T07:40:49.067 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server
2021-04-18T07:40:49.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-18T07:40:49.356 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64
2021-04-18T07:40:49.411 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Red Hat Enterprise Linux"
2021-04-18T07:40:49.412 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8.3 (Ootpa)"
2021-04-18T07:40:49.412 INFO:teuthology.orchestra.run.smithi100.stdout:ID="rhel"
2021-04-18T07:40:49.413 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="fedora"
2021-04-18T07:40:49.413 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8.3"
2021-04-18T07:40:49.414 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8"
2021-04-18T07:40:49.414 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-04-18T07:40:49.414 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2021-04-18T07:40:49.415 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-04-18T07:40:49.415 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.redhat.com/"
2021-04-18T07:40:49.416 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-04-18T07:40:49.416 INFO:teuthology.orchestra.run.smithi100.stdout:
2021-04-18T07:40:49.417 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-04-18T07:40:49.417 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-04-18T07:40:49.418 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-04-18T07:40:49.418 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-04-18T07:40:49.419 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2021-04-18T07:41:00.624 INFO:teuthology.dispatcher.supervisor:Running job 6054630
2021-04-18T07:41:00.624 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-04-18_04:17:03-fs-pacific-distro-basic-smithi/6054630 --name teuthology-2021-04-18_04:17:03-fs-pacific-distro-basic-smithi --description fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}} -- /home/teuthworker/archive/teuthology-2021-04-18_04:17:03-fs-pacific-distro-basic-smithi/6054630/orig.config.yaml
2021-04-18T07:41:00.629 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-04-18_04:17:03-fs-pacific-distro-basic-smithi/6054630
2021-04-18T07:41:00.630 INFO:teuthology.dispatcher.supervisor:Job PID: 4505
2021-04-18T07:41:00.630 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-04-18T19:42:23.100 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-04-18T19:42:23.324 INFO:teuthology.kill:Killing Pids: {4505}
2021-04-18T19:42:25.214 INFO:teuthology.kill:Nuking machines: ['smithi078', 'smithi100']
2021-04-18T19:42:26.306 INFO:teuthology.kill:2021-04-18 19:42:26,306.306 INFO:teuthology.nuke:targets:
2021-04-18T19:42:26.307 INFO:teuthology.kill:  smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDB6vRxp7I0RZg4dPT4V5aoodMxCGMNBa+dKo59nBYB2Zz5HfUKXMx6QBLxSHqalLJcQJNPnHjEjXgWYsnNrUxliDChD6RJHQsFe4G2QImkbtCbhCZKN4qv3Sk9dboeZqWTKHc0uHvC6i9GqOCWKoIy2A7NOg/3fuV2CePCKLK9F9FJMzlCrJhVHCh4cgTgM7A5++CHSZ4JHw5bT92o0iWbnYMZxuwxbPpJM5ADyiw/dEbguT4LWU4PvHXD2qmb1tK7OLFJ2SytMLfKW136l3d2hZj4DVlxoewzY7TColJjPUtrnxopMIqf+kPXUJ9Ssg/HvVTf8th4+JenbSXg763w0hCn1itfcWPD6SVzMwKni6OGrj0a0hdoCgVPwrerAjdk5OlRpF6d7KI91VLOxBxxY7pQDpvNSO/5EHvV9I1/+cPl4BOmOEdEocpzzGsE6e4rvE+rdlgHr0EsW8TGh6scOqvDtO90odG1LGEEmSOlSK9xiTkVJt/VoSOJrX991Y0=
2021-04-18T19:42:26.308 INFO:teuthology.kill:  smithi100.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcBfEi0tnZAY/sdROVIudqMtDHjA/V/GJPyJ68fWaXB9s7otL1Y1j4aWHdnsxJ0+SDb+AK+4g/AMoFAt34zHaLAJiNiGwoKafmBE+1kS7QecoSxtoOhbIy0U72cipo6UWVq0M0S4h7wQ9Mt93Tj3Ml9rq+sPot2/vYisd968pCL0SgAsOhIL5Jz5/kWyA5C+rQ0eC/EPPLAFdgxNo8OLqe7yBVmr8s9m2DISW+9M8CV29CSVs1FR/CzOY9TUaUrWQdasUL2ZCQN5XCCaDsKq+6ltj9UP2pjDa2yv+MkqvXM8EwpUX8Q5hbxOEZ5+hdkilX9XvaYu8mjFnogjQec2VFJ/PcLdf6pzeUhuhEPsUoAoWa0FB0a2teXvtwMx7v5voxcIFcZI4O4TUunz6wxmKiv6IADQ19SKgkakFGq1ve7zp+IL0W5BR5pwFF25fONilbtRX1V05b5A07lIa7BuvsoFlse3y8SaqT+VDrhsDyM95qEaHLrB8F7jwAAru89CM=
2021-04-18T19:42:26.308 INFO:teuthology.kill:2021-04-18 19:42:26,306.306 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-18T19:42:26.309 INFO:teuthology.kill:2021-04-18 19:42:26,309.309 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-18T19:42:26.387 INFO:teuthology.kill:2021-04-18 19:42:26,387.387 INFO:teuthology.orchestra.console:Power off smithi078
2021-04-18T19:42:26.406 INFO:teuthology.kill:2021-04-18 19:42:26,406.406 INFO:teuthology.orchestra.console:Power off smithi100
2021-04-18T19:42:38.899 INFO:teuthology.kill:2021-04-18 19:42:38,899.899 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2021-04-18T19:42:38.905 INFO:teuthology.kill:2021-04-18 19:42:38,904.904 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2021-04-18T19:42:39.153 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-04-18T19:42:39.156 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-04-18T19:42:39.157 INFO:teuthology.misc:Compressing logs...
2021-04-18T19:42:39.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-18T19:43:13.756 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-04-18T19:43:13.831 INFO:teuthology.kill:No teuthology processes running
2021-04-18T19:43:16.255 INFO:teuthology.kill:Nuking machines: ['smithi078', 'smithi100']
2021-04-18T19:43:17.245 INFO:teuthology.kill:2021-04-18 19:43:17,245.245 INFO:teuthology.nuke:targets:
2021-04-18T19:43:17.246 INFO:teuthology.kill:  smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDB6vRxp7I0RZg4dPT4V5aoodMxCGMNBa+dKo59nBYB2Zz5HfUKXMx6QBLxSHqalLJcQJNPnHjEjXgWYsnNrUxliDChD6RJHQsFe4G2QImkbtCbhCZKN4qv3Sk9dboeZqWTKHc0uHvC6i9GqOCWKoIy2A7NOg/3fuV2CePCKLK9F9FJMzlCrJhVHCh4cgTgM7A5++CHSZ4JHw5bT92o0iWbnYMZxuwxbPpJM5ADyiw/dEbguT4LWU4PvHXD2qmb1tK7OLFJ2SytMLfKW136l3d2hZj4DVlxoewzY7TColJjPUtrnxopMIqf+kPXUJ9Ssg/HvVTf8th4+JenbSXg763w0hCn1itfcWPD6SVzMwKni6OGrj0a0hdoCgVPwrerAjdk5OlRpF6d7KI91VLOxBxxY7pQDpvNSO/5EHvV9I1/+cPl4BOmOEdEocpzzGsE6e4rvE+rdlgHr0EsW8TGh6scOqvDtO90odG1LGEEmSOlSK9xiTkVJt/VoSOJrX991Y0=
2021-04-18T19:43:17.246 INFO:teuthology.kill:  smithi100.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcBfEi0tnZAY/sdROVIudqMtDHjA/V/GJPyJ68fWaXB9s7otL1Y1j4aWHdnsxJ0+SDb+AK+4g/AMoFAt34zHaLAJiNiGwoKafmBE+1kS7QecoSxtoOhbIy0U72cipo6UWVq0M0S4h7wQ9Mt93Tj3Ml9rq+sPot2/vYisd968pCL0SgAsOhIL5Jz5/kWyA5C+rQ0eC/EPPLAFdgxNo8OLqe7yBVmr8s9m2DISW+9M8CV29CSVs1FR/CzOY9TUaUrWQdasUL2ZCQN5XCCaDsKq+6ltj9UP2pjDa2yv+MkqvXM8EwpUX8Q5hbxOEZ5+hdkilX9XvaYu8mjFnogjQec2VFJ/PcLdf6pzeUhuhEPsUoAoWa0FB0a2teXvtwMx7v5voxcIFcZI4O4TUunz6wxmKiv6IADQ19SKgkakFGq1ve7zp+IL0W5BR5pwFF25fONilbtRX1V05b5A07lIa7BuvsoFlse3y8SaqT+VDrhsDyM95qEaHLrB8F7jwAAru89CM=
2021-04-18T19:43:17.265 INFO:teuthology.kill:2021-04-18 19:43:17,265.265 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-18T19:43:17.276 INFO:teuthology.kill:2021-04-18 19:43:17,276.276 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-18T19:43:17.342 INFO:teuthology.kill:2021-04-18 19:43:17,341.341 INFO:teuthology.orchestra.console:Power off smithi078
2021-04-18T19:43:17.358 INFO:teuthology.kill:2021-04-18 19:43:17,358.358 INFO:teuthology.orchestra.console:Power off smithi100
2021-04-18T19:43:17.515 INFO:teuthology.kill:2021-04-18 19:43:17,514.514 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2021-04-18T19:43:17.520 INFO:teuthology.kill:2021-04-18 19:43:17,520.520 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2021-04-18T19:43:17.675 INFO:teuthology.kill:2021-04-18 19:43:17,674.674 INFO:teuthology.lock.ops:unlocked smithi100.front.sepia.ceph.com
2021-04-18T19:43:17.691 INFO:teuthology.kill:2021-04-18 19:43:17,690.690 INFO:teuthology.lock.ops:unlocked smithi078.front.sepia.ceph.com
2021-04-18T19:45:17.932 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15