2021-05-13T19:14:27.323 INFO:root:teuthology version: 1.1.0-19220a3b
2021-05-13T19:14:27.421 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi049.front.sepia.ceph.com' reimaging
2021-05-13T19:14:27.422 INFO:teuthology.lock.ops:Updating [ubuntu@smithi049.front.sepia.ceph.com]: reset os type and version on server
2021-05-13T19:14:27.423 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2021-05-13T19:14:27.437 INFO:teuthology.lock.ops:Node 'ubuntu@smithi049.front.sepia.ceph.com' reimaging is complete
2021-05-13T19:14:27.438 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi123.front.sepia.ceph.com' reimaging
2021-05-13T19:14:27.438 INFO:teuthology.lock.ops:Updating [ubuntu@smithi123.front.sepia.ceph.com]: reset os type and version on server
2021-05-13T19:14:27.439 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2021-05-13T19:14:27.454 INFO:teuthology.lock.ops:Node 'ubuntu@smithi123.front.sepia.ceph.com' reimaging is complete
2021-05-13T19:14:27.642 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 8.3
2021-05-13T19:14:27.654 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 8.3
2021-05-13T19:14:27.970 INFO:teuthology.orchestra.console:Power off smithi049
2021-05-13T19:14:27.985 INFO:teuthology.orchestra.console:Power off smithi123
2021-05-13T19:14:36.341 INFO:teuthology.orchestra.console:Power off for smithi049 completed
2021-05-13T19:14:36.442 INFO:teuthology.orchestra.console:Power on smithi049
2021-05-13T19:14:40.456 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2021-05-13T19:14:40.558 INFO:teuthology.orchestra.console:Power on smithi123
2021-05-13T19:14:40.697 INFO:teuthology.orchestra.console:Power on for smithi049 completed
2021-05-13T19:14:40.798 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish
2021-05-13T19:14:48.922 INFO:teuthology.orchestra.console:Power on for smithi123 completed
2021-05-13T19:14:49.024 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2021-05-13T19:18:55.421 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-13T19:19:12.623 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-13T19:19:12.956 INFO:teuthology.provision.fog.smithi049:Node is ready
2021-05-13T19:19:12.971 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com
2021-05-13T19:19:13.026 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049
2021-05-13T19:19:13.346 INFO:teuthology.provision.fog.smithi049:Deploy complete!
2021-05-13T19:19:15.771 INFO:teuthology.provision.fog.smithi123:Node is ready
2021-05-13T19:19:15.790 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com
2021-05-13T19:19:15.847 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2021-05-13T19:19:16.182 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2021-05-13T19:19:16.333 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com
2021-05-13T19:19:16.334 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-13T19:19:16.351 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2021-05-13T19:19:16.351 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-13T19:19:16.367 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server
2021-05-13T19:19:16.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-13T19:19:16.664 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64
2021-05-13T19:19:16.719 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Linux"
2021-05-13T19:19:16.719 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8"
2021-05-13T19:19:16.720 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2021-05-13T19:19:16.720 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2021-05-13T19:19:16.720 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8"
2021-05-13T19:19:16.720 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8"
2021-05-13T19:19:16.721 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Linux 8"
2021-05-13T19:19:16.721 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2021-05-13T19:19:16.721 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-05-13T19:19:16.721 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2021-05-13T19:19:16.721 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-05-13T19:19:16.722 INFO:teuthology.orchestra.run.smithi049.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-05-13T19:19:16.722 INFO:teuthology.orchestra.run.smithi049.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-05-13T19:19:16.723 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2021-05-13T19:19:16.793 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2021-05-13T19:19:16.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-13T19:19:17.109 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2021-05-13T19:19:17.159 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Linux"
2021-05-13T19:19:17.160 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8"
2021-05-13T19:19:17.160 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos"
2021-05-13T19:19:17.160 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora"
2021-05-13T19:19:17.160 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8"
2021-05-13T19:19:17.161 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8"
2021-05-13T19:19:17.161 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Linux 8"
2021-05-13T19:19:17.161 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2021-05-13T19:19:17.161 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-05-13T19:19:17.161 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/"
2021-05-13T19:19:17.162 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-05-13T19:19:17.162 INFO:teuthology.orchestra.run.smithi123.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-05-13T19:19:17.162 INFO:teuthology.orchestra.run.smithi123.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-05-13T19:19:17.163 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2021-05-13T19:19:17.252 INFO:teuthology.dispatcher.supervisor:Running job 6113658
2021-05-13T19:19:17.253 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-05-13_15:35:24-rados-no_column_b-distro-basic-smithi/6113658 --name benhanokh-2021-05-13_15:35:24-rados-no_column_b-distro-basic-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} -- /home/teuthworker/archive/benhanokh-2021-05-13_15:35:24-rados-no_column_b-distro-basic-smithi/6113658/orig.config.yaml
2021-05-13T19:19:17.256 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-05-13_15:35:24-rados-no_column_b-distro-basic-smithi/6113658
2021-05-13T19:19:17.257 INFO:teuthology.dispatcher.supervisor:Job PID: 25958
2021-05-13T19:19:17.257 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-05-14T07:20:10.331 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-05-14T07:20:10.518 INFO:teuthology.kill:Killing Pids: {25958}
2021-05-14T07:20:11.612 INFO:teuthology.kill:Nuking machines: ['smithi049', 'smithi123']
2021-05-14T07:20:12.516 INFO:teuthology.kill:2021-05-14 07:20:12,516.516 INFO:teuthology.nuke:targets:
2021-05-14T07:20:12.517 INFO:teuthology.kill:  smithi049.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD7T7sgXG8YdiqaBctJGVGHuJMV8rgOFvVbZ+Ly3xFoF/AFgsmv1R5ysc02JrcmseUgszRXokyEHGSTy3dQNhOyqxHzgx/c/OAQY7jTx1wZNLDOQ+jD8O+6U9Y1tkEK/pLtorVG6qGqOXKzKkXqtjks0BKGxopudH/h1NgB8HJMEq8WR5NdhHeJGIMBJ4u8UGKJ1RwEFYJF4yoaX3VuPcSH/qV3IIoPGZLTX73eUCI2sKhL/vt/u2ru3y2GM4CU3lD+fhpDPdGoT+lZu+1+BohEFeERGK2UStIsxXB91KAlCu1nO5NEv+EGDM9E9OiHnYEn/xBbD+Rd9kUMYOvZsbcCVETNm28az/boOA8EQRdFiZkzbaaKeF3qffgNr9iPJ4b0x798+ETlPKmicsELcNV9ZjardyHFM00K/jpr903p2ElMPuz8rSF+kdOZ+wZ92KH7LTwLKYr/dREOJy/tkHyv1SlQm11bU8OvarmU0MieFul57r5FeZegY7Z+y8J48Ik=
2021-05-14T07:20:12.517 INFO:teuthology.kill:  smithi123.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIkwihi9NVmPadBPtPZw9bZxa8L5zVcWsKEaCcRPwHrW2JTI0hdvKseuiWLrfix9qEb9uwo4utl3vqmuTyqInaKYj/buYPsFRetkjjxzFNY4L8YJsfgh+aGO87w7P2a+bUN5QSAC7znmGaN2+nF9BGQSpQ4t+j8Lln34YXrosj4MXag7cHnd7jhzS7KjBnzhH5J4tHqpe9dJwan21ez+y4GpFY7r16acYRWPu1hw1NHA5eWF6A3H4Gze/RBNNe76rud2H25WRkcGOYIwm4Q5zErJNR3SGZys+28kjKygwnDu/9Tkf7YK2jwrfulGPLlvLiODkVI4LV8b54MpY/1nOgy5cd9kP3kXlmbmBYuDmVpM8iTL/D/DW/SLO/fV2/RT7n0j7DqiRuVYLV/CUywPqZoV3RcnwvWvDGr+18IUbUUjSeiyKvnqF3ObMc5QlZwEVejMQxn4epL7lbqizcP0DjQikHjReDY/bgHLjywNzH9tyYqhYdngJToId7RHyYIic=
2021-05-14T07:20:12.518 INFO:teuthology.kill:2021-05-14 07:20:12,518.518 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-14T07:20:12.521 INFO:teuthology.kill:2021-05-14 07:20:12,520.520 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-14T07:20:12.574 INFO:teuthology.kill:2021-05-14 07:20:12,574.574 INFO:teuthology.orchestra.console:Power off smithi123
2021-05-14T07:20:12.589 INFO:teuthology.kill:2021-05-14 07:20:12,588.588 INFO:teuthology.orchestra.console:Power off smithi049
2021-05-14T07:20:20.953 INFO:teuthology.kill:2021-05-14 07:20:20,953.953 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2021-05-14T07:20:20.961 INFO:teuthology.kill:2021-05-14 07:20:20,961.961 INFO:teuthology.orchestra.console:Power off for smithi049 completed
2021-05-14T07:20:21.188 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-05-14T07:20:21.189 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-05-14T07:20:21.189 INFO:teuthology.misc:Compressing logs...
2021-05-14T07:20:21.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-14T07:20:55.755 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-05-14T07:20:55.829 INFO:teuthology.kill:No teuthology processes running
2021-05-14T07:20:56.886 INFO:teuthology.kill:Nuking machines: ['smithi049', 'smithi123']
2021-05-14T07:20:57.856 INFO:teuthology.kill:2021-05-14 07:20:57,856.856 INFO:teuthology.nuke:targets:
2021-05-14T07:20:57.857 INFO:teuthology.kill:  smithi049.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD7T7sgXG8YdiqaBctJGVGHuJMV8rgOFvVbZ+Ly3xFoF/AFgsmv1R5ysc02JrcmseUgszRXokyEHGSTy3dQNhOyqxHzgx/c/OAQY7jTx1wZNLDOQ+jD8O+6U9Y1tkEK/pLtorVG6qGqOXKzKkXqtjks0BKGxopudH/h1NgB8HJMEq8WR5NdhHeJGIMBJ4u8UGKJ1RwEFYJF4yoaX3VuPcSH/qV3IIoPGZLTX73eUCI2sKhL/vt/u2ru3y2GM4CU3lD+fhpDPdGoT+lZu+1+BohEFeERGK2UStIsxXB91KAlCu1nO5NEv+EGDM9E9OiHnYEn/xBbD+Rd9kUMYOvZsbcCVETNm28az/boOA8EQRdFiZkzbaaKeF3qffgNr9iPJ4b0x798+ETlPKmicsELcNV9ZjardyHFM00K/jpr903p2ElMPuz8rSF+kdOZ+wZ92KH7LTwLKYr/dREOJy/tkHyv1SlQm11bU8OvarmU0MieFul57r5FeZegY7Z+y8J48Ik=
2021-05-14T07:20:57.857 INFO:teuthology.kill:  smithi123.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIkwihi9NVmPadBPtPZw9bZxa8L5zVcWsKEaCcRPwHrW2JTI0hdvKseuiWLrfix9qEb9uwo4utl3vqmuTyqInaKYj/buYPsFRetkjjxzFNY4L8YJsfgh+aGO87w7P2a+bUN5QSAC7znmGaN2+nF9BGQSpQ4t+j8Lln34YXrosj4MXag7cHnd7jhzS7KjBnzhH5J4tHqpe9dJwan21ez+y4GpFY7r16acYRWPu1hw1NHA5eWF6A3H4Gze/RBNNe76rud2H25WRkcGOYIwm4Q5zErJNR3SGZys+28kjKygwnDu/9Tkf7YK2jwrfulGPLlvLiODkVI4LV8b54MpY/1nOgy5cd9kP3kXlmbmBYuDmVpM8iTL/D/DW/SLO/fV2/RT7n0j7DqiRuVYLV/CUywPqZoV3RcnwvWvDGr+18IUbUUjSeiyKvnqF3ObMc5QlZwEVejMQxn4epL7lbqizcP0DjQikHjReDY/bgHLjywNzH9tyYqhYdngJToId7RHyYIic=
2021-05-14T07:20:57.876 INFO:teuthology.kill:2021-05-14 07:20:57,875.875 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-14T07:20:57.879 INFO:teuthology.kill:2021-05-14 07:20:57,878.878 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-14T07:20:57.933 INFO:teuthology.kill:2021-05-14 07:20:57,932.932 INFO:teuthology.orchestra.console:Power off smithi123
2021-05-14T07:20:57.945 INFO:teuthology.kill:2021-05-14 07:20:57,945.945 INFO:teuthology.orchestra.console:Power off smithi049
2021-05-14T07:20:58.075 INFO:teuthology.kill:2021-05-14 07:20:58,075.075 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2021-05-14T07:20:58.087 INFO:teuthology.kill:2021-05-14 07:20:58,087.087 INFO:teuthology.orchestra.console:Power off for smithi049 completed
2021-05-14T07:20:58.214 INFO:teuthology.kill:2021-05-14 07:20:58,214.214 INFO:teuthology.lock.ops:unlocked smithi123.front.sepia.ceph.com
2021-05-14T07:20:58.226 INFO:teuthology.kill:2021-05-14 07:20:58,225.225 INFO:teuthology.lock.ops:unlocked smithi049.front.sepia.ceph.com
2021-05-14T07:22:58.503 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-05-14T07:22:58.591 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-05-14T07:22:58.591 INFO:teuthology.nuke:Checking targets against current locks
2021-05-14T07:22:58.677 INFO:teuthology.nuke:Not nuking smithi049.front.sepia.ceph.com because description doesn't match
2021-05-14T07:22:58.677 INFO:teuthology.nuke:Not nuking smithi123.front.sepia.ceph.com because description doesn't match