2021-08-09T20:14:20.376 INFO:root:teuthology version: 1.1.0-321319b1
2021-08-09T20:14:20.480 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi063.front.sepia.ceph.com' reimaging
2021-08-09T20:14:20.481 INFO:teuthology.lock.ops:Updating [ubuntu@smithi063.front.sepia.ceph.com]: reset os type and version on server
2021-08-09T20:14:20.482 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2021-08-09T20:14:20.501 INFO:teuthology.lock.ops:Node 'ubuntu@smithi063.front.sepia.ceph.com' reimaging is complete
2021-08-09T20:14:20.502 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging
2021-08-09T20:14:20.502 INFO:teuthology.lock.ops:Updating [ubuntu@smithi140.front.sepia.ceph.com]: reset os type and version on server
2021-08-09T20:14:20.503 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2021-08-09T20:14:20.522 INFO:teuthology.lock.ops:Node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging is complete
2021-08-09T20:14:20.724 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of rhel 8.4
2021-08-09T20:14:20.734 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.4
2021-08-09T20:14:21.050 INFO:teuthology.orchestra.console:Power off smithi140
2021-08-09T20:14:21.065 INFO:teuthology.orchestra.console:Power off smithi063
2021-08-09T20:14:29.427 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2021-08-09T20:14:29.528 INFO:teuthology.orchestra.console:Power on smithi140
2021-08-09T20:14:33.547 INFO:teuthology.orchestra.console:Power off for smithi063 completed
2021-08-09T20:14:33.649 INFO:teuthology.orchestra.console:Power on smithi063
2021-08-09T20:14:37.900 INFO:teuthology.orchestra.console:Power on for smithi063 completed
2021-08-09T20:14:37.948 INFO:teuthology.orchestra.console:Power on for smithi140 completed
2021-08-09T20:14:38.002 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish
2021-08-09T20:14:38.049 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish
2021-08-09T20:19:33.966 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-09T20:19:33.990 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-09T20:19:34.214 INFO:teuthology.provision.fog.smithi140:Node is ready
2021-08-09T20:19:34.229 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com
2021-08-09T20:19:34.239 INFO:teuthology.provision.fog.smithi063:Node is ready
2021-08-09T20:19:34.255 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com
2021-08-09T20:19:34.284 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140
2021-08-09T20:19:34.315 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063
2021-08-09T20:19:34.611 INFO:teuthology.provision.fog.smithi140:Deploy complete!
2021-08-09T20:19:34.645 INFO:teuthology.provision.fog.smithi063:Deploy complete!
2021-08-09T20:19:34.794 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com
2021-08-09T20:19:34.795 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-09T20:19:34.816 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com
2021-08-09T20:19:34.817 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-09T20:19:34.841 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server
2021-08-09T20:19:34.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-09T20:19:35.073 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64
2021-08-09T20:19:35.129 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Red Hat Enterprise Linux"
2021-08-09T20:19:35.129 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8.4 (Ootpa)"
2021-08-09T20:19:35.130 INFO:teuthology.orchestra.run.smithi063.stdout:ID="rhel"
2021-08-09T20:19:35.130 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="fedora"
2021-08-09T20:19:35.130 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8.4"
2021-08-09T20:19:35.130 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8"
2021-08-09T20:19:35.131 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-08-09T20:19:35.131 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2021-08-09T20:19:35.131 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-08-09T20:19:35.131 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.redhat.com/"
2021-08-09T20:19:35.132 INFO:teuthology.orchestra.run.smithi063.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-08-09T20:19:35.132 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-08-09T20:19:35.132 INFO:teuthology.orchestra.run.smithi063.stdout:
2021-08-09T20:19:35.132 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-08-09T20:19:35.132 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-08-09T20:19:35.133 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-08-09T20:19:35.133 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-08-09T20:19:35.134 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2021-08-09T20:19:35.157 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server
2021-08-09T20:19:35.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-09T20:19:35.386 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64
2021-08-09T20:19:35.440 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Red Hat Enterprise Linux"
2021-08-09T20:19:35.440 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8.4 (Ootpa)"
2021-08-09T20:19:35.441 INFO:teuthology.orchestra.run.smithi140.stdout:ID="rhel"
2021-08-09T20:19:35.441 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="fedora"
2021-08-09T20:19:35.441 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8.4"
2021-08-09T20:19:35.441 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8"
2021-08-09T20:19:35.442 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-08-09T20:19:35.442 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31"
2021-08-09T20:19:35.442 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-08-09T20:19:35.442 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.redhat.com/"
2021-08-09T20:19:35.443 INFO:teuthology.orchestra.run.smithi140.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-08-09T20:19:35.443 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-08-09T20:19:35.443 INFO:teuthology.orchestra.run.smithi140.stdout:
2021-08-09T20:19:35.443 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-08-09T20:19:35.444 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-08-09T20:19:35.444 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-08-09T20:19:35.444 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-08-09T20:19:35.445 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2021-08-09T20:19:35.525 INFO:teuthology.dispatcher.supervisor:Running job 6328975
2021-08-09T20:19:35.526 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/virtualenv/bin/teuthology -v --owner scheduled_nojha@teuthology --archive /home/teuthworker/archive/nojha-2021-08-09_20:10:33-rados-wip_gbenhano_ncbz-distro-basic-smithi/6328975 --name nojha-2021-08-09_20:10:33-rados-wip_gbenhano_ncbz-distro-basic-smithi --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /home/teuthworker/archive/nojha-2021-08-09_20:10:33-rados-wip_gbenhano_ncbz-distro-basic-smithi/6328975/orig.config.yaml
2021-08-09T20:19:35.529 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nojha-2021-08-09_20:10:33-rados-wip_gbenhano_ncbz-distro-basic-smithi/6328975
2021-08-09T20:19:35.530 INFO:teuthology.dispatcher.supervisor:Job PID: 11910
2021-08-09T20:19:35.530 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-08-10T08:20:27.411 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-08-10T08:20:27.604 INFO:teuthology.kill:Killing Pids: {11910}
2021-08-10T08:20:28.748 INFO:teuthology.kill:Nuking machines: ['smithi063', 'smithi140']
2021-08-10T08:20:29.711 INFO:teuthology.kill:2021-08-10 08:20:29,711.711 INFO:teuthology.nuke:targets:
2021-08-10T08:20:29.712 INFO:teuthology.kill:  smithi063.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDV6HX9utN0/febUupw9wBDSYclXZg6X4360eVWleuQ7Zcmhv+m2XUmvHowDnj34PLOed01BQtDMT4P5Nl5h8zflWBdc0mR7s+NhC3PQJ4WsBjqoBTb+Da2whb0zYmvohyj4+AO3CqR9YO3MGVMYsOvK9wMf8pYZzzHIMp03oAu14LV4RrbvD7pqqB7w+hqBC83ROPj9AjJdGR565nd8aB94yrPnMrnPoEQvSQzijOgVJ8fRzD6pCIWKZ41YW5tiWyOF9Z4he02jme0wukROYIH5adc7GJdv1DYzlbWHqjccU2AdOAWqdvE3aDfnVGPiHC6WpoEaSIYGo8jnPx9ex1v4plNs//RhfGaq3gvDcPX+caFwbIwjQqqP+YnBLP6WwQQDY2dm1e+6k+20Wk0OngNytggot4nz0XCANS54kVMm1Yz8U0fCajvSzcEBU/vtwc8AMhWWwutLDPfvvE/zckBhD0r8LT7HUPzMRgrnBff+mtO39vmlkHFbe2hj3afbak=
2021-08-10T08:20:29.713 INFO:teuthology.kill:  smithi140.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuhfb7v73pqrKR7TP8N6ONOj5wZHTosou74FfN86n7dMsIl/2I+UHdZkUOogfEkWMx6B+zrrgnwKDHY0o1KzE5YCkVzk+SjadIfSRBON7RtgAR40U2j5KL+yiaPzrsS6dKqyop5qnYU/bDQkkRHASkXNnB0yWXugtpcfW3bY3R+7urm12dGdqyQ5abNiPQ6dyif2XS3GWgQJOsuyKm6ngCS4HXDqs/QobbHhZeHSItiTSySZYAmr/Prc2lbWJ4oz3AGTIqB53kH1S+ZNXJ/hi1hK26sIdK5DexweIm+BZvaXcvDVRqV/F2UQT1ydy8nxE7mcAOW2LpgTdm625F+o6nzh8Z8H0me7j75PhFzp9/HoivYy4couFiIt+V4v50115uVTGBJV+vwVqxQZeFdVUtcUbvzlZIv10cmtuv9y9aeQeYJeUjuGo7mhvLrSZiMr5MWN4BWrjZ2FFAdHQzexrOwsTF/xkUXTdutkA5GApVAXyP5iGlH+ENrspBRKtWJL0=
2021-08-10T08:20:29.713 INFO:teuthology.kill:2021-08-10 08:20:29,711.711 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-10T08:20:29.714 INFO:teuthology.kill:2021-08-10 08:20:29,714.714 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-10T08:20:29.774 INFO:teuthology.kill:2021-08-10 08:20:29,773.773 INFO:teuthology.orchestra.console:Power off smithi063
2021-08-10T08:20:29.786 INFO:teuthology.kill:2021-08-10 08:20:29,786.786 INFO:teuthology.orchestra.console:Power off smithi140
2021-08-10T08:20:38.153 INFO:teuthology.kill:2021-08-10 08:20:38,152.152 INFO:teuthology.orchestra.console:Power off for smithi063 completed
2021-08-10T08:20:42.268 INFO:teuthology.kill:2021-08-10 08:20:42,268.268 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2021-08-10T08:20:42.493 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-08-10T08:20:42.494 INFO:teuthology.task.internal:roles: ubuntu@smithi140.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-08-10T08:20:42.494 INFO:teuthology.misc:Compressing logs...
2021-08-10T08:20:42.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-10T08:21:17.131 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-08-10T08:21:17.248 INFO:teuthology.kill:No teuthology processes running
2021-08-10T08:21:18.373 INFO:teuthology.kill:Nuking machines: ['smithi063', 'smithi140']
2021-08-10T08:21:19.361 INFO:teuthology.kill:2021-08-10 08:21:19,360.360 INFO:teuthology.nuke:targets:
2021-08-10T08:21:19.361 INFO:teuthology.kill:  smithi063.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDV6HX9utN0/febUupw9wBDSYclXZg6X4360eVWleuQ7Zcmhv+m2XUmvHowDnj34PLOed01BQtDMT4P5Nl5h8zflWBdc0mR7s+NhC3PQJ4WsBjqoBTb+Da2whb0zYmvohyj4+AO3CqR9YO3MGVMYsOvK9wMf8pYZzzHIMp03oAu14LV4RrbvD7pqqB7w+hqBC83ROPj9AjJdGR565nd8aB94yrPnMrnPoEQvSQzijOgVJ8fRzD6pCIWKZ41YW5tiWyOF9Z4he02jme0wukROYIH5adc7GJdv1DYzlbWHqjccU2AdOAWqdvE3aDfnVGPiHC6WpoEaSIYGo8jnPx9ex1v4plNs//RhfGaq3gvDcPX+caFwbIwjQqqP+YnBLP6WwQQDY2dm1e+6k+20Wk0OngNytggot4nz0XCANS54kVMm1Yz8U0fCajvSzcEBU/vtwc8AMhWWwutLDPfvvE/zckBhD0r8LT7HUPzMRgrnBff+mtO39vmlkHFbe2hj3afbak=
2021-08-10T08:21:19.368 INFO:teuthology.kill:  smithi140.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuhfb7v73pqrKR7TP8N6ONOj5wZHTosou74FfN86n7dMsIl/2I+UHdZkUOogfEkWMx6B+zrrgnwKDHY0o1KzE5YCkVzk+SjadIfSRBON7RtgAR40U2j5KL+yiaPzrsS6dKqyop5qnYU/bDQkkRHASkXNnB0yWXugtpcfW3bY3R+7urm12dGdqyQ5abNiPQ6dyif2XS3GWgQJOsuyKm6ngCS4HXDqs/QobbHhZeHSItiTSySZYAmr/Prc2lbWJ4oz3AGTIqB53kH1S+ZNXJ/hi1hK26sIdK5DexweIm+BZvaXcvDVRqV/F2UQT1ydy8nxE7mcAOW2LpgTdm625F+o6nzh8Z8H0me7j75PhFzp9/HoivYy4couFiIt+V4v50115uVTGBJV+vwVqxQZeFdVUtcUbvzlZIv10cmtuv9y9aeQeYJeUjuGo7mhvLrSZiMr5MWN4BWrjZ2FFAdHQzexrOwsTF/xkUXTdutkA5GApVAXyP5iGlH+ENrspBRKtWJL0=
2021-08-10T08:21:19.383 INFO:teuthology.kill:2021-08-10 08:21:19,383.383 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-10T08:21:19.386 INFO:teuthology.kill:2021-08-10 08:21:19,386.386 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-10T08:21:19.444 INFO:teuthology.kill:2021-08-10 08:21:19,444.444 INFO:teuthology.orchestra.console:Power off smithi140
2021-08-10T08:21:19.457 INFO:teuthology.kill:2021-08-10 08:21:19,457.457 INFO:teuthology.orchestra.console:Power off smithi063
2021-08-10T08:21:19.585 INFO:teuthology.kill:2021-08-10 08:21:19,585.585 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2021-08-10T08:21:19.597 INFO:teuthology.kill:2021-08-10 08:21:19,597.597 INFO:teuthology.orchestra.console:Power off for smithi063 completed
2021-08-10T08:21:19.729 INFO:teuthology.kill:2021-08-10 08:21:19,729.729 INFO:teuthology.lock.ops:unlocked smithi140.front.sepia.ceph.com
2021-08-10T08:21:19.734 INFO:teuthology.kill:2021-08-10 08:21:19,734.734 INFO:teuthology.lock.ops:unlocked smithi063.front.sepia.ceph.com
2021-08-10T08:23:20.013 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-08-10T08:23:20.106 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-08-10T08:23:20.106 INFO:teuthology.nuke:Checking targets against current locks
2021-08-10T08:23:20.214 INFO:teuthology.nuke:Not nuking smithi063.front.sepia.ceph.com because description doesn't match
2021-08-10T08:23:20.214 INFO:teuthology.nuke:Not nuking smithi140.front.sepia.ceph.com because description doesn't match