2021-04-23T10:24:23.401 INFO:root:teuthology version: 1.1.0-2713a3cd
2021-04-23T10:24:23.503 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba018.front.sepia.ceph.com' reimaging
2021-04-23T10:24:23.503 INFO:teuthology.lock.ops:Updating [ubuntu@gibba018.front.sepia.ceph.com]: reset os type and version on server
2021-04-23T10:24:23.503 INFO:teuthology.lock.ops:Updating gibba018.front.sepia.ceph.com on lock server
2021-04-23T10:24:23.520 INFO:teuthology.lock.ops:Node 'ubuntu@gibba018.front.sepia.ceph.com' reimaging is complete
2021-04-23T10:24:23.520 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba041.front.sepia.ceph.com' reimaging
2021-04-23T10:24:23.520 INFO:teuthology.lock.ops:Updating [ubuntu@gibba041.front.sepia.ceph.com]: reset os type and version on server
2021-04-23T10:24:23.521 INFO:teuthology.lock.ops:Updating gibba041.front.sepia.ceph.com on lock server
2021-04-23T10:24:23.536 INFO:teuthology.lock.ops:Node 'ubuntu@gibba041.front.sepia.ceph.com' reimaging is complete
2021-04-23T10:24:23.729 INFO:teuthology.provision.fog.gibba018:Scheduling deploy of rhel 8.3
2021-04-23T10:24:23.749 INFO:teuthology.provision.fog.gibba041:Scheduling deploy of rhel 8.3
2021-04-23T10:24:24.011 INFO:teuthology.orchestra.console:Power off gibba018
2021-04-23T10:24:24.042 INFO:teuthology.orchestra.console:Power off gibba041
2021-04-23T10:24:32.409 INFO:teuthology.orchestra.console:Power off for gibba018 completed
2021-04-23T10:24:32.419 INFO:teuthology.orchestra.console:Power off for gibba041 completed
2021-04-23T10:24:32.511 INFO:teuthology.orchestra.console:Power on gibba018
2021-04-23T10:24:32.520 INFO:teuthology.orchestra.console:Power on gibba041
2021-04-23T10:24:40.895 INFO:teuthology.orchestra.console:Power on for gibba018 completed
2021-04-23T10:24:40.968 INFO:teuthology.orchestra.console:Power on for gibba041 completed
2021-04-23T10:24:40.996 INFO:teuthology.provision.fog.gibba018:Waiting for deploy to finish
2021-04-23T10:24:41.069 INFO:teuthology.provision.fog.gibba041:Waiting for deploy to finish
2021-04-23T10:28:41.294 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-23T10:28:52.069 INFO:teuthology.provision.fog.gibba018:Node is ready
2021-04-23T10:28:52.082 INFO:teuthology.orchestra.run.gibba018.stdout:gibba018.front.sepia.ceph.com
2021-04-23T10:28:52.135 INFO:teuthology.orchestra.run.gibba018.stdout:172.21.2.118 gibba018.front.sepia.ceph.com gibba018
2021-04-23T10:28:52.484 INFO:teuthology.provision.fog.gibba018:Deploy complete!
2021-04-23T10:29:06.795 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-23T10:29:07.041 INFO:teuthology.provision.fog.gibba041:Node is ready
2021-04-23T10:29:07.051 INFO:teuthology.orchestra.run.gibba041.stdout:gibba041.front.sepia.ceph.com
2021-04-23T10:29:07.103 INFO:teuthology.orchestra.run.gibba041.stdout:172.21.2.141 gibba041.front.sepia.ceph.com gibba041
2021-04-23T10:29:07.388 INFO:teuthology.provision.fog.gibba041:Deploy complete!
2021-04-23T10:29:07.531 INFO:teuthology.lock.ops:Checking gibba018.front.sepia.ceph.com
2021-04-23T10:29:07.531 INFO:teuthology.lock.ops:New key found. Updating...
2021-04-23T10:29:07.550 INFO:teuthology.lock.ops:Checking gibba041.front.sepia.ceph.com
2021-04-23T10:29:07.550 INFO:teuthology.lock.ops:New key found. Updating...
2021-04-23T10:29:07.565 INFO:teuthology.lock.ops:Updating [gibba018.front.sepia.ceph.com]: set os type and version on server
2021-04-23T10:29:07.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-23T10:29:07.815 INFO:teuthology.orchestra.run.gibba018.stdout:x86_64
2021-04-23T10:29:07.867 INFO:teuthology.orchestra.run.gibba018.stdout:NAME="Red Hat Enterprise Linux"
2021-04-23T10:29:07.867 INFO:teuthology.orchestra.run.gibba018.stdout:VERSION="8.3 (Ootpa)"
2021-04-23T10:29:07.867 INFO:teuthology.orchestra.run.gibba018.stdout:ID="rhel"
2021-04-23T10:29:07.868 INFO:teuthology.orchestra.run.gibba018.stdout:ID_LIKE="fedora"
2021-04-23T10:29:07.868 INFO:teuthology.orchestra.run.gibba018.stdout:VERSION_ID="8.3"
2021-04-23T10:29:07.868 INFO:teuthology.orchestra.run.gibba018.stdout:PLATFORM_ID="platform:el8"
2021-04-23T10:29:07.868 INFO:teuthology.orchestra.run.gibba018.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-04-23T10:29:07.868 INFO:teuthology.orchestra.run.gibba018.stdout:ANSI_COLOR="0;31"
2021-04-23T10:29:07.868 INFO:teuthology.orchestra.run.gibba018.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-04-23T10:29:07.868 INFO:teuthology.orchestra.run.gibba018.stdout:HOME_URL="https://www.redhat.com/"
2021-04-23T10:29:07.868 INFO:teuthology.orchestra.run.gibba018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-04-23T10:29:07.868 INFO:teuthology.orchestra.run.gibba018.stdout:
2021-04-23T10:29:07.868 INFO:teuthology.orchestra.run.gibba018.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-04-23T10:29:07.868 INFO:teuthology.orchestra.run.gibba018.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-04-23T10:29:07.869 INFO:teuthology.orchestra.run.gibba018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-04-23T10:29:07.869 INFO:teuthology.orchestra.run.gibba018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-04-23T10:29:07.870 INFO:teuthology.lock.ops:Updating gibba018.front.sepia.ceph.com on lock server
2021-04-23T10:29:07.886 INFO:teuthology.lock.ops:Updating [gibba041.front.sepia.ceph.com]: set os type and version on server
2021-04-23T10:29:07.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-23T10:29:08.133 INFO:teuthology.orchestra.run.gibba041.stdout:x86_64
2021-04-23T10:29:08.186 INFO:teuthology.orchestra.run.gibba041.stdout:NAME="Red Hat Enterprise Linux"
2021-04-23T10:29:08.186 INFO:teuthology.orchestra.run.gibba041.stdout:VERSION="8.3 (Ootpa)"
2021-04-23T10:29:08.186 INFO:teuthology.orchestra.run.gibba041.stdout:ID="rhel"
2021-04-23T10:29:08.186 INFO:teuthology.orchestra.run.gibba041.stdout:ID_LIKE="fedora"
2021-04-23T10:29:08.187 INFO:teuthology.orchestra.run.gibba041.stdout:VERSION_ID="8.3"
2021-04-23T10:29:08.187 INFO:teuthology.orchestra.run.gibba041.stdout:PLATFORM_ID="platform:el8"
2021-04-23T10:29:08.187 INFO:teuthology.orchestra.run.gibba041.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-04-23T10:29:08.187 INFO:teuthology.orchestra.run.gibba041.stdout:ANSI_COLOR="0;31"
2021-04-23T10:29:08.187 INFO:teuthology.orchestra.run.gibba041.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-04-23T10:29:08.187 INFO:teuthology.orchestra.run.gibba041.stdout:HOME_URL="https://www.redhat.com/"
2021-04-23T10:29:08.187 INFO:teuthology.orchestra.run.gibba041.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-04-23T10:29:08.187 INFO:teuthology.orchestra.run.gibba041.stdout:
2021-04-23T10:29:08.187 INFO:teuthology.orchestra.run.gibba041.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-04-23T10:29:08.187 INFO:teuthology.orchestra.run.gibba041.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-04-23T10:29:08.187 INFO:teuthology.orchestra.run.gibba041.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-04-23T10:29:08.188 INFO:teuthology.orchestra.run.gibba041.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-04-23T10:29:08.188 INFO:teuthology.lock.ops:Updating gibba041.front.sepia.ceph.com on lock server
2021-04-23T10:29:08.273 INFO:teuthology.dispatcher.supervisor:Running job 6067849
2021-04-23T10:29:08.273 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2021-04-23_08:19:18-rados-wip-ronenf-scrub-sched-distro-basic-gibba/6067849 --name rfriedma-2021-04-23_08:19:18-rados-wip-ronenf-scrub-sched-distro-basic-gibba --description rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} -- /home/teuthworker/archive/rfriedma-2021-04-23_08:19:18-rados-wip-ronenf-scrub-sched-distro-basic-gibba/6067849/orig.config.yaml
2021-04-23T10:29:08.278 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2021-04-23_08:19:18-rados-wip-ronenf-scrub-sched-distro-basic-gibba/6067849
2021-04-23T10:29:08.278 INFO:teuthology.dispatcher.supervisor:Job PID: 8071
2021-04-23T10:29:08.279 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-04-23T22:29:17.300 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-04-23T22:29:17.471 INFO:teuthology.kill:Killing Pids: {8071}
2021-04-23T22:29:18.580 INFO:teuthology.kill:Nuking machines: ['gibba018', 'gibba041']
2021-04-23T22:29:19.512 INFO:teuthology.kill:2021-04-23 22:29:19,512.512 INFO:teuthology.nuke:targets:
2021-04-23T22:29:19.512 INFO:teuthology.kill:  gibba018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUU1X6Q9qAXj8bt1V2Knl2ooh/mvUWwtoBFdpDdhEymUJE8joEKaon1C9bzPKUJICe6mc3858xpPoZ0sziMTMlFiJ7XlGMf7LxuVmdFzEu7U+FJClCDcc+h0OnKMstAgErAN9rMWxpbCAXOX7pUIVCisuoNa3dZrihU+m5MjA9MLFR6WpkvMC7fZqLm4dAyz2V8igymDYvWx59gpjwElQy5GxzW7iW6mZniMWkmimXbeOsfXqNRMmQnxHVCOGSi6KIPFWdBPE8kplto45RM55WDIjId8aZFOdzaUzTgdnhXvOajEk3ddsq+8GK5y0wzYuXg9iFsMgXprzMeho7fLHpo8BH7UMQjbGV4QQFhXHkF+t7HBC46wtYwKNMBPkrpaRcpoKa/ZPWKiedT9A4XWBXCvp/DjyvaCDFq57hw53iAIcmKvGtPTnN8o2za8Mpk4l/pj+K4li4eMq4mKbADWESl6QH/HrY4aelPnk+/HMlhQmZ7utPvBwewFaP59SXtgk=
2021-04-23T22:29:19.512 INFO:teuthology.kill:  gibba041.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKTxRLHNAS3GQASIKSw6Fg7ehJZL6AdpkLxA367uoc4K7oBDVT0jS8fGC4hKh5YmQFkjBXL3oHpRAAYrF1hm0+yvKZJwlh4begcEkb4cV0weVUrsTQlnMlrEohsEmNAXiVoOghuteTOXU/u3BiXLVtMZaiiAG7pJsi0NRK70bJtW6S+WfgZQtU8/IgOB0lo3T5ReQxMlKDfqmzLoR2AdNv1eRE1452fXIW+mO89fPv3CwvMYS/muRV02Q8t5Tw10FLIJnFgok0+PzjckZZUOAjasJImaRJILtKY2b4koEgf249JpQYwHrSwRZcdrULtZqI1YO/3vN9PTzj66qkkTwMXo8cNYpVpGeUTOJHyWdiQwHIv6I5xf+Y6FvGl+KjeqfuMmvEGXM1WPrqfQMh5iWWUuoVvnz7pwzUwdh9Hop08gETXH4Jbi9Dq0I/xetPQdjPuTAEiPa7/HEDehlrhuYOa2NYxf4qceLsZ6n482EWF2fcLTQoaVolRKomYVQz4eU=
2021-04-23T22:29:19.513 INFO:teuthology.kill:2021-04-23 22:29:19,512.512 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-23T22:29:19.514 INFO:teuthology.kill:2021-04-23 22:29:19,514.514 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-23T22:29:19.589 INFO:teuthology.kill:2021-04-23 22:29:19,588.588 INFO:teuthology.orchestra.console:Power off gibba018
2021-04-23T22:29:19.602 INFO:teuthology.kill:2021-04-23 22:29:19,601.601 INFO:teuthology.orchestra.console:Power off gibba041
2021-04-23T22:29:27.966 INFO:teuthology.kill:2021-04-23 22:29:27,965.965 INFO:teuthology.orchestra.console:Power off for gibba018 completed
2021-04-23T22:29:27.970 INFO:teuthology.kill:2021-04-23 22:29:27,970.970 INFO:teuthology.orchestra.console:Power off for gibba041 completed
2021-04-23T22:29:28.217 INFO:teuthology.task.internal:roles: ubuntu@gibba018.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-04-23T22:29:28.217 INFO:teuthology.task.internal:roles: ubuntu@gibba041.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-04-23T22:29:28.217 INFO:teuthology.misc:Compressing logs...
2021-04-23T22:29:28.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-23T22:30:28.280 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-04-23T22:30:28.364 INFO:teuthology.kill:No teuthology processes running
2021-04-23T22:30:30.516 INFO:teuthology.kill:Nuking machines: ['gibba018', 'gibba041']
2021-04-23T22:30:31.715 INFO:teuthology.kill:2021-04-23 22:30:31,714.714 INFO:teuthology.nuke:targets:
2021-04-23T22:30:31.715 INFO:teuthology.kill:  gibba018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUU1X6Q9qAXj8bt1V2Knl2ooh/mvUWwtoBFdpDdhEymUJE8joEKaon1C9bzPKUJICe6mc3858xpPoZ0sziMTMlFiJ7XlGMf7LxuVmdFzEu7U+FJClCDcc+h0OnKMstAgErAN9rMWxpbCAXOX7pUIVCisuoNa3dZrihU+m5MjA9MLFR6WpkvMC7fZqLm4dAyz2V8igymDYvWx59gpjwElQy5GxzW7iW6mZniMWkmimXbeOsfXqNRMmQnxHVCOGSi6KIPFWdBPE8kplto45RM55WDIjId8aZFOdzaUzTgdnhXvOajEk3ddsq+8GK5y0wzYuXg9iFsMgXprzMeho7fLHpo8BH7UMQjbGV4QQFhXHkF+t7HBC46wtYwKNMBPkrpaRcpoKa/ZPWKiedT9A4XWBXCvp/DjyvaCDFq57hw53iAIcmKvGtPTnN8o2za8Mpk4l/pj+K4li4eMq4mKbADWESl6QH/HrY4aelPnk+/HMlhQmZ7utPvBwewFaP59SXtgk=
2021-04-23T22:30:31.715 INFO:teuthology.kill:  gibba041.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKTxRLHNAS3GQASIKSw6Fg7ehJZL6AdpkLxA367uoc4K7oBDVT0jS8fGC4hKh5YmQFkjBXL3oHpRAAYrF1hm0+yvKZJwlh4begcEkb4cV0weVUrsTQlnMlrEohsEmNAXiVoOghuteTOXU/u3BiXLVtMZaiiAG7pJsi0NRK70bJtW6S+WfgZQtU8/IgOB0lo3T5ReQxMlKDfqmzLoR2AdNv1eRE1452fXIW+mO89fPv3CwvMYS/muRV02Q8t5Tw10FLIJnFgok0+PzjckZZUOAjasJImaRJILtKY2b4koEgf249JpQYwHrSwRZcdrULtZqI1YO/3vN9PTzj66qkkTwMXo8cNYpVpGeUTOJHyWdiQwHIv6I5xf+Y6FvGl+KjeqfuMmvEGXM1WPrqfQMh5iWWUuoVvnz7pwzUwdh9Hop08gETXH4Jbi9Dq0I/xetPQdjPuTAEiPa7/HEDehlrhuYOa2NYxf4qceLsZ6n482EWF2fcLTQoaVolRKomYVQz4eU=
2021-04-23T22:30:31.734 INFO:teuthology.kill:2021-04-23 22:30:31,734.734 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-23T22:30:31.747 INFO:teuthology.kill:2021-04-23 22:30:31,747.747 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-23T22:30:31.812 INFO:teuthology.kill:2021-04-23 22:30:31,812.812 INFO:teuthology.orchestra.console:Power off gibba018
2021-04-23T22:30:31.832 INFO:teuthology.kill:2021-04-23 22:30:31,832.832 INFO:teuthology.orchestra.console:Power off gibba041
2021-04-23T22:30:31.993 INFO:teuthology.kill:2021-04-23 22:30:31,992.992 INFO:teuthology.orchestra.console:Power off for gibba041 completed
2021-04-23T22:30:31.996 INFO:teuthology.kill:2021-04-23 22:30:31,996.996 INFO:teuthology.orchestra.console:Power off for gibba018 completed
2021-04-23T22:30:32.147 INFO:teuthology.kill:2021-04-23 22:30:32,146.146 INFO:teuthology.lock.ops:unlocked gibba041.front.sepia.ceph.com
2021-04-23T22:30:32.162 INFO:teuthology.kill:2021-04-23 22:30:32,162.162 INFO:teuthology.lock.ops:unlocked gibba018.front.sepia.ceph.com
2021-04-23T22:32:32.463 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-04-23T22:32:32.554 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-04-23T22:32:32.555 INFO:teuthology.nuke:Checking targets against current locks
2021-04-23T22:32:32.621 INFO:teuthology.nuke:Not nuking gibba018.front.sepia.ceph.com because description doesn't match
2021-04-23T22:32:32.622 INFO:teuthology.nuke:Not nuking gibba041.front.sepia.ceph.com because description doesn't match