2021-04-23T12:45:22.173 INFO:root:teuthology version: 1.1.0-2713a3cd
2021-04-23T12:45:22.283 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba035.front.sepia.ceph.com' reimaging
2021-04-23T12:45:22.283 INFO:teuthology.lock.ops:Updating [ubuntu@gibba035.front.sepia.ceph.com]: reset os type and version on server
2021-04-23T12:45:22.283 INFO:teuthology.lock.ops:Updating gibba035.front.sepia.ceph.com on lock server
2021-04-23T12:45:22.300 INFO:teuthology.lock.ops:Node 'ubuntu@gibba035.front.sepia.ceph.com' reimaging is complete
2021-04-23T12:45:22.300 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba039.front.sepia.ceph.com' reimaging
2021-04-23T12:45:22.300 INFO:teuthology.lock.ops:Updating [ubuntu@gibba039.front.sepia.ceph.com]: reset os type and version on server
2021-04-23T12:45:22.300 INFO:teuthology.lock.ops:Updating gibba039.front.sepia.ceph.com on lock server
2021-04-23T12:45:22.314 INFO:teuthology.lock.ops:Node 'ubuntu@gibba039.front.sepia.ceph.com' reimaging is complete
2021-04-23T12:45:22.497 INFO:teuthology.provision.fog.gibba035:Scheduling deploy of centos 8.3
2021-04-23T12:45:22.517 INFO:teuthology.provision.fog.gibba039:Scheduling deploy of centos 8.3
2021-04-23T12:45:22.816 INFO:teuthology.orchestra.console:Power off gibba035
2021-04-23T12:45:22.844 INFO:teuthology.orchestra.console:Power off gibba039
2021-04-23T12:45:31.205 INFO:teuthology.orchestra.console:Power off for gibba035 completed
2021-04-23T12:45:31.223 INFO:teuthology.orchestra.console:Power off for gibba039 completed
2021-04-23T12:45:31.306 INFO:teuthology.orchestra.console:Power on gibba035
2021-04-23T12:45:31.323 INFO:teuthology.orchestra.console:Power on gibba039
2021-04-23T12:45:39.681 INFO:teuthology.orchestra.console:Power on for gibba035 completed
2021-04-23T12:45:39.700 INFO:teuthology.orchestra.console:Power on for gibba039 completed
2021-04-23T12:45:39.782 INFO:teuthology.provision.fog.gibba035:Waiting for deploy to finish
2021-04-23T12:45:39.801 INFO:teuthology.provision.fog.gibba039:Waiting for deploy to finish
2021-04-23T12:49:40.182 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-23T12:49:40.246 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-23T12:49:50.597 INFO:teuthology.provision.fog.gibba035:Node is ready
2021-04-23T12:49:50.609 INFO:teuthology.orchestra.run.gibba035.stdout:gibba029
2021-04-23T12:49:50.662 INFO:teuthology.orchestra.run.gibba035.stdout:172.21.2.129 gibba029.front.sepia.ceph.com gibba029
2021-04-23T12:49:50.945 INFO:teuthology.provision.fog.gibba035:Deploy complete!
2021-04-23T12:49:55.551 INFO:teuthology.provision.fog.gibba039:Node is ready
2021-04-23T12:49:55.605 INFO:teuthology.orchestra.run.gibba039.stdout:gibba039.front.sepia.ceph.com
2021-04-23T12:49:55.657 INFO:teuthology.orchestra.run.gibba039.stdout:172.21.2.139 gibba039.front.sepia.ceph.com gibba039
2021-04-23T12:49:55.947 INFO:teuthology.provision.fog.gibba039:Deploy complete!
2021-04-23T12:49:56.070 INFO:teuthology.lock.ops:Checking gibba035.front.sepia.ceph.com
2021-04-23T12:49:56.071 INFO:teuthology.lock.ops:New key found. Updating...
2021-04-23T12:49:56.086 INFO:teuthology.lock.ops:Checking gibba039.front.sepia.ceph.com
2021-04-23T12:49:56.086 INFO:teuthology.lock.ops:New key found. Updating...
2021-04-23T12:49:56.100 INFO:teuthology.lock.ops:Updating [gibba035.front.sepia.ceph.com]: set os type and version on server
2021-04-23T12:49:56.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-23T12:49:56.343 INFO:teuthology.orchestra.run.gibba035.stdout:x86_64
2021-04-23T12:49:56.395 INFO:teuthology.orchestra.run.gibba035.stdout:NAME="CentOS Linux"
2021-04-23T12:49:56.395 INFO:teuthology.orchestra.run.gibba035.stdout:VERSION="8"
2021-04-23T12:49:56.396 INFO:teuthology.orchestra.run.gibba035.stdout:ID="centos"
2021-04-23T12:49:56.396 INFO:teuthology.orchestra.run.gibba035.stdout:ID_LIKE="rhel fedora"
2021-04-23T12:49:56.396 INFO:teuthology.orchestra.run.gibba035.stdout:VERSION_ID="8"
2021-04-23T12:49:56.396 INFO:teuthology.orchestra.run.gibba035.stdout:PLATFORM_ID="platform:el8"
2021-04-23T12:49:56.396 INFO:teuthology.orchestra.run.gibba035.stdout:PRETTY_NAME="CentOS Linux 8"
2021-04-23T12:49:56.396 INFO:teuthology.orchestra.run.gibba035.stdout:ANSI_COLOR="0;31"
2021-04-23T12:49:56.396 INFO:teuthology.orchestra.run.gibba035.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-04-23T12:49:56.396 INFO:teuthology.orchestra.run.gibba035.stdout:HOME_URL="https://centos.org/"
2021-04-23T12:49:56.396 INFO:teuthology.orchestra.run.gibba035.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-04-23T12:49:56.396 INFO:teuthology.orchestra.run.gibba035.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-04-23T12:49:56.396 INFO:teuthology.orchestra.run.gibba035.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-04-23T12:49:56.397 INFO:teuthology.lock.ops:Updating gibba035.front.sepia.ceph.com on lock server
2021-04-23T12:49:56.413 INFO:teuthology.lock.ops:Updating [gibba039.front.sepia.ceph.com]: set os type and version on server
2021-04-23T12:49:56.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-23T12:49:56.659 INFO:teuthology.orchestra.run.gibba039.stdout:x86_64
2021-04-23T12:49:56.711 INFO:teuthology.orchestra.run.gibba039.stdout:NAME="CentOS Linux"
2021-04-23T12:49:56.711 INFO:teuthology.orchestra.run.gibba039.stdout:VERSION="8"
2021-04-23T12:49:56.711 INFO:teuthology.orchestra.run.gibba039.stdout:ID="centos"
2021-04-23T12:49:56.711 INFO:teuthology.orchestra.run.gibba039.stdout:ID_LIKE="rhel fedora"
2021-04-23T12:49:56.711 INFO:teuthology.orchestra.run.gibba039.stdout:VERSION_ID="8"
2021-04-23T12:49:56.711 INFO:teuthology.orchestra.run.gibba039.stdout:PLATFORM_ID="platform:el8"
2021-04-23T12:49:56.711 INFO:teuthology.orchestra.run.gibba039.stdout:PRETTY_NAME="CentOS Linux 8"
2021-04-23T12:49:56.711 INFO:teuthology.orchestra.run.gibba039.stdout:ANSI_COLOR="0;31"
2021-04-23T12:49:56.712 INFO:teuthology.orchestra.run.gibba039.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-04-23T12:49:56.712 INFO:teuthology.orchestra.run.gibba039.stdout:HOME_URL="https://centos.org/"
2021-04-23T12:49:56.712 INFO:teuthology.orchestra.run.gibba039.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-04-23T12:49:56.712 INFO:teuthology.orchestra.run.gibba039.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-04-23T12:49:56.712 INFO:teuthology.orchestra.run.gibba039.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-04-23T12:49:56.712 INFO:teuthology.lock.ops:Updating gibba039.front.sepia.ceph.com on lock server
2021-04-23T12:49:56.789 INFO:teuthology.dispatcher.supervisor:Running job 6067855
2021-04-23T12:49:56.790 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2021-04-23_08:19:18-rados-wip-ronenf-scrub-sched-distro-basic-gibba/6067855 --name rfriedma-2021-04-23_08:19:18-rados-wip-ronenf-scrub-sched-distro-basic-gibba --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} -- /home/teuthworker/archive/rfriedma-2021-04-23_08:19:18-rados-wip-ronenf-scrub-sched-distro-basic-gibba/6067855/orig.config.yaml
2021-04-23T12:49:56.793 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2021-04-23_08:19:18-rados-wip-ronenf-scrub-sched-distro-basic-gibba/6067855
2021-04-23T12:49:56.794 INFO:teuthology.dispatcher.supervisor:Job PID: 18203
2021-04-23T12:49:56.794 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-04-24T00:50:46.816 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-04-24T00:50:47.086 INFO:teuthology.kill:Killing Pids: {18203}
2021-04-24T00:50:48.346 INFO:teuthology.kill:Nuking machines: ['gibba035', 'gibba039']
2021-04-24T00:50:49.280 INFO:teuthology.kill:2021-04-24 00:50:49,279.279 INFO:teuthology.nuke:targets:
2021-04-24T00:50:49.280 INFO:teuthology.kill:  gibba035.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCWzY2gkXcXnjsZMZRi7f9ygG7ZYVzms/kykompyc7V8nRl9jZTrRLY3BVzaTeSRAKtA3IQbe8j3sQIKF6wngabpcodqLD9HDQ9xs1Txen4xMZ+BdJFHgQR1d6u9IzpLqJxexig0NJAv1M9TZ1lcgRARv5YlQvlr9hzWogRkiw78r/Xiud/uLklnkn1oWFDggFOQLwgy27DuKGA8ZlPacSbija2Kg8bm972efieHOm8l7KSaQubmhZMfNfKpOe7WyzLpFbrF2YRLpzUmnrwOm2rxdNKPcZsi95okBE7h/uNWQ2vD8TLiu1jKh3Ew0ym8mUqKqV2B9e42ia6AkdS8Oau0bl6ZNHoRzY0Rogjvbe7Jn8OtLmPja2h5H/IaWHRcuagXxWURmxdi4fvfDeQb+cbxf+9tNZZ9h3dxfHZahFKcbhLZdraFVKm/tsZKfu6aF+zkdoF3UzmzQffbsVkzab3T+8qnLeSNrs/xXF98wxiZBk4NBQYNz3VSRqM8eTvExs=
2021-04-24T00:50:49.280 INFO:teuthology.kill:  gibba039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMEOOyIoLWhf3LWiMJ6/XJpaDZ7prFe0kKegHpusOqpNW5DCG+eXoIZOfKn0OvJVnZJF/DY5dZUg4aC9hjdDS2wLY1BU/ODkHJXfbFUhtVhcOQldjJ5VZ2IGDJB5OH5HRI1YoAJMmsUAe2nnDzj05g0DZ9ycv6IR+aZJGTmQPkCSmUJFD/g2SkNJ0OAq4UUQlnndLuacsYvH6mhq097gp6FXjE/JIfc6xnJE8aT5KSiZsSwe2CAyIilVPB8N0e3n2YglzVggtacDsR+6HIvBpemVyK00ljQq+mytfFVXmFSThTX6Z2Ro9uHyhCdejcE6vpz9I0tCAd3Zyzj/AJJTaZta6Fkj+19cwV8UuNv/9RWPymC7xHgTysL7rR4QQTFHRrGLxkgwPHGcJnzCMHwAvXUebSyRdDWv3FPmOU+e8V9//i9n8sPdzq8GW72TF3ICLfAibjlKlWs/VF7GhbzuE6BTSMdsi7fUcmctvm97eToONKP1vubXdpOEv8xPiP4Hc=
2021-04-24T00:50:49.280 INFO:teuthology.kill:2021-04-24 00:50:49,280.280 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-24T00:50:49.282 INFO:teuthology.kill:2021-04-24 00:50:49,282.282 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-24T00:50:49.382 INFO:teuthology.kill:2021-04-24 00:50:49,382.382 INFO:teuthology.orchestra.console:Power off gibba035
2021-04-24T00:50:49.423 INFO:teuthology.kill:2021-04-24 00:50:49,422.422 INFO:teuthology.orchestra.console:Power off gibba039
2021-04-24T00:50:57.772 INFO:teuthology.kill:2021-04-24 00:50:57,771.771 INFO:teuthology.orchestra.console:Power off for gibba035 completed
2021-04-24T00:50:57.800 INFO:teuthology.kill:2021-04-24 00:50:57,799.799 INFO:teuthology.orchestra.console:Power off for gibba039 completed
2021-04-24T00:50:58.105 INFO:teuthology.task.internal:roles: ubuntu@gibba035.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-04-24T00:50:58.105 INFO:teuthology.task.internal:roles: ubuntu@gibba039.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-04-24T00:50:58.106 INFO:teuthology.misc:Compressing logs...
2021-04-24T00:50:58.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-24T00:51:58.168 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-04-24T00:51:58.231 INFO:teuthology.kill:No teuthology processes running
2021-04-24T00:52:00.065 INFO:teuthology.kill:Nuking machines: ['gibba035', 'gibba039']
2021-04-24T00:52:01.067 INFO:teuthology.kill:2021-04-24 00:52:01,067.067 INFO:teuthology.nuke:targets:
2021-04-24T00:52:01.068 INFO:teuthology.kill:  gibba035.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCWzY2gkXcXnjsZMZRi7f9ygG7ZYVzms/kykompyc7V8nRl9jZTrRLY3BVzaTeSRAKtA3IQbe8j3sQIKF6wngabpcodqLD9HDQ9xs1Txen4xMZ+BdJFHgQR1d6u9IzpLqJxexig0NJAv1M9TZ1lcgRARv5YlQvlr9hzWogRkiw78r/Xiud/uLklnkn1oWFDggFOQLwgy27DuKGA8ZlPacSbija2Kg8bm972efieHOm8l7KSaQubmhZMfNfKpOe7WyzLpFbrF2YRLpzUmnrwOm2rxdNKPcZsi95okBE7h/uNWQ2vD8TLiu1jKh3Ew0ym8mUqKqV2B9e42ia6AkdS8Oau0bl6ZNHoRzY0Rogjvbe7Jn8OtLmPja2h5H/IaWHRcuagXxWURmxdi4fvfDeQb+cbxf+9tNZZ9h3dxfHZahFKcbhLZdraFVKm/tsZKfu6aF+zkdoF3UzmzQffbsVkzab3T+8qnLeSNrs/xXF98wxiZBk4NBQYNz3VSRqM8eTvExs=
2021-04-24T00:52:01.068 INFO:teuthology.kill:  gibba039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMEOOyIoLWhf3LWiMJ6/XJpaDZ7prFe0kKegHpusOqpNW5DCG+eXoIZOfKn0OvJVnZJF/DY5dZUg4aC9hjdDS2wLY1BU/ODkHJXfbFUhtVhcOQldjJ5VZ2IGDJB5OH5HRI1YoAJMmsUAe2nnDzj05g0DZ9ycv6IR+aZJGTmQPkCSmUJFD/g2SkNJ0OAq4UUQlnndLuacsYvH6mhq097gp6FXjE/JIfc6xnJE8aT5KSiZsSwe2CAyIilVPB8N0e3n2YglzVggtacDsR+6HIvBpemVyK00ljQq+mytfFVXmFSThTX6Z2Ro9uHyhCdejcE6vpz9I0tCAd3Zyzj/AJJTaZta6Fkj+19cwV8UuNv/9RWPymC7xHgTysL7rR4QQTFHRrGLxkgwPHGcJnzCMHwAvXUebSyRdDWv3FPmOU+e8V9//i9n8sPdzq8GW72TF3ICLfAibjlKlWs/VF7GhbzuE6BTSMdsi7fUcmctvm97eToONKP1vubXdpOEv8xPiP4Hc=
2021-04-24T00:52:01.105 INFO:teuthology.kill:2021-04-24 00:52:01,105.105 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-24T00:52:01.117 INFO:teuthology.kill:2021-04-24 00:52:01,117.117 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-24T00:52:01.235 INFO:teuthology.kill:2021-04-24 00:52:01,235.235 INFO:teuthology.orchestra.console:Power off gibba035
2021-04-24T00:52:01.252 INFO:teuthology.kill:2021-04-24 00:52:01,252.252 INFO:teuthology.orchestra.console:Power off gibba039
2021-04-24T00:52:01.390 INFO:teuthology.kill:2021-04-24 00:52:01,389.389 INFO:teuthology.orchestra.console:Power off for gibba035 completed
2021-04-24T00:52:01.401 INFO:teuthology.kill:2021-04-24 00:52:01,401.401 INFO:teuthology.orchestra.console:Power off for gibba039 completed
2021-04-24T00:52:01.593 INFO:teuthology.kill:2021-04-24 00:52:01,592.592 INFO:teuthology.lock.ops:unlocked gibba035.front.sepia.ceph.com
2021-04-24T00:52:01.610 INFO:teuthology.kill:2021-04-24 00:52:01,609.609 INFO:teuthology.lock.ops:unlocked gibba039.front.sepia.ceph.com
2021-04-24T00:54:01.959 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-04-24T00:54:02.144 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-04-24T00:54:02.144 INFO:teuthology.nuke:Checking targets against current locks
2021-04-24T00:54:02.227 INFO:teuthology.nuke:Not nuking gibba035.front.sepia.ceph.com because description doesn't match
2021-04-24T00:54:02.227 INFO:teuthology.nuke:Not nuking gibba039.front.sepia.ceph.com because description doesn't match