2021-03-27T13:34:15.100 INFO:root:teuthology version: 1.1.0-d5a60f86
2021-03-27T13:34:15.222 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba002.front.sepia.ceph.com' reimaging
2021-03-27T13:34:15.224 INFO:teuthology.lock.ops:Updating [ubuntu@gibba002.front.sepia.ceph.com]: reset os type and version on server
2021-03-27T13:34:15.224 INFO:teuthology.lock.ops:Updating gibba002.front.sepia.ceph.com on lock server
2021-03-27T13:34:15.247 INFO:teuthology.lock.ops:Node 'ubuntu@gibba002.front.sepia.ceph.com' reimaging is complete
2021-03-27T13:34:15.247 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba036.front.sepia.ceph.com' reimaging
2021-03-27T13:34:15.248 INFO:teuthology.lock.ops:Updating [ubuntu@gibba036.front.sepia.ceph.com]: reset os type and version on server
2021-03-27T13:34:15.248 INFO:teuthology.lock.ops:Updating gibba036.front.sepia.ceph.com on lock server
2021-03-27T13:34:15.276 INFO:teuthology.lock.ops:Node 'ubuntu@gibba036.front.sepia.ceph.com' reimaging is complete
2021-03-27T13:34:15.483 INFO:teuthology.provision.fog.gibba002:Scheduling deploy of centos 8.3
2021-03-27T13:34:15.495 INFO:teuthology.provision.fog.gibba036:Scheduling deploy of centos 8.3
2021-03-27T13:34:15.900 INFO:teuthology.orchestra.console:Power off gibba002
2021-03-27T13:34:15.947 INFO:teuthology.orchestra.console:Power off gibba036
2021-03-27T13:34:24.286 INFO:teuthology.orchestra.console:Power off for gibba002 completed
2021-03-27T13:34:24.328 INFO:teuthology.orchestra.console:Power off for gibba036 completed
2021-03-27T13:34:24.388 INFO:teuthology.orchestra.console:Power on gibba002
2021-03-27T13:34:24.429 INFO:teuthology.orchestra.console:Power on gibba036
2021-03-27T13:34:32.772 INFO:teuthology.orchestra.console:Power on for gibba002 completed
2021-03-27T13:34:32.797 INFO:teuthology.orchestra.console:Power on for gibba036 completed
2021-03-27T13:34:32.874 INFO:teuthology.provision.fog.gibba002:Waiting for deploy to finish
2021-03-27T13:34:32.898 INFO:teuthology.provision.fog.gibba036:Waiting for deploy to finish
2021-03-27T13:38:33.799 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-27T13:38:43.984 INFO:teuthology.provision.fog.gibba002:Node is ready
2021-03-27T13:38:43.998 INFO:teuthology.orchestra.run.gibba002.stdout:gibba002.front.sepia.ceph.com
2021-03-27T13:38:44.050 INFO:teuthology.orchestra.run.gibba002.stdout:172.21.2.102 gibba002.front.sepia.ceph.com gibba002
2021-03-27T13:38:44.356 INFO:teuthology.provision.fog.gibba002:Deploy complete!
2021-03-27T13:38:59.051 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-27T13:38:59.336 INFO:teuthology.provision.fog.gibba036:Node is ready
2021-03-27T13:38:59.389 INFO:teuthology.orchestra.run.gibba036.stdout:gibba036.front.sepia.ceph.com
2021-03-27T13:38:59.442 INFO:teuthology.orchestra.run.gibba036.stdout:172.21.2.136 gibba036.front.sepia.ceph.com gibba036
2021-03-27T13:38:59.732 INFO:teuthology.provision.fog.gibba036:Deploy complete!
2021-03-27T13:38:59.841 INFO:teuthology.lock.ops:Checking gibba002.front.sepia.ceph.com
2021-03-27T13:38:59.842 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-27T13:38:59.859 INFO:teuthology.lock.ops:Checking gibba036.front.sepia.ceph.com
2021-03-27T13:38:59.859 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-27T13:38:59.873 INFO:teuthology.lock.ops:Updating [gibba002.front.sepia.ceph.com]: set os type and version on server
2021-03-27T13:38:59.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-27T13:39:00.118 INFO:teuthology.orchestra.run.gibba002.stdout:x86_64
2021-03-27T13:39:00.169 INFO:teuthology.orchestra.run.gibba002.stdout:NAME="CentOS Linux"
2021-03-27T13:39:00.169 INFO:teuthology.orchestra.run.gibba002.stdout:VERSION="8"
2021-03-27T13:39:00.170 INFO:teuthology.orchestra.run.gibba002.stdout:ID="centos"
2021-03-27T13:39:00.170 INFO:teuthology.orchestra.run.gibba002.stdout:ID_LIKE="rhel fedora"
2021-03-27T13:39:00.170 INFO:teuthology.orchestra.run.gibba002.stdout:VERSION_ID="8"
2021-03-27T13:39:00.170 INFO:teuthology.orchestra.run.gibba002.stdout:PLATFORM_ID="platform:el8"
2021-03-27T13:39:00.171 INFO:teuthology.orchestra.run.gibba002.stdout:PRETTY_NAME="CentOS Linux 8"
2021-03-27T13:39:00.171 INFO:teuthology.orchestra.run.gibba002.stdout:ANSI_COLOR="0;31"
2021-03-27T13:39:00.171 INFO:teuthology.orchestra.run.gibba002.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-27T13:39:00.172 INFO:teuthology.orchestra.run.gibba002.stdout:HOME_URL="https://centos.org/"
2021-03-27T13:39:00.172 INFO:teuthology.orchestra.run.gibba002.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-27T13:39:00.172 INFO:teuthology.orchestra.run.gibba002.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-27T13:39:00.172 INFO:teuthology.orchestra.run.gibba002.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-27T13:39:00.174 INFO:teuthology.lock.ops:Updating gibba002.front.sepia.ceph.com on lock server
2021-03-27T13:39:00.191 INFO:teuthology.lock.ops:Updating [gibba036.front.sepia.ceph.com]: set os type and version on server
2021-03-27T13:39:00.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-27T13:39:00.443 INFO:teuthology.orchestra.run.gibba036.stdout:x86_64
2021-03-27T13:39:00.496 INFO:teuthology.orchestra.run.gibba036.stdout:NAME="CentOS Linux"
2021-03-27T13:39:00.496 INFO:teuthology.orchestra.run.gibba036.stdout:VERSION="8"
2021-03-27T13:39:00.497 INFO:teuthology.orchestra.run.gibba036.stdout:ID="centos"
2021-03-27T13:39:00.497 INFO:teuthology.orchestra.run.gibba036.stdout:ID_LIKE="rhel fedora"
2021-03-27T13:39:00.498 INFO:teuthology.orchestra.run.gibba036.stdout:VERSION_ID="8"
2021-03-27T13:39:00.498 INFO:teuthology.orchestra.run.gibba036.stdout:PLATFORM_ID="platform:el8"
2021-03-27T13:39:00.498 INFO:teuthology.orchestra.run.gibba036.stdout:PRETTY_NAME="CentOS Linux 8"
2021-03-27T13:39:00.498 INFO:teuthology.orchestra.run.gibba036.stdout:ANSI_COLOR="0;31"
2021-03-27T13:39:00.499 INFO:teuthology.orchestra.run.gibba036.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-27T13:39:00.499 INFO:teuthology.orchestra.run.gibba036.stdout:HOME_URL="https://centos.org/"
2021-03-27T13:39:00.499 INFO:teuthology.orchestra.run.gibba036.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-27T13:39:00.500 INFO:teuthology.orchestra.run.gibba036.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-27T13:39:00.500 INFO:teuthology.orchestra.run.gibba036.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-27T13:39:00.500 INFO:teuthology.lock.ops:Updating gibba036.front.sepia.ceph.com on lock server
2021-03-27T13:39:00.588 INFO:teuthology.dispatcher.supervisor:Running job 6003994
2021-03-27T13:39:00.589 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/virtualenv/bin/teuthology -v --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-03-27_12:17:59-rados-wip-kefu-testing-2021-03-27-1545-distro-basic-gibba/6003994 --name kchai-2021-03-27_12:17:59-rados-wip-kefu-testing-2021-03-27-1545-distro-basic-gibba --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/kchai-2021-03-27_12:17:59-rados-wip-kefu-testing-2021-03-27-1545-distro-basic-gibba/6003994/orig.config.yaml
2021-03-27T13:39:00.593 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kchai-2021-03-27_12:17:59-rados-wip-kefu-testing-2021-03-27-1545-distro-basic-gibba/6003994
2021-03-27T13:39:00.594 INFO:teuthology.dispatcher.supervisor:Job PID: 7194
2021-03-27T13:39:00.594 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-28T01:39:37.831 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-03-28T01:39:38.010 INFO:teuthology.kill:Killing Pids: {7194}
2021-03-28T01:39:39.050 INFO:teuthology.kill:Nuking machines: ['gibba002', 'gibba036']
2021-03-28T01:39:39.919 INFO:teuthology.kill:2021-03-28 01:39:39,918.918 INFO:teuthology.nuke:targets:
2021-03-28T01:39:39.919 INFO:teuthology.kill:  gibba002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrID1qmCpwkKzsf9sdQ4AEDIDEEXTdIFIiJVkr+CcWziqfPir3s28wNYlMP+/MmJnAzHS9d9/cDjEBaxVdGjOLGYIRC2n6UOs4rrlEnrZuaXmr0ptLaJWe2dqqKdnpNXSAlQeD539nd3JjLtG8MPe/jzMVvohRYhAmJojY4AZK9RM+lRtm2i8QPkDiUIQVOIwNSqKfoL2cb0nKAH5fLU0N8EjzBlzUTMzN6Za+r8v660tpusA1C+wXbCZPzim5WnQmuaRdTfy+GM0jp2xGoZAlz2Dgb2FnXNMHVk6I5Kl+voYdVXHWRMq88p6DG3EMOvH/RmMjkxhz8S6xzyHah13OGtnN7SB35Xo3Wj+6oU0v51xn8snwEJo+o6Kp6KqRue+wMxZpUNl7qAgEIRk3PZftzh5dOa9lzFO70g6a5RZFE/j3oDjSkDJNpzXcQWhP7MNDujL5o/kHMmeHcWWCa9+jwVxIIKJEjSmfzL7yUVyEF8SfzVx79yFeLDtYUG+CTYk=
2021-03-28T01:39:39.920 INFO:teuthology.kill:  gibba036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDB1ctkHAF5xxv5AQ3VXKUGghENIC0omWk+Vb5Q3KDqYfjRZXdmZ7QsrCkLZHE1ubrgbH6WLTDRdEaNu7TVEEcc2ikq/9t0fqTv/TgycDlT1Ywv1gVNAxBIgiN1+khC5c3UOED+KEZGBEFoZFwvw2wJtQeI8cThCTXF3NcN9jJXFkAZg6ASZostC9Gxn5lhuVtneaoNh/Vv1RQqBVf94Tnzvza/G+A6DCnYx3k8JuQFYwigo0rooeH0AGlyo9FgxvsKrK/XFsRsBuvmLRsy9sBGb3pmR7goK5hM6Dr/xDCF7KZxRkp3p2Ke98wwND1ymsl7Q2sQBrOlpCDLw2lSXI8QMDCZZtU4ucC70Fw9+0nQ2bSkrtOq8MnH9RtHhjox5hvPnTCtxLGs2nuoRE5xsfOKaqSpLEYsgQk3d/nO5nrFQEWaTVQHgjbGQj17tDL6LFXqoUm8UCncxQClQKX4PM1zqipyuMe7kU0UApUqj76VwQl30z/CTrTwE14Me7KVRns=
2021-03-28T01:39:39.920 INFO:teuthology.kill:2021-03-28 01:39:39,919.919 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-28T01:39:39.921 INFO:teuthology.kill:2021-03-28 01:39:39,921.921 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-28T01:39:40.020 INFO:teuthology.kill:2021-03-28 01:39:40,020.020 INFO:teuthology.orchestra.console:Power off gibba002
2021-03-28T01:39:40.033 INFO:teuthology.kill:2021-03-28 01:39:40,032.032 INFO:teuthology.orchestra.console:Power off gibba036
2021-03-28T01:39:48.414 INFO:teuthology.kill:2021-03-28 01:39:48,414.414 INFO:teuthology.orchestra.console:Power off for gibba036 completed
2021-03-28T01:39:48.472 INFO:teuthology.kill:2021-03-28 01:39:48,471.471 INFO:teuthology.orchestra.console:Power off for gibba002 completed
2021-03-28T01:39:48.697 INFO:teuthology.task.internal:roles: ubuntu@gibba002.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-03-28T01:39:48.698 INFO:teuthology.task.internal:roles: ubuntu@gibba036.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-03-28T01:39:48.698 INFO:teuthology.misc:Compressing logs...
2021-03-28T01:39:48.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-28T01:40:48.760 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d5a60f86b5bc836fe1569aac8a1c7ce60b0a3cf2/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-03-28T01:40:48.811 INFO:teuthology.kill:No teuthology processes running
2021-03-28T01:40:49.853 INFO:teuthology.kill:Nuking machines: ['gibba002', 'gibba036']
2021-03-28T01:40:50.733 INFO:teuthology.kill:2021-03-28 01:40:50,733.733 INFO:teuthology.nuke:targets:
2021-03-28T01:40:50.734 INFO:teuthology.kill:  gibba002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrID1qmCpwkKzsf9sdQ4AEDIDEEXTdIFIiJVkr+CcWziqfPir3s28wNYlMP+/MmJnAzHS9d9/cDjEBaxVdGjOLGYIRC2n6UOs4rrlEnrZuaXmr0ptLaJWe2dqqKdnpNXSAlQeD539nd3JjLtG8MPe/jzMVvohRYhAmJojY4AZK9RM+lRtm2i8QPkDiUIQVOIwNSqKfoL2cb0nKAH5fLU0N8EjzBlzUTMzN6Za+r8v660tpusA1C+wXbCZPzim5WnQmuaRdTfy+GM0jp2xGoZAlz2Dgb2FnXNMHVk6I5Kl+voYdVXHWRMq88p6DG3EMOvH/RmMjkxhz8S6xzyHah13OGtnN7SB35Xo3Wj+6oU0v51xn8snwEJo+o6Kp6KqRue+wMxZpUNl7qAgEIRk3PZftzh5dOa9lzFO70g6a5RZFE/j3oDjSkDJNpzXcQWhP7MNDujL5o/kHMmeHcWWCa9+jwVxIIKJEjSmfzL7yUVyEF8SfzVx79yFeLDtYUG+CTYk=
2021-03-28T01:40:50.734 INFO:teuthology.kill:  gibba036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDB1ctkHAF5xxv5AQ3VXKUGghENIC0omWk+Vb5Q3KDqYfjRZXdmZ7QsrCkLZHE1ubrgbH6WLTDRdEaNu7TVEEcc2ikq/9t0fqTv/TgycDlT1Ywv1gVNAxBIgiN1+khC5c3UOED+KEZGBEFoZFwvw2wJtQeI8cThCTXF3NcN9jJXFkAZg6ASZostC9Gxn5lhuVtneaoNh/Vv1RQqBVf94Tnzvza/G+A6DCnYx3k8JuQFYwigo0rooeH0AGlyo9FgxvsKrK/XFsRsBuvmLRsy9sBGb3pmR7goK5hM6Dr/xDCF7KZxRkp3p2Ke98wwND1ymsl7Q2sQBrOlpCDLw2lSXI8QMDCZZtU4ucC70Fw9+0nQ2bSkrtOq8MnH9RtHhjox5hvPnTCtxLGs2nuoRE5xsfOKaqSpLEYsgQk3d/nO5nrFQEWaTVQHgjbGQj17tDL6LFXqoUm8UCncxQClQKX4PM1zqipyuMe7kU0UApUqj76VwQl30z/CTrTwE14Me7KVRns=
2021-03-28T01:40:50.754 INFO:teuthology.kill:2021-03-28 01:40:50,754.754 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-28T01:40:50.766 INFO:teuthology.kill:2021-03-28 01:40:50,766.766 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-28T01:40:50.830 INFO:teuthology.kill:2021-03-28 01:40:50,830.830 INFO:teuthology.orchestra.console:Power off gibba002
2021-03-28T01:40:50.842 INFO:teuthology.kill:2021-03-28 01:40:50,841.841 INFO:teuthology.orchestra.console:Power off gibba036
2021-03-28T01:40:50.976 INFO:teuthology.kill:2021-03-28 01:40:50,976.976 INFO:teuthology.orchestra.console:Power off for gibba002 completed
2021-03-28T01:40:50.988 INFO:teuthology.kill:2021-03-28 01:40:50,988.988 INFO:teuthology.orchestra.console:Power off for gibba036 completed
2021-03-28T01:40:51.129 INFO:teuthology.kill:2021-03-28 01:40:51,128.128 INFO:teuthology.lock.ops:unlocked gibba002.front.sepia.ceph.com
2021-03-28T01:40:51.145 INFO:teuthology.kill:2021-03-28 01:40:51,144.144 INFO:teuthology.lock.ops:unlocked gibba036.front.sepia.ceph.com
2021-03-28T01:43:01.995 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-28T01:43:02.077 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-28T01:43:02.077 INFO:teuthology.nuke:Checking targets against current locks
2021-03-28T01:43:02.166 INFO:teuthology.nuke:Not nuking gibba002.front.sepia.ceph.com because description doesn't match
2021-03-28T01:43:02.166 INFO:teuthology.nuke:Not nuking gibba036.front.sepia.ceph.com because description doesn't match