2021-03-25T02:37:28.609 INFO:root:teuthology version: 1.1.0-6b3150e9
2021-03-25T02:37:28.718 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba011.front.sepia.ceph.com' reimaging
2021-03-25T02:37:28.718 INFO:teuthology.lock.ops:Updating [ubuntu@gibba011.front.sepia.ceph.com]: reset os type and version on server
2021-03-25T02:37:28.718 INFO:teuthology.lock.ops:Updating gibba011.front.sepia.ceph.com on lock server
2021-03-25T02:37:28.734 INFO:teuthology.lock.ops:Node 'ubuntu@gibba011.front.sepia.ceph.com' reimaging is complete
2021-03-25T02:37:28.734 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba012.front.sepia.ceph.com' reimaging
2021-03-25T02:37:28.734 INFO:teuthology.lock.ops:Updating [ubuntu@gibba012.front.sepia.ceph.com]: reset os type and version on server
2021-03-25T02:37:28.734 INFO:teuthology.lock.ops:Updating gibba012.front.sepia.ceph.com on lock server
2021-03-25T02:37:28.755 INFO:teuthology.lock.ops:Node 'ubuntu@gibba012.front.sepia.ceph.com' reimaging is complete
2021-03-25T02:37:28.951 INFO:teuthology.provision.fog.gibba011:Scheduling deploy of ubuntu 18.04
2021-03-25T02:37:28.969 INFO:teuthology.provision.fog.gibba012:Scheduling deploy of ubuntu 18.04
2021-03-25T02:37:29.307 INFO:teuthology.orchestra.console:Power off gibba011
2021-03-25T02:37:29.360 INFO:teuthology.orchestra.console:Power off gibba012
2021-03-25T02:37:37.699 INFO:teuthology.orchestra.console:Power off for gibba011 completed
2021-03-25T02:37:37.734 INFO:teuthology.orchestra.console:Power off for gibba012 completed
2021-03-25T02:37:37.801 INFO:teuthology.orchestra.console:Power on gibba011
2021-03-25T02:37:37.835 INFO:teuthology.orchestra.console:Power on gibba012
2021-03-25T02:37:46.208 INFO:teuthology.orchestra.console:Power on for gibba011 completed
2021-03-25T02:37:46.282 INFO:teuthology.orchestra.console:Power on for gibba012 completed
2021-03-25T02:37:46.310 INFO:teuthology.provision.fog.gibba011:Waiting for deploy to finish
2021-03-25T02:37:46.383 INFO:teuthology.provision.fog.gibba012:Waiting for deploy to finish
2021-03-25T02:40:17.940 ERROR:teuthology.orchestra.connection:Error authenticating with gibba012.front.sepia.ceph.com: Authentication failed.
2021-03-25T02:42:11.384 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-25T02:42:16.773 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-25T02:42:17.395 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-25T02:42:22.783 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-25T02:42:23.406 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-25T02:42:29.421 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-25T02:42:29.802 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-25T02:42:35.489 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-25T02:42:35.777 INFO:teuthology.provision.fog.gibba012:Node is ready
2021-03-25T02:42:35.831 INFO:teuthology.orchestra.run.gibba012.stdout:gibba012.front.sepia.ceph.com
2021-03-25T02:42:35.871 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-25T02:42:35.879 INFO:teuthology.orchestra.run.gibba012.stdout:172.21.2.112 gibba012.front.sepia.ceph.com gibba012
2021-03-25T02:42:36.179 INFO:teuthology.provision.fog.gibba012:Deploy complete!
2021-03-25T02:42:36.316 INFO:teuthology.provision.fog.gibba011:Node is ready
2021-03-25T02:42:36.367 INFO:teuthology.orchestra.run.gibba011.stdout:gibba011.front.sepia.ceph.com
2021-03-25T02:42:36.417 INFO:teuthology.orchestra.run.gibba011.stdout:172.21.2.111 gibba011.front.sepia.ceph.com gibba011
2021-03-25T02:42:36.702 INFO:teuthology.provision.fog.gibba011:Deploy complete!
2021-03-25T02:42:36.849 INFO:teuthology.lock.ops:Checking gibba011.front.sepia.ceph.com
2021-03-25T02:42:36.849 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-25T02:42:36.866 INFO:teuthology.lock.ops:Checking gibba012.front.sepia.ceph.com
2021-03-25T02:42:36.866 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-25T02:42:36.882 INFO:teuthology.lock.ops:Updating [gibba011.front.sepia.ceph.com]: set os type and version on server
2021-03-25T02:42:36.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-25T02:42:37.147 INFO:teuthology.orchestra.run.gibba011.stdout:x86_64
2021-03-25T02:42:37.195 INFO:teuthology.orchestra.run.gibba011.stdout:NAME="Ubuntu"
2021-03-25T02:42:37.195 INFO:teuthology.orchestra.run.gibba011.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-25T02:42:37.195 INFO:teuthology.orchestra.run.gibba011.stdout:ID=ubuntu
2021-03-25T02:42:37.195 INFO:teuthology.orchestra.run.gibba011.stdout:ID_LIKE=debian
2021-03-25T02:42:37.195 INFO:teuthology.orchestra.run.gibba011.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-25T02:42:37.195 INFO:teuthology.orchestra.run.gibba011.stdout:VERSION_ID="18.04"
2021-03-25T02:42:37.195 INFO:teuthology.orchestra.run.gibba011.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-25T02:42:37.196 INFO:teuthology.orchestra.run.gibba011.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-25T02:42:37.196 INFO:teuthology.orchestra.run.gibba011.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-25T02:42:37.196 INFO:teuthology.orchestra.run.gibba011.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-25T02:42:37.196 INFO:teuthology.orchestra.run.gibba011.stdout:VERSION_CODENAME=bionic
2021-03-25T02:42:37.196 INFO:teuthology.orchestra.run.gibba011.stdout:UBUNTU_CODENAME=bionic
2021-03-25T02:42:37.197 INFO:teuthology.lock.ops:Updating gibba011.front.sepia.ceph.com on lock server
2021-03-25T02:42:37.213 INFO:teuthology.lock.ops:Updating [gibba012.front.sepia.ceph.com]: set os type and version on server
2021-03-25T02:42:37.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-25T02:42:37.468 INFO:teuthology.orchestra.run.gibba012.stdout:x86_64
2021-03-25T02:42:37.519 INFO:teuthology.orchestra.run.gibba012.stdout:NAME="Ubuntu"
2021-03-25T02:42:37.519 INFO:teuthology.orchestra.run.gibba012.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-25T02:42:37.519 INFO:teuthology.orchestra.run.gibba012.stdout:ID=ubuntu
2021-03-25T02:42:37.519 INFO:teuthology.orchestra.run.gibba012.stdout:ID_LIKE=debian
2021-03-25T02:42:37.520 INFO:teuthology.orchestra.run.gibba012.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-25T02:42:37.520 INFO:teuthology.orchestra.run.gibba012.stdout:VERSION_ID="18.04"
2021-03-25T02:42:37.520 INFO:teuthology.orchestra.run.gibba012.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-25T02:42:37.520 INFO:teuthology.orchestra.run.gibba012.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-25T02:42:37.520 INFO:teuthology.orchestra.run.gibba012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-25T02:42:37.520 INFO:teuthology.orchestra.run.gibba012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-25T02:42:37.520 INFO:teuthology.orchestra.run.gibba012.stdout:VERSION_CODENAME=bionic
2021-03-25T02:42:37.520 INFO:teuthology.orchestra.run.gibba012.stdout:UBUNTU_CODENAME=bionic
2021-03-25T02:42:37.521 INFO:teuthology.lock.ops:Updating gibba012.front.sepia.ceph.com on lock server
2021-03-25T02:42:37.593 INFO:teuthology.dispatcher.supervisor:Running job 5991276
2021-03-25T02:42:37.593 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology -v --owner scheduled_nojha@teuthology --archive /home/teuthworker/archive/nojha-2021-03-23_23:04:33-rados-wip-40323-2-distro-basic-gibba/5991276 --name nojha-2021-03-23_23:04:33-rados-wip-40323-2-distro-basic-gibba --description rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} -- /home/teuthworker/archive/nojha-2021-03-23_23:04:33-rados-wip-40323-2-distro-basic-gibba/5991276/orig.config.yaml
2021-03-25T02:42:37.596 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nojha-2021-03-23_23:04:33-rados-wip-40323-2-distro-basic-gibba/5991276
2021-03-25T02:42:37.597 INFO:teuthology.dispatcher.supervisor:Job PID: 26929
2021-03-25T02:42:37.597 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-25T06:08:42.121 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 498, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 463, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 320, in report_job
    response.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/nojha-2021-03-23_23:04:33-rados-wip-40323-2-distro-basic-gibba/jobs/5991276/
2021-03-25T14:42:53.574 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-03-25T14:42:54.136 INFO:teuthology.kill:Killing Pids: {26929}
2021-03-25T14:42:56.334 INFO:teuthology.kill:Nuking machines: ['gibba011', 'gibba012']
2021-03-25T14:42:57.488 INFO:teuthology.kill:2021-03-25 14:42:57,487.487 INFO:teuthology.nuke:targets:
2021-03-25T14:42:57.489 INFO:teuthology.kill:  gibba011.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzCnCm7lh/Tfef4MNanlHhNLBtDFHT3BmUodLfcWMLiLsGBwmU7S5dBLLsVPq0dzeFghcZOrL2MCAU6/DW87sOKWGo1lv4Y6E8kon6DP9FsYcdaTW/42JDMgE3/PvgxvMBKYQgAML2eCERTweYxmfwbfKo+OdBVv5SdydpBf/s8X3t8xnGIRcOYRGzHozhQhCQVSZOPxItWJ6zkJTtrLUhI+t0ntQ0PA2GHodhn3hejVTnjm+upl7OulwdQWe6R5cX+SOwrnuQbBdKPu+U7ER7JdAt3bJ+0vIEA0R0iQ/l/KCiunzxQ5TaDzOjuelBUY+PlVRqWKTNzVVBW/XtWAkX
2021-03-25T14:42:57.489 INFO:teuthology.kill:  gibba012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMutY9m+SmzgiRQkPUePGx85+OGouWqEzuVKgFEzjJouYQMiWgRZjSTd07hMWtwCmJrinAWDkSzVOE8ccML45cFoYnao+N6tuoVe1Vh4k7lnzCTKe1xfAVEBaYVOuTzIMKCd8ScHh8s3E7UBwhSsPBMqZ2fEq23u1Lqf0Y3/+VcfwAhZ6wwb0CcuS5xBtl9208I0ZO1zpOebh2+e+13vLyqaz7QapPZCTEvTbDPCWV7EPZKRXVKYa+f1yjkeR/ApSgfibKmpwkSB8FXGYh8ddAJWyCnEIPzIjqZqtSHJ3ApDNsa7l8d3zgp8GunVZwO8Dl6lqRO4V/lXV8ZBuVL7fn
2021-03-25T14:42:57.489 INFO:teuthology.kill:2021-03-25 14:42:57,488.488 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-25T14:42:57.490 INFO:teuthology.kill:2021-03-25 14:42:57,490.490 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-25T14:42:57.561 INFO:teuthology.kill:2021-03-25 14:42:57,560.560 INFO:teuthology.orchestra.console:Power off gibba012
2021-03-25T14:42:57.577 INFO:teuthology.kill:2021-03-25 14:42:57,577.577 INFO:teuthology.orchestra.console:Power off gibba011
2021-03-25T14:43:05.972 INFO:teuthology.kill:2021-03-25 14:43:05,972.972 INFO:teuthology.orchestra.console:Power off for gibba011 completed
2021-03-25T14:43:05.992 INFO:teuthology.kill:2021-03-25 14:43:05,992.992 INFO:teuthology.orchestra.console:Power off for gibba012 completed
2021-03-25T14:43:06.399 INFO:teuthology.task.internal:roles: ubuntu@gibba011.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2']
2021-03-25T14:43:06.400 INFO:teuthology.task.internal:roles: ubuntu@gibba012.front.sepia.ceph.com - ['osd.3', 'osd.4', 'osd.5', 'client.0']
2021-03-25T14:43:06.406 INFO:teuthology.misc:Compressing logs...
2021-03-25T14:43:06.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-25T14:43:25.011 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-03-25T14:43:25.091 INFO:teuthology.kill:No teuthology processes running
2021-03-25T14:43:26.135 INFO:teuthology.kill:Nuking machines: ['gibba011', 'gibba012']
2021-03-25T14:43:27.067 INFO:teuthology.kill:2021-03-25 14:43:27,067.067 INFO:teuthology.nuke:targets:
2021-03-25T14:43:27.068 INFO:teuthology.kill:  gibba011.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzCnCm7lh/Tfef4MNanlHhNLBtDFHT3BmUodLfcWMLiLsGBwmU7S5dBLLsVPq0dzeFghcZOrL2MCAU6/DW87sOKWGo1lv4Y6E8kon6DP9FsYcdaTW/42JDMgE3/PvgxvMBKYQgAML2eCERTweYxmfwbfKo+OdBVv5SdydpBf/s8X3t8xnGIRcOYRGzHozhQhCQVSZOPxItWJ6zkJTtrLUhI+t0ntQ0PA2GHodhn3hejVTnjm+upl7OulwdQWe6R5cX+SOwrnuQbBdKPu+U7ER7JdAt3bJ+0vIEA0R0iQ/l/KCiunzxQ5TaDzOjuelBUY+PlVRqWKTNzVVBW/XtWAkX
2021-03-25T14:43:27.068 INFO:teuthology.kill:  gibba012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMutY9m+SmzgiRQkPUePGx85+OGouWqEzuVKgFEzjJouYQMiWgRZjSTd07hMWtwCmJrinAWDkSzVOE8ccML45cFoYnao+N6tuoVe1Vh4k7lnzCTKe1xfAVEBaYVOuTzIMKCd8ScHh8s3E7UBwhSsPBMqZ2fEq23u1Lqf0Y3/+VcfwAhZ6wwb0CcuS5xBtl9208I0ZO1zpOebh2+e+13vLyqaz7QapPZCTEvTbDPCWV7EPZKRXVKYa+f1yjkeR/ApSgfibKmpwkSB8FXGYh8ddAJWyCnEIPzIjqZqtSHJ3ApDNsa7l8d3zgp8GunVZwO8Dl6lqRO4V/lXV8ZBuVL7fn
2021-03-25T14:43:27.089 INFO:teuthology.kill:2021-03-25 14:43:27,089.089 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-25T14:43:27.092 INFO:teuthology.kill:2021-03-25 14:43:27,092.092 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-25T14:43:27.151 INFO:teuthology.kill:2021-03-25 14:43:27,151.151 INFO:teuthology.orchestra.console:Power off gibba012
2021-03-25T14:43:27.175 INFO:teuthology.kill:2021-03-25 14:43:27,174.174 INFO:teuthology.orchestra.console:Power off gibba011
2021-03-25T14:43:27.321 INFO:teuthology.kill:2021-03-25 14:43:27,320.320 INFO:teuthology.orchestra.console:Power off for gibba012 completed
2021-03-25T14:43:27.328 INFO:teuthology.kill:2021-03-25 14:43:27,328.328 INFO:teuthology.orchestra.console:Power off for gibba011 completed
2021-03-25T14:43:27.465 INFO:teuthology.kill:2021-03-25 14:43:27,464.464 INFO:teuthology.lock.ops:unlocked gibba012.front.sepia.ceph.com
2021-03-25T14:43:27.466 INFO:teuthology.kill:2021-03-25 14:43:27,466.466 ERROR:teuthology.lock.ops:failed to unlock gibba011.front.sepia.ceph.com. reason: 500
2021-03-25T14:45:27.667 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-25T14:45:27.787 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-25T14:45:27.790 INFO:teuthology.nuke:Checking targets against current locks
2021-03-25T14:45:28.044 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/scripts/dispatcher.py", line 33, in main
    teuthology.dispatcher.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 59, in main
    verbose
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 152, in run_job
    unlock_targets(job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets
    nuke(fake_ctx, True)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/nuke/__init__.py", line 250, in nuke
    if ctx.name not in lock['description']:
TypeError: argument of type 'NoneType' is not iterable