2021-03-18T20:29:59.783 INFO:root:teuthology version: 1.1.0-b9656917
2021-03-18T20:29:59.882 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba031.front.sepia.ceph.com' reimaging
2021-03-18T20:29:59.882 INFO:teuthology.lock.ops:Updating [ubuntu@gibba031.front.sepia.ceph.com]: reset os type and version on server
2021-03-18T20:29:59.882 INFO:teuthology.lock.ops:Updating gibba031.front.sepia.ceph.com on lock server
2021-03-18T20:29:59.898 INFO:teuthology.lock.ops:Node 'ubuntu@gibba031.front.sepia.ceph.com' reimaging is complete
2021-03-18T20:29:59.898 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba045.front.sepia.ceph.com' reimaging
2021-03-18T20:29:59.898 INFO:teuthology.lock.ops:Updating [ubuntu@gibba045.front.sepia.ceph.com]: reset os type and version on server
2021-03-18T20:29:59.898 INFO:teuthology.lock.ops:Updating gibba045.front.sepia.ceph.com on lock server
2021-03-18T20:29:59.915 INFO:teuthology.lock.ops:Node 'ubuntu@gibba045.front.sepia.ceph.com' reimaging is complete
2021-03-18T20:30:00.117 INFO:teuthology.provision.fog.gibba031:Scheduling deploy of ubuntu 18.04
2021-03-18T20:30:00.137 INFO:teuthology.provision.fog.gibba045:Scheduling deploy of ubuntu 18.04
2021-03-18T20:30:00.514 INFO:teuthology.orchestra.console:Power off gibba031
2021-03-18T20:30:00.551 INFO:teuthology.orchestra.console:Power off gibba045
2021-03-18T20:30:08.919 INFO:teuthology.orchestra.console:Power off for gibba031 completed
2021-03-18T20:30:08.934 INFO:teuthology.orchestra.console:Power off for gibba045 completed
2021-03-18T20:30:09.021 INFO:teuthology.orchestra.console:Power on gibba031
2021-03-18T20:30:09.035 INFO:teuthology.orchestra.console:Power on gibba045
2021-03-18T20:30:17.407 INFO:teuthology.orchestra.console:Power on for gibba031 completed
2021-03-18T20:30:17.482 INFO:teuthology.orchestra.console:Power on for gibba045 completed
2021-03-18T20:30:17.509 INFO:teuthology.provision.fog.gibba031:Waiting for deploy to finish
2021-03-18T20:30:17.583 INFO:teuthology.provision.fog.gibba045:Waiting for deploy to finish
2021-03-18T20:34:39.300 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-18T20:34:45.316 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-18T20:34:45.696 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-18T20:34:51.327 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-18T20:34:51.706 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-18T20:34:57.410 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-18T20:34:57.711 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-18T20:34:57.806 INFO:teuthology.provision.fog.gibba045:Node is ready
2021-03-18T20:34:57.850 INFO:teuthology.orchestra.run.gibba045.stdout:gibba045.front.sepia.ceph.com
2021-03-18T20:34:57.894 INFO:teuthology.orchestra.run.gibba045.stdout:172.21.2.145 gibba045.front.sepia.ceph.com gibba045
2021-03-18T20:34:58.140 INFO:teuthology.provision.fog.gibba045:Deploy complete!
2021-03-18T20:35:03.775 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-18T20:35:04.184 INFO:teuthology.provision.fog.gibba031:Node is ready
2021-03-18T20:35:04.229 INFO:teuthology.orchestra.run.gibba031.stdout:gibba031.front.sepia.ceph.com
2021-03-18T20:35:04.273 INFO:teuthology.orchestra.run.gibba031.stdout:172.21.2.131 gibba031.front.sepia.ceph.com gibba031
2021-03-18T20:35:04.552 INFO:teuthology.provision.fog.gibba031:Deploy complete!
2021-03-18T20:35:04.663 INFO:teuthology.lock.ops:Checking gibba031.front.sepia.ceph.com
2021-03-18T20:35:04.663 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-18T20:35:04.681 INFO:teuthology.lock.ops:Checking gibba045.front.sepia.ceph.com
2021-03-18T20:35:04.682 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-18T20:35:04.698 INFO:teuthology.lock.ops:Updating [gibba031.front.sepia.ceph.com]: set os type and version on server
2021-03-18T20:35:04.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-18T20:35:04.977 INFO:teuthology.orchestra.run.gibba031.stdout:x86_64
2021-03-18T20:35:05.021 INFO:teuthology.orchestra.run.gibba031.stdout:NAME="Ubuntu"
2021-03-18T20:35:05.021 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-18T20:35:05.021 INFO:teuthology.orchestra.run.gibba031.stdout:ID=ubuntu
2021-03-18T20:35:05.021 INFO:teuthology.orchestra.run.gibba031.stdout:ID_LIKE=debian
2021-03-18T20:35:05.022 INFO:teuthology.orchestra.run.gibba031.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-18T20:35:05.022 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION_ID="18.04"
2021-03-18T20:35:05.022 INFO:teuthology.orchestra.run.gibba031.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-18T20:35:05.022 INFO:teuthology.orchestra.run.gibba031.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-18T20:35:05.022 INFO:teuthology.orchestra.run.gibba031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-18T20:35:05.022 INFO:teuthology.orchestra.run.gibba031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-18T20:35:05.022 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION_CODENAME=bionic
2021-03-18T20:35:05.022 INFO:teuthology.orchestra.run.gibba031.stdout:UBUNTU_CODENAME=bionic
2021-03-18T20:35:05.023 INFO:teuthology.lock.ops:Updating gibba031.front.sepia.ceph.com on lock server
2021-03-18T20:35:05.039 INFO:teuthology.lock.ops:Updating [gibba045.front.sepia.ceph.com]: set os type and version on server
2021-03-18T20:35:05.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-18T20:35:05.321 INFO:teuthology.orchestra.run.gibba045.stdout:x86_64
2021-03-18T20:35:05.365 INFO:teuthology.orchestra.run.gibba045.stdout:NAME="Ubuntu"
2021-03-18T20:35:05.365 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-18T20:35:05.365 INFO:teuthology.orchestra.run.gibba045.stdout:ID=ubuntu
2021-03-18T20:35:05.365 INFO:teuthology.orchestra.run.gibba045.stdout:ID_LIKE=debian
2021-03-18T20:35:05.366 INFO:teuthology.orchestra.run.gibba045.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-18T20:35:05.366 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION_ID="18.04"
2021-03-18T20:35:05.366 INFO:teuthology.orchestra.run.gibba045.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-18T20:35:05.366 INFO:teuthology.orchestra.run.gibba045.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-18T20:35:05.366 INFO:teuthology.orchestra.run.gibba045.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-18T20:35:05.366 INFO:teuthology.orchestra.run.gibba045.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-18T20:35:05.366 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION_CODENAME=bionic
2021-03-18T20:35:05.366 INFO:teuthology.orchestra.run.gibba045.stdout:UBUNTU_CODENAME=bionic
2021-03-18T20:35:05.367 INFO:teuthology.lock.ops:Updating gibba045.front.sepia.ceph.com on lock server
2021-03-18T20:35:05.459 INFO:teuthology.dispatcher.supervisor:Running job 5977894
2021-03-18T20:35:05.459 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/virtualenv/bin/teuthology -v --owner scheduled_ideepika@teuthology --archive /home/teuthworker/archive/ideepika-2021-03-18_20:03:11-rados:thrash-erasure-code-wip-test-merge-log-distro-basic-gibba/5977894 --name ideepika-2021-03-18_20:03:11-rados:thrash-erasure-code-wip-test-merge-log-distro-basic-gibba --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/ideepika-2021-03-18_20:03:11-rados:thrash-erasure-code-wip-test-merge-log-distro-basic-gibba/5977894/orig.config.yaml
2021-03-18T20:35:05.462 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ideepika-2021-03-18_20:03:11-rados:thrash-erasure-code-wip-test-merge-log-distro-basic-gibba/5977894
2021-03-18T20:35:05.463 INFO:teuthology.dispatcher.supervisor:Job PID: 18493
2021-03-18T20:35:05.463 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-18T22:51:15.007 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/report.py", line 498, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/report.py", line 463, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/report.py", line 320, in report_job
    response.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/ideepika-2021-03-18_20:03:11-rados:thrash-erasure-code-wip-test-merge-log-distro-basic-gibba/jobs/5977894/
2021-03-19T08:35:54.782 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-03-19T08:35:54.940 INFO:teuthology.kill:Killing Pids: {18493}
2021-03-19T08:35:56.087 INFO:teuthology.kill:Nuking machines: ['gibba031', 'gibba045']
2021-03-19T08:35:57.030 INFO:teuthology.kill:2021-03-19 08:35:57,029.029 INFO:teuthology.nuke:targets:
2021-03-19T08:35:57.030 INFO:teuthology.kill:  gibba031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ehGlV981SfVJjRk/U0KP2GRWLPMeodsV9U4m9tpFIvymCADHXwj46j9SVPtUW+gFA5wsiY4E5gKp95jHs7OjLpQK/magHgp0hJJ2Sa/ty0qQV9rJRWHbI8gsprGDxK+vNRa7OkAd6wisEZPX+QACyEwT0W2UwTnMhBzNaIGSL4odYhC6gJm19Sq2Vih7aBUap4WOeYwyiA8F9ii0aqfdjU7J/HHJQSWWERInxb7DLMCNdz5Mkrw8r/7BH1qOZ2G2VwM7brQlClNpiygfFamrEX+9NY28+bcR7c3Qy2tF1RALrnKlxAnrwROiqOGaDzbmdVjv3vOSCk6Kv/Ui6kAz
2021-03-19T08:35:57.030 INFO:teuthology.kill:  gibba045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrAfCJZS1FDbxPIx7jt/v8Wtj5yia8kp2I46cpxTsR9C/0VOG69Adq5V+TTcYkJJW/jNrjSnBi/st/1hZJIhxjHjYL7NpwZMiT8nwN+ygHrQIS/qCG/hPHVYet0ZuMXOiQurGeJY4A/oJgzM3vp/uvfRD1TmesO66qfJuS1bKLNP9dvCR174HQLovWQ3t1rhIV8LxqPiK7nv22iIkWR5+/YoWSCYlD2Zkx6FobG08k/INpQTyxn6CY13e9W+O3aFrznsUBAyxLat57kiBH+6SLXmxZXnS8xG95NA/PcaXPYV5evpDmLk/usLBwqRhK5C3PYUPXooGA3JZAvWXl4ft/
2021-03-19T08:35:57.030 INFO:teuthology.kill:2021-03-19 08:35:57,030.030 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-19T08:35:57.032 INFO:teuthology.kill:2021-03-19 08:35:57,032.032 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-19T08:35:57.095 INFO:teuthology.kill:2021-03-19 08:35:57,094.094 INFO:teuthology.orchestra.console:Power off gibba045
2021-03-19T08:35:57.108 INFO:teuthology.kill:2021-03-19 08:35:57,108.108 INFO:teuthology.orchestra.console:Power off gibba031
2021-03-19T08:36:05.475 INFO:teuthology.kill:2021-03-19 08:36:05,474.474 INFO:teuthology.orchestra.console:Power off for gibba045 completed
2021-03-19T08:36:09.591 INFO:teuthology.kill:2021-03-19 08:36:09,591.591 INFO:teuthology.orchestra.console:Power off for gibba031 completed
2021-03-19T08:36:09.834 INFO:teuthology.task.internal:roles: ubuntu@gibba031.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-03-19T08:36:09.834 INFO:teuthology.task.internal:roles: ubuntu@gibba045.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-03-19T08:36:09.835 INFO:teuthology.misc:Compressing logs...
2021-03-19T08:36:09.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-19T08:37:09.895 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-03-19T08:37:09.957 INFO:teuthology.kill:No teuthology processes running
2021-03-19T08:37:11.068 INFO:teuthology.kill:Nuking machines: ['gibba031', 'gibba045']
2021-03-19T08:37:12.057 INFO:teuthology.kill:2021-03-19 08:37:12,056.056 INFO:teuthology.nuke:targets:
2021-03-19T08:37:12.057 INFO:teuthology.kill:  gibba031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ehGlV981SfVJjRk/U0KP2GRWLPMeodsV9U4m9tpFIvymCADHXwj46j9SVPtUW+gFA5wsiY4E5gKp95jHs7OjLpQK/magHgp0hJJ2Sa/ty0qQV9rJRWHbI8gsprGDxK+vNRa7OkAd6wisEZPX+QACyEwT0W2UwTnMhBzNaIGSL4odYhC6gJm19Sq2Vih7aBUap4WOeYwyiA8F9ii0aqfdjU7J/HHJQSWWERInxb7DLMCNdz5Mkrw8r/7BH1qOZ2G2VwM7brQlClNpiygfFamrEX+9NY28+bcR7c3Qy2tF1RALrnKlxAnrwROiqOGaDzbmdVjv3vOSCk6Kv/Ui6kAz
2021-03-19T08:37:12.057 INFO:teuthology.kill:  gibba045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrAfCJZS1FDbxPIx7jt/v8Wtj5yia8kp2I46cpxTsR9C/0VOG69Adq5V+TTcYkJJW/jNrjSnBi/st/1hZJIhxjHjYL7NpwZMiT8nwN+ygHrQIS/qCG/hPHVYet0ZuMXOiQurGeJY4A/oJgzM3vp/uvfRD1TmesO66qfJuS1bKLNP9dvCR174HQLovWQ3t1rhIV8LxqPiK7nv22iIkWR5+/YoWSCYlD2Zkx6FobG08k/INpQTyxn6CY13e9W+O3aFrznsUBAyxLat57kiBH+6SLXmxZXnS8xG95NA/PcaXPYV5evpDmLk/usLBwqRhK5C3PYUPXooGA3JZAvWXl4ft/
2021-03-19T08:37:12.081 INFO:teuthology.kill:2021-03-19 08:37:12,080.080 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-19T08:37:12.084 INFO:teuthology.kill:2021-03-19 08:37:12,084.084 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-19T08:37:12.144 INFO:teuthology.kill:2021-03-19 08:37:12,144.144 INFO:teuthology.orchestra.console:Power off gibba045
2021-03-19T08:37:12.160 INFO:teuthology.kill:2021-03-19 08:37:12,160.160 INFO:teuthology.orchestra.console:Power off gibba031
2021-03-19T08:37:12.295 INFO:teuthology.kill:2021-03-19 08:37:12,295.295 INFO:teuthology.orchestra.console:Power off for gibba045 completed
2021-03-19T08:37:12.308 INFO:teuthology.kill:2021-03-19 08:37:12,307.307 INFO:teuthology.orchestra.console:Power off for gibba031 completed
2021-03-19T08:37:12.439 INFO:teuthology.kill:2021-03-19 08:37:12,438.438 INFO:teuthology.lock.ops:unlocked gibba045.front.sepia.ceph.com
2021-03-19T08:37:12.447 INFO:teuthology.kill:2021-03-19 08:37:12,447.447 INFO:teuthology.lock.ops:unlocked gibba031.front.sepia.ceph.com
2021-03-19T08:39:12.736 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-19T08:39:12.833 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-19T08:39:12.833 INFO:teuthology.nuke:Checking targets against current locks
2021-03-19T08:39:12.917 INFO:teuthology.nuke:Not nuking gibba045.front.sepia.ceph.com because description doesn't match
2021-03-19T08:39:12.917 INFO:teuthology.nuke:Not nuking gibba031.front.sepia.ceph.com because description doesn't match