2021-10-05T04:12:58.598 INFO:root:teuthology version: 1.1.0-f08b273e
2021-10-05T04:12:58.801 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba029.front.sepia.ceph.com' reimaging
2021-10-05T04:12:58.802 INFO:teuthology.lock.ops:Updating [ubuntu@gibba029.front.sepia.ceph.com]: reset os type and version on server
2021-10-05T04:12:58.803 INFO:teuthology.lock.ops:Updating gibba029.front.sepia.ceph.com on lock server
2021-10-05T04:12:58.820 INFO:teuthology.lock.ops:Node 'ubuntu@gibba029.front.sepia.ceph.com' reimaging is complete
2021-10-05T04:12:58.820 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba038.front.sepia.ceph.com' reimaging
2021-10-05T04:12:58.821 INFO:teuthology.lock.ops:Updating [ubuntu@gibba038.front.sepia.ceph.com]: reset os type and version on server
2021-10-05T04:12:58.821 INFO:teuthology.lock.ops:Updating gibba038.front.sepia.ceph.com on lock server
2021-10-05T04:12:58.839 INFO:teuthology.lock.ops:Node 'ubuntu@gibba038.front.sepia.ceph.com' reimaging is complete
2021-10-05T04:12:58.839 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba042.front.sepia.ceph.com' reimaging
2021-10-05T04:12:58.840 INFO:teuthology.lock.ops:Updating [ubuntu@gibba042.front.sepia.ceph.com]: reset os type and version on server
2021-10-05T04:12:58.840 INFO:teuthology.lock.ops:Updating gibba042.front.sepia.ceph.com on lock server
2021-10-05T04:12:58.858 INFO:teuthology.lock.ops:Node 'ubuntu@gibba042.front.sepia.ceph.com' reimaging is complete
2021-10-05T04:12:59.026 INFO:teuthology.provision.fog.gibba029:Scheduling deploy of ubuntu 18.04
2021-10-05T04:12:59.052 INFO:teuthology.provision.fog.gibba038:Scheduling deploy of ubuntu 18.04
2021-10-05T04:12:59.065 INFO:teuthology.provision.fog.gibba042:Scheduling deploy of ubuntu 18.04
2021-10-05T04:12:59.409 INFO:teuthology.orchestra.console:Power off gibba029
2021-10-05T04:12:59.441 INFO:teuthology.orchestra.console:Power off gibba038
2021-10-05T04:12:59.456 INFO:teuthology.orchestra.console:Power off gibba042
2021-10-05T04:13:07.812 INFO:teuthology.orchestra.console:Power off for gibba029 completed
2021-10-05T04:13:07.819 INFO:teuthology.orchestra.console:Power off for gibba038 completed
2021-10-05T04:13:07.826 INFO:teuthology.orchestra.console:Power off for gibba042 completed
2021-10-05T04:13:07.913 INFO:teuthology.orchestra.console:Power on gibba029
2021-10-05T04:13:07.921 INFO:teuthology.orchestra.console:Power on gibba038
2021-10-05T04:13:07.927 INFO:teuthology.orchestra.console:Power on gibba042
2021-10-05T04:13:16.294 INFO:teuthology.orchestra.console:Power on for gibba029 completed
2021-10-05T04:13:16.302 INFO:teuthology.orchestra.console:Power on for gibba038 completed
2021-10-05T04:13:16.322 INFO:teuthology.orchestra.console:Power on for gibba042 completed
2021-10-05T04:13:16.395 INFO:teuthology.provision.fog.gibba029:Waiting for deploy to finish
2021-10-05T04:13:16.404 INFO:teuthology.provision.fog.gibba038:Waiting for deploy to finish
2021-10-05T04:13:16.423 INFO:teuthology.provision.fog.gibba042:Waiting for deploy to finish
2021-10-05T04:17:37.869 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-10-05T04:17:43.880 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-10-05T04:17:49.894 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-10-05T04:17:50.898 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-10-05T04:17:56.981 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-10-05T04:17:57.191 INFO:teuthology.provision.fog.gibba038:Node is ready
2021-10-05T04:17:57.240 INFO:teuthology.orchestra.run.gibba038.stdout:gibba038.front.sepia.ceph.com
2021-10-05T04:17:57.288 INFO:teuthology.orchestra.run.gibba038.stdout:172.21.2.138 gibba038.front.sepia.ceph.com gibba038
2021-10-05T04:17:57.545 INFO:teuthology.provision.fog.gibba038:Deploy complete!
2021-10-05T04:18:01.991 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-10-05T04:18:02.245 INFO:teuthology.provision.fog.gibba029:Node is ready
2021-10-05T04:18:02.293 INFO:teuthology.orchestra.run.gibba029.stdout:gibba029.front.sepia.ceph.com
2021-10-05T04:18:02.346 INFO:teuthology.orchestra.run.gibba029.stdout:172.21.2.129 gibba029.front.sepia.ceph.com gibba029
2021-10-05T04:18:02.590 INFO:teuthology.provision.fog.gibba029:Deploy complete!
2021-10-05T04:18:06.446 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-10-05T04:18:06.773 INFO:teuthology.provision.fog.gibba042:Node is ready
2021-10-05T04:18:06.820 INFO:teuthology.orchestra.run.gibba042.stdout:gibba042.front.sepia.ceph.com
2021-10-05T04:18:06.868 INFO:teuthology.orchestra.run.gibba042.stdout:172.21.2.142 gibba042.front.sepia.ceph.com gibba042
2021-10-05T04:18:07.126 INFO:teuthology.provision.fog.gibba042:Deploy complete!
2021-10-05T04:18:07.285 INFO:teuthology.lock.ops:Checking gibba029.front.sepia.ceph.com
2021-10-05T04:18:07.286 INFO:teuthology.lock.ops:New key found. Updating...
2021-10-05T04:18:07.305 INFO:teuthology.lock.ops:Checking gibba038.front.sepia.ceph.com
2021-10-05T04:18:07.305 INFO:teuthology.lock.ops:New key found. Updating...
2021-10-05T04:18:07.322 INFO:teuthology.lock.ops:Checking gibba042.front.sepia.ceph.com
2021-10-05T04:18:07.322 INFO:teuthology.lock.ops:New key found. Updating...
2021-10-05T04:18:07.339 INFO:teuthology.lock.ops:Updating [gibba029.front.sepia.ceph.com]: set os type and version on server
2021-10-05T04:18:07.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba029.front.sepia.ceph.com'
2021-10-05T04:18:07.620 INFO:teuthology.orchestra.run.gibba029.stdout:x86_64
2021-10-05T04:18:07.671 INFO:teuthology.orchestra.run.gibba029.stdout:NAME="Ubuntu"
2021-10-05T04:18:07.671 INFO:teuthology.orchestra.run.gibba029.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2021-10-05T04:18:07.672 INFO:teuthology.orchestra.run.gibba029.stdout:ID=ubuntu
2021-10-05T04:18:07.672 INFO:teuthology.orchestra.run.gibba029.stdout:ID_LIKE=debian
2021-10-05T04:18:07.672 INFO:teuthology.orchestra.run.gibba029.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2021-10-05T04:18:07.672 INFO:teuthology.orchestra.run.gibba029.stdout:VERSION_ID="18.04"
2021-10-05T04:18:07.672 INFO:teuthology.orchestra.run.gibba029.stdout:HOME_URL="https://www.ubuntu.com/"
2021-10-05T04:18:07.673 INFO:teuthology.orchestra.run.gibba029.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-10-05T04:18:07.673 INFO:teuthology.orchestra.run.gibba029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-10-05T04:18:07.673 INFO:teuthology.orchestra.run.gibba029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-10-05T04:18:07.673 INFO:teuthology.orchestra.run.gibba029.stdout:VERSION_CODENAME=bionic
2021-10-05T04:18:07.674 INFO:teuthology.orchestra.run.gibba029.stdout:UBUNTU_CODENAME=bionic
2021-10-05T04:18:07.675 INFO:teuthology.lock.ops:Updating gibba029.front.sepia.ceph.com on lock server
2021-10-05T04:18:07.692 INFO:teuthology.lock.ops:Updating [gibba038.front.sepia.ceph.com]: set os type and version on server
2021-10-05T04:18:07.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba038.front.sepia.ceph.com'
2021-10-05T04:18:07.949 INFO:teuthology.orchestra.run.gibba038.stdout:x86_64
2021-10-05T04:18:07.999 INFO:teuthology.orchestra.run.gibba038.stdout:NAME="Ubuntu"
2021-10-05T04:18:08.000 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2021-10-05T04:18:08.000 INFO:teuthology.orchestra.run.gibba038.stdout:ID=ubuntu
2021-10-05T04:18:08.000 INFO:teuthology.orchestra.run.gibba038.stdout:ID_LIKE=debian
2021-10-05T04:18:08.000 INFO:teuthology.orchestra.run.gibba038.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2021-10-05T04:18:08.000 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION_ID="18.04"
2021-10-05T04:18:08.001 INFO:teuthology.orchestra.run.gibba038.stdout:HOME_URL="https://www.ubuntu.com/"
2021-10-05T04:18:08.001 INFO:teuthology.orchestra.run.gibba038.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-10-05T04:18:08.001 INFO:teuthology.orchestra.run.gibba038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-10-05T04:18:08.001 INFO:teuthology.orchestra.run.gibba038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-10-05T04:18:08.002 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION_CODENAME=bionic
2021-10-05T04:18:08.002 INFO:teuthology.orchestra.run.gibba038.stdout:UBUNTU_CODENAME=bionic
2021-10-05T04:18:08.002 INFO:teuthology.lock.ops:Updating gibba038.front.sepia.ceph.com on lock server
2021-10-05T04:18:08.021 INFO:teuthology.lock.ops:Updating [gibba042.front.sepia.ceph.com]: set os type and version on server
2021-10-05T04:18:08.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba042.front.sepia.ceph.com'
2021-10-05T04:18:08.226 INFO:teuthology.orchestra.run.gibba042.stdout:x86_64
2021-10-05T04:18:08.276 INFO:teuthology.orchestra.run.gibba042.stdout:NAME="Ubuntu"
2021-10-05T04:18:08.277 INFO:teuthology.orchestra.run.gibba042.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2021-10-05T04:18:08.277 INFO:teuthology.orchestra.run.gibba042.stdout:ID=ubuntu
2021-10-05T04:18:08.277 INFO:teuthology.orchestra.run.gibba042.stdout:ID_LIKE=debian
2021-10-05T04:18:08.277 INFO:teuthology.orchestra.run.gibba042.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2021-10-05T04:18:08.278 INFO:teuthology.orchestra.run.gibba042.stdout:VERSION_ID="18.04"
2021-10-05T04:18:08.278 INFO:teuthology.orchestra.run.gibba042.stdout:HOME_URL="https://www.ubuntu.com/"
2021-10-05T04:18:08.278 INFO:teuthology.orchestra.run.gibba042.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-10-05T04:18:08.278 INFO:teuthology.orchestra.run.gibba042.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-10-05T04:18:08.279 INFO:teuthology.orchestra.run.gibba042.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-10-05T04:18:08.279 INFO:teuthology.orchestra.run.gibba042.stdout:VERSION_CODENAME=bionic
2021-10-05T04:18:08.279 INFO:teuthology.orchestra.run.gibba042.stdout:UBUNTU_CODENAME=bionic
2021-10-05T04:18:08.279 INFO:teuthology.lock.ops:Updating gibba042.front.sepia.ceph.com on lock server
2021-10-05T04:18:08.480 INFO:teuthology.dispatcher.supervisor:Running job 6416942
2021-10-05T04:18:08.480 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba/6416942 --name teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba --description upgrade:octopus-p2p/octopus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-stupid supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba/6416942/orig.config.yaml
2021-10-05T04:18:08.484 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba/6416942
2021-10-05T04:18:08.484 INFO:teuthology.dispatcher.supervisor:Job PID: 11550
2021-10-05T04:18:08.485 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-10-05T06:10:17.829 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body bgcolor="white">
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.14.0 (Ubuntu)</center>
</body>
</html>

2021-10-05T06:10:18.862 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body bgcolor="white">
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.14.0 (Ubuntu)</center>
</body>
</html>

2021-10-05T06:10:20.000 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body bgcolor="white">
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.14.0 (Ubuntu)</center>
</body>
</html>

2021-10-05T06:10:21.272 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body bgcolor="white">
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.14.0 (Ubuntu)</center>
</body>
</html>

2021-10-05T06:10:22.677 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body bgcolor="white">
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.14.0 (Ubuntu)</center>
</body>
</html>

2021-10-05T06:10:24.215 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body bgcolor="white">
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.14.0 (Ubuntu)</center>
</body>
</html>

2021-10-05T06:10:25.886 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body bgcolor="white">
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.14.0 (Ubuntu)</center>
</body>
</html>

2021-10-05T06:10:27.692 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body bgcolor="white">
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.14.0 (Ubuntu)</center>
</body>
</html>

2021-10-05T06:10:29.629 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body bgcolor="white">
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.14.0 (Ubuntu)</center>
</body>
</html>

2021-10-05T06:10:31.701 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-10-02_01:25:02-upgrade:octopus-p2p-octopus-distro-basic-gibba/jobs/ failed with status 502: <html>
<head><title>502 Bad Gateway</title></head>
<body bgcolor="white">
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.14.0 (Ubuntu)</center>
</body>
</html>

2021-10-05T06:10:31.702 ERROR:teuthology.dispatcher.supervisor:run_with_watchdog had an unhandled exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/dispatcher/supervisor.py", line 136, in run_job
    run_with_watchdog(p, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/dispatcher/supervisor.py", line 243, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/report.py", line 505, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/report.py", line 470, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/report.py", line 298, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/contextutil.py", line 133, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 6416942' reached maximum tries (10) after waiting for 15.993242184008452 seconds
2021-10-05T06:10:31.703 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/scripts/dispatcher.py", line 33, in main
    teuthology.dispatcher.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/dispatcher/supervisor.py", line 59, in main
    verbose
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/dispatcher/supervisor.py", line 136, in run_job
    run_with_watchdog(p, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/dispatcher/supervisor.py", line 243, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/report.py", line 505, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/report.py", line 470, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/report.py", line 298, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f08b273eeec75318a83a4e8d7fb51841e4d71be0/teuthology/contextutil.py", line 133, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 6416942' reached maximum tries (10) after waiting for 15.993242184008452 seconds