2024-01-16T17:35:38.523 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-16T17:35:38.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:35:38.670 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fe32684cf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fe3278b2c10>, signals=[15])
2024-01-16T17:35:38.670 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging
2024-01-16T17:35:38.670 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server
2024-01-16T17:35:38.671 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2024-01-16T17:35:38.692 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging
2024-01-16T17:35:38.693 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server
2024-01-16T17:35:38.693 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2024-01-16T17:35:39.140 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-16T17:35:39.144 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-16T17:35:39.187 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of ubuntu 22.04
2024-01-16T17:35:39.200 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of ubuntu 22.04
2024-01-16T17:35:39.485 INFO:teuthology.orchestra.console.smithi160:Power off
2024-01-16T17:35:39.486 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-16T17:35:39.501 INFO:teuthology.orchestra.console.smithi124:Power off
2024-01-16T17:35:39.502 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-16T17:35:39.512 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off
2024-01-16T17:35:39.512 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:39.526 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2024-01-16T17:35:39.526 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:39.533 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on
2024-01-16T17:35:39.546 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2024-01-16T17:35:43.538 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:43.547 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:43.646 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on
2024-01-16T17:35:43.656 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2024-01-16T17:35:47.654 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:47.665 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:47.767 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off
2024-01-16T17:35:47.774 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2024-01-16T17:35:47.868 INFO:teuthology.orchestra.console.smithi160:Power off completed
2024-01-16T17:35:47.969 INFO:teuthology.orchestra.console.smithi160:Power on
2024-01-16T17:35:47.969 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-16T17:35:47.990 DEBUG:teuthology.orchestra.console.smithi160:power on output: Chassis Power Control: Up/On
2024-01-16T17:35:47.991 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:48.012 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off
2024-01-16T17:35:51.776 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:51.885 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2024-01-16T17:35:51.986 INFO:teuthology.orchestra.console.smithi124:Power off completed
2024-01-16T17:35:52.013 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:52.087 INFO:teuthology.orchestra.console.smithi124:Power on
2024-01-16T17:35:52.088 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-16T17:35:52.119 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On
2024-01-16T17:35:52.119 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:52.127 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off
2024-01-16T17:35:52.139 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2024-01-16T17:35:56.132 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:56.139 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:56.248 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2024-01-16T17:35:56.319 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on
2024-01-16T17:35:56.349 INFO:teuthology.orchestra.console.smithi124:Power on completed
2024-01-16T17:35:56.419 INFO:teuthology.orchestra.console.smithi160:Power on completed
2024-01-16T17:35:56.451 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2024-01-16T17:35:56.520 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish
2024-01-16T17:39:43.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:39:43.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:39:46.652 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-16T17:39:52.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:39:55.741 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-16T17:40:01.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:01.980 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-16T17:40:04.829 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-16T17:40:07.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:10.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:11.036 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-16T17:40:13.885 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-16T17:40:17.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:19.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:20.092 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-16T17:40:22.972 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-16T17:40:26.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:28.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:29.148 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-16T17:40:32.028 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-16T17:40:35.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:38.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:38.204 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-16T17:40:44.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:02.653 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-16T17:41:08.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:11.740 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-16T17:41:17.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:19.806 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-16T17:41:25.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:25.815 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-16T17:41:31.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:31.823 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-16T17:41:37.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:37.830 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-16T17:41:38.035 WARNING:teuthology.provision.fog.smithi124:timed out
2024-01-16T17:41:43.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:43.838 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2024-01-16T17:41:44.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:44.038 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2024-01-16T17:41:49.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:50.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:50.107 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-16T17:41:50.107 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-16T17:41:50.242 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-16T17:41:50.242 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-16T17:41:50.542 INFO:teuthology.provision.fog.smithi160:Node is ready
2024-01-16T17:41:50.542 DEBUG:teuthology.orchestra.run.smithi160:> hostname
2024-01-16T17:41:50.586 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com
2024-01-16T17:41:50.587 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts
2024-01-16T17:41:50.635 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160
2024-01-16T17:41:50.636 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160
2024-01-16T17:41:50.743 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts
2024-01-16T17:41:50.756 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts
2024-01-16T17:41:50.814 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname
2024-01-16T17:41:50.870 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160
2024-01-16T17:41:50.926 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release
2024-01-16T17:41:50.971 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-16T17:41:50.971 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu"
2024-01-16T17:41:50.971 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="22.04"
2024-01-16T17:41:50.971 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-16T17:41:50.971 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=jammy
2024-01-16T17:41:50.971 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu
2024-01-16T17:41:50.971 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian
2024-01-16T17:41:50.971 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-16T17:41:50.971 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-16T17:41:50.971 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-16T17:41:50.971 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-16T17:41:50.972 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=jammy
2024-01-16T17:41:50.972 INFO:teuthology.provision.fog.smithi160:Deploy complete!
2024-01-16T17:41:50.973 DEBUG:teuthology.parallel:result is None
2024-01-16T17:41:51.011 INFO:teuthology.provision.fog.smithi124:Node is ready
2024-01-16T17:41:51.011 DEBUG:teuthology.orchestra.run.smithi124:> hostname
2024-01-16T17:41:51.058 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com
2024-01-16T17:41:51.058 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts
2024-01-16T17:41:51.106 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2024-01-16T17:41:51.106 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2024-01-16T17:41:51.225 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts
2024-01-16T17:41:51.239 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts
2024-01-16T17:41:51.293 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname
2024-01-16T17:41:51.349 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2024-01-16T17:41:51.404 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2024-01-16T17:41:51.450 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-16T17:41:51.450 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Ubuntu"
2024-01-16T17:41:51.450 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="22.04"
2024-01-16T17:41:51.450 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-16T17:41:51.450 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_CODENAME=jammy
2024-01-16T17:41:51.450 INFO:teuthology.orchestra.run.smithi124.stdout:ID=ubuntu
2024-01-16T17:41:51.450 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE=debian
2024-01-16T17:41:51.450 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-16T17:41:51.450 INFO:teuthology.orchestra.run.smithi124.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-16T17:41:51.450 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-16T17:41:51.450 INFO:teuthology.orchestra.run.smithi124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-16T17:41:51.450 INFO:teuthology.orchestra.run.smithi124.stdout:UBUNTU_CODENAME=jammy
2024-01-16T17:41:51.451 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2024-01-16T17:41:51.451 DEBUG:teuthology.parallel:result is None
2024-01-16T17:41:51.628 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2024-01-16T17:41:51.629 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-16T17:41:51.650 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com
2024-01-16T17:41:51.650 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-16T17:41:51.668 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2024-01-16T17:41:51.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2024-01-16T17:41:51.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:51.745 DEBUG:teuthology.orchestra.run.smithi124:> true
2024-01-16T17:41:51.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com'
2024-01-16T17:41:51.840 DEBUG:teuthology.orchestra.run.smithi124:> uname -m
2024-01-16T17:41:51.885 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2024-01-16T17:41:51.886 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2024-01-16T17:41:51.937 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-16T17:41:51.938 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Ubuntu"
2024-01-16T17:41:51.938 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="22.04"
2024-01-16T17:41:51.938 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-16T17:41:51.938 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_CODENAME=jammy
2024-01-16T17:41:51.938 INFO:teuthology.orchestra.run.smithi124.stdout:ID=ubuntu
2024-01-16T17:41:51.938 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE=debian
2024-01-16T17:41:51.938 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-16T17:41:51.938 INFO:teuthology.orchestra.run.smithi124.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-16T17:41:51.938 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-16T17:41:51.938 INFO:teuthology.orchestra.run.smithi124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-16T17:41:51.938 INFO:teuthology.orchestra.run.smithi124.stdout:UBUNTU_CODENAME=jammy
2024-01-16T17:41:51.938 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2024-01-16T17:41:51.959 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server
2024-01-16T17:41:51.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com'
2024-01-16T17:41:51.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:52.035 DEBUG:teuthology.orchestra.run.smithi160:> true
2024-01-16T17:41:52.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com'
2024-01-16T17:41:52.144 DEBUG:teuthology.orchestra.run.smithi160:> uname -m
2024-01-16T17:41:52.190 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64
2024-01-16T17:41:52.191 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release
2024-01-16T17:41:52.238 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-16T17:41:52.238 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu"
2024-01-16T17:41:52.238 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="22.04"
2024-01-16T17:41:52.238 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-16T17:41:52.238 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=jammy
2024-01-16T17:41:52.239 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu
2024-01-16T17:41:52.239 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian
2024-01-16T17:41:52.239 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-16T17:41:52.239 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-16T17:41:52.239 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-16T17:41:52.239 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-16T17:41:52.239 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=jammy
2024-01-16T17:41:52.239 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2024-01-16T17:41:52.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:41:52.342 INFO:teuthology.dispatcher.supervisor:Running job 7518297
2024-01-16T17:41:52.342 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_rraja@teuthology --archive /home/teuthworker/archive/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/7518297 --name rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi --description rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-nbd} -- /home/teuthworker/archive/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/7518297/orig.config.yaml
2024-01-16T17:41:52.345 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/7518297
2024-01-16T17:41:52.345 INFO:teuthology.dispatcher.supervisor:Job PID: 3081399
2024-01-16T17:41:52.345 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-16T17:43:52.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:45:52.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:47:52.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:49:52.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:51:53.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:53:53.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:55:53.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:57:53.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:59:53.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:01:53.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:03:54.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:05:54.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:07:54.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:09:54.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:11:54.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:13:54.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:15:55.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:17:55.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:19:55.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:21:55.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:23:55.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:25:55.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:27:56.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:29:56.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:31:56.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:33:56.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:35:56.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:37:56.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:39:56.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:41:57.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:43:57.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:45:57.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:47:57.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:49:57.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:51:57.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:53:58.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:55:58.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:57:58.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:59:58.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:01:58.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:03:58.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:05:58.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:07:59.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:09:59.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:11:59.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:13:59.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:15:59.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:17:59.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:19:59.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:22:00.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:24:00.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:26:00.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:28:00.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:30:00.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:32:00.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:34:01.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:36:01.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:38:01.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:40:01.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:42:01.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:44:01.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:46:01.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:46:01.947 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:46:03.202 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:46:04.663 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:46:06.327 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:46:08.239 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:46:10.304 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:46:12.567 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:46:15.028 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:46:17.698 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:46:20.566 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:46:20.566 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 19.028273705954632 seconds
2024-01-16T19:48:20.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:48:20.716 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:21.948 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:23.333 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:24.889 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:26.595 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:28.471 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:30.508 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:32.716 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:35.078 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:37.597 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:37.597 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 17.292220464774545 seconds
2024-01-16T19:50:37.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:50:37.702 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:38.916 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:40.279 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:41.795 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:43.458 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:45.278 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:47.260 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:49.392 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:51.671 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:54.103 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:54.103 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 16.83592139217749 seconds
2024-01-16T19:52:54.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:52:54.275 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:52:56.209 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:52:59.029 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:02.666 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:07.180 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:12.543 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:18.772 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:25.852 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:33.785 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:42.588 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:42.588 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 48.66025676537188 seconds
2024-01-16T19:55:42.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:55:42.765 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:55:44.686 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:55:47.450 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:55:51.067 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:55:55.525 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:00.835 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:06.988 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:13.990 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:21.840 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:30.547 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:30.547 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 48.1768184072844 seconds
2024-01-16T19:58:30.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:58:30.725 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:58:32.459 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:58:34.882 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:58:37.971 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:58:41.740 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:58:46.193 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:58:51.318 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:58:57.113 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:59:03.588 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:59:10.744 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:59:10.745 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 40.44808110354527 seconds
2024-01-16T20:01:10.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:01:10.864 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:11.981 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:13.164 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:14.406 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:15.706 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:17.066 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:18.488 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:19.976 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:21.529 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:23.149 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:23.149 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 12.751840475206887 seconds
2024-01-16T20:03:23.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:03:23.321 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:03:25.355 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:03:28.339 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:03:32.294 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:03:37.208 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:03:43.087 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:03:49.935 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:03:57.745 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:04:06.519 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:04:16.248 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:04:16.248 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 53.346377765726736 seconds
2024-01-16T20:06:16.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:06:16.406 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:06:17.771 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:06:19.419 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:06:21.367 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:06:23.603 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:06:26.116 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:06:28.927 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:06:32.023 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:06:35.418 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:06:39.095 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:06:39.096 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 23.07467485316225 seconds
2024-01-16T20:08:39.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:08:39.278 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:08:40.765 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:08:42.697 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:08:45.047 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:08:47.830 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:08:51.036 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:08:54.681 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:08:58.753 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:09:03.254 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:09:08.183 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:09:08.183 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 29.353597438046236 seconds
2024-01-16T20:11:08.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:11:08.363 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:11:10.181 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:11:12.763 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:11:16.098 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:11:20.195 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:11:25.061 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:11:30.675 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:11:37.036 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:11:44.159 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:11:52.043 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:11:52.043 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 44.066317406280156 seconds
2024-01-16T20:13:52.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:13:52.217 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:13:53.385 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:13:54.673 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:13:56.070 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:13:57.576 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:13:59.182 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:14:01.061 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:14:02.892 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:14:04.824 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:14:06.884 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:14:06.885 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 14.917755907543908 seconds
2024-01-16T20:16:06.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:16:07.078 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:16:09.023 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:16:11.871 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:16:15.610 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:16:20.240 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:16:25.754 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:16:32.161 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:16:39.499 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:16:47.698 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:16:56.790 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:16:56.790 ERROR:teuthology.dispatcher.supervisor:run_with_watchdog had an unhandled exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 162, in run_job
    run_with_watchdog(p, job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 357, in run_with_watchdog
    report.try_push_job_info(job_info, extra_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 50.08561734452323 seconds
2024-01-16T20:16:56.791 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 68, in main
    return run_job(
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 162, in run_job
    run_with_watchdog(p, job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 357, in run_with_watchdog
    report.try_push_job_info(job_info, extra_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518297' reached maximum tries (11) after waiting for 50.08561734452323 seconds