2024-01-16T17:35:52.371 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-16T17:35:52.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:35:52.508 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1258328f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f125938ec10>, signals=[15])
2024-01-16T17:35:52.509 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging
2024-01-16T17:35:52.509 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server
2024-01-16T17:35:52.509 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-01-16T17:35:52.533 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging
2024-01-16T17:35:52.534 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server
2024-01-16T17:35:52.534 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-01-16T17:35:52.634 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-16T17:35:52.642 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-16T17:35:52.680 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of ubuntu 22.04
2024-01-16T17:35:52.683 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of ubuntu 22.04
2024-01-16T17:35:52.972 INFO:teuthology.orchestra.console.smithi149:Power off
2024-01-16T17:35:52.972 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-16T17:35:52.987 INFO:teuthology.orchestra.console.smithi153:Power off
2024-01-16T17:35:52.987 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-16T17:35:52.997 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off
2024-01-16T17:35:52.997 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:53.006 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2024-01-16T17:35:53.007 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:53.019 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-01-16T17:35:53.028 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-16T17:35:53.129 INFO:teuthology.orchestra.console.smithi153:Power off completed
2024-01-16T17:35:53.229 INFO:teuthology.orchestra.console.smithi153:Power on
2024-01-16T17:35:53.229 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-16T17:35:53.248 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On
2024-01-16T17:35:53.248 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:53.269 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-16T17:35:57.020 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:57.129 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-01-16T17:35:57.270 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:35:57.381 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-01-16T17:36:01.133 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:36:01.241 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-01-16T17:36:01.342 INFO:teuthology.orchestra.console.smithi149:Power off completed
2024-01-16T17:36:01.382 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:36:01.442 INFO:teuthology.orchestra.console.smithi149:Power on
2024-01-16T17:36:01.443 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-16T17:36:01.462 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On
2024-01-16T17:36:01.462 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:36:01.483 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-01-16T17:36:01.490 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-01-16T17:36:01.591 INFO:teuthology.orchestra.console.smithi153:Power on completed
2024-01-16T17:36:01.691 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2024-01-16T17:36:05.488 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:36:05.596 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-01-16T17:36:09.600 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T17:36:09.709 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-01-16T17:36:09.809 INFO:teuthology.orchestra.console.smithi149:Power on completed
2024-01-16T17:36:09.910 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish
2024-01-16T17:39:48.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:07.101 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-16T17:40:13.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:16.156 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-16T17:40:22.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:25.244 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-16T17:40:31.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:34.304 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-16T17:40:40.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:43.388 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-16T17:40:49.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:40:52.477 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-16T17:40:58.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:12.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:12.582 ERROR:teuthology.orchestra.connection:Error authenticating with smithi149.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-16T17:41:16.988 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-16T17:41:22.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:26.044 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-16T17:41:32.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:33.052 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-16T17:41:39.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:39.056 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-16T17:41:45.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:45.059 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-16T17:41:51.036 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-01-16T17:41:51.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:51.061 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-01-16T17:41:57.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:57.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:41:57.314 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-16T17:41:57.315 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-16T17:41:57.774 INFO:teuthology.provision.fog.smithi153:Node is ready
2024-01-16T17:41:57.774 DEBUG:teuthology.orchestra.run.smithi153:> hostname
2024-01-16T17:41:57.820 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com
2024-01-16T17:41:57.820 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts
2024-01-16T17:41:57.868 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2024-01-16T17:41:57.869 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-01-16T17:41:58.005 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts
2024-01-16T17:41:58.020 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts
2024-01-16T17:41:58.076 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname
2024-01-16T17:41:58.133 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-01-16T17:41:58.188 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-01-16T17:41:58.236 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-16T17:41:58.236 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu"
2024-01-16T17:41:58.236 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04"
2024-01-16T17:41:58.237 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-16T17:41:58.237 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy
2024-01-16T17:41:58.237 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu
2024-01-16T17:41:58.237 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian
2024-01-16T17:41:58.237 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-16T17:41:58.237 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-16T17:41:58.237 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-16T17:41:58.237 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-16T17:41:58.237 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy
2024-01-16T17:41:58.238 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2024-01-16T17:41:58.240 DEBUG:teuthology.parallel:result is None
2024-01-16T17:42:00.096 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-01-16T17:42:06.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:42:09.148 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-01-16T17:42:15.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:42:18.204 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-01-16T17:42:24.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:42:55.804 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-01-16T17:43:01.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:43:01.807 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-01-16T17:43:07.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:43:07.810 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-01-16T17:43:13.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:43:13.813 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-01-16T17:43:19.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:43:20.094 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-16T17:43:20.094 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-16T17:43:20.531 INFO:teuthology.provision.fog.smithi149:Node is ready
2024-01-16T17:43:20.531 DEBUG:teuthology.orchestra.run.smithi149:> hostname
2024-01-16T17:43:20.577 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com
2024-01-16T17:43:20.577 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts
2024-01-16T17:43:20.625 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149
2024-01-16T17:43:20.626 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-01-16T17:43:20.759 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts
2024-01-16T17:43:20.774 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts
2024-01-16T17:43:20.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname
2024-01-16T17:43:20.885 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-01-16T17:43:20.940 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-01-16T17:43:20.985 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-16T17:43:20.986 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu"
2024-01-16T17:43:20.986 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="22.04"
2024-01-16T17:43:20.986 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-16T17:43:20.986 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=jammy
2024-01-16T17:43:20.986 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu
2024-01-16T17:43:20.986 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian
2024-01-16T17:43:20.986 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-16T17:43:20.986 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-16T17:43:20.986 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-16T17:43:20.986 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-16T17:43:20.986 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=jammy
2024-01-16T17:43:20.986 INFO:teuthology.provision.fog.smithi149:Deploy complete!
2024-01-16T17:43:20.987 DEBUG:teuthology.parallel:result is None
2024-01-16T17:43:21.161 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com
2024-01-16T17:43:21.162 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-16T17:43:21.188 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2024-01-16T17:43:21.188 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-16T17:43:21.205 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server
2024-01-16T17:43:21.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-01-16T17:43:21.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:43:21.280 DEBUG:teuthology.orchestra.run.smithi149:> true
2024-01-16T17:43:21.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-01-16T17:43:21.388 DEBUG:teuthology.orchestra.run.smithi149:> uname -m
2024-01-16T17:43:21.433 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64
2024-01-16T17:43:21.433 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-01-16T17:43:21.485 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-16T17:43:21.485 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu"
2024-01-16T17:43:21.485 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="22.04"
2024-01-16T17:43:21.485 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-16T17:43:21.485 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=jammy
2024-01-16T17:43:21.485 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu
2024-01-16T17:43:21.485 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian
2024-01-16T17:43:21.485 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-16T17:43:21.485 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-16T17:43:21.486 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-16T17:43:21.486 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-16T17:43:21.486 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=jammy
2024-01-16T17:43:21.486 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-01-16T17:43:21.505 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2024-01-16T17:43:21.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-01-16T17:43:21.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T17:43:21.586 DEBUG:teuthology.orchestra.run.smithi153:> true
2024-01-16T17:43:21.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-01-16T17:43:21.816 DEBUG:teuthology.orchestra.run.smithi153:> uname -m
2024-01-16T17:43:21.864 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2024-01-16T17:43:21.864 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-01-16T17:43:21.912 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-16T17:43:21.912 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu"
2024-01-16T17:43:21.912 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04"
2024-01-16T17:43:21.912 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-16T17:43:21.912 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy
2024-01-16T17:43:21.912 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu
2024-01-16T17:43:21.912 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian
2024-01-16T17:43:21.912 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-16T17:43:21.913 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-16T17:43:21.913 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-16T17:43:21.913 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-16T17:43:21.913 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy
2024-01-16T17:43:21.913 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-01-16T17:43:21.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:43:22.031 INFO:teuthology.dispatcher.supervisor:Running job 7518307
2024-01-16T17:43:22.031 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_rraja@teuthology --archive /home/teuthworker/archive/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/7518307 --name rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi --description rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-nbd} -- /home/teuthworker/archive/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/7518307/orig.config.yaml
2024-01-16T17:43:22.034 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/7518307
2024-01-16T17:43:22.034 INFO:teuthology.dispatcher.supervisor:Job PID: 3082916
2024-01-16T17:43:22.034 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-16T17:45:22.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:47:22.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:49:22.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:51:22.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:53:22.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:55:22.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:57:22.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T17:59:22.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:01:22.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:03:22.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:05:22.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:07:22.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:09:22.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:11:22.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:13:23.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:15:23.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:17:23.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:19:23.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:21:23.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:23:23.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:25:23.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:27:23.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:29:23.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:31:23.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:33:23.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:35:23.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:37:23.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:39:23.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:41:23.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:43:24.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:45:24.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:47:24.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:49:24.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:51:24.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:53:24.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:55:24.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:57:24.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T18:59:24.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:01:24.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:03:24.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:05:24.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:07:24.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:09:24.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:11:24.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:13:25.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:15:25.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:17:25.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:19:25.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:21:25.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:23:25.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:25:25.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:27:25.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:29:25.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:31:25.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:33:25.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:35:25.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:37:25.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:39:25.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:41:26.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:43:26.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:45:26.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:45:26.264 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:45:27.778 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:45:29.736 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:45:32.120 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:45:34.954 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:45:38.215 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:45:41.925 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:45:46.062 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:45:50.648 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:45:55.667 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:45:55.668 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 29.789446172462878 seconds
2024-01-16T19:47:55.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:47:55.745 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:47:57.683 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:00.473 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:04.135 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:08.660 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:14.049 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:20.299 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:27.407 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:35.377 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:44.221 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:48:44.221 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 48.86630233197657 seconds
2024-01-16T19:50:44.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:50:44.287 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:46.207 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:48.982 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:52.609 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:50:57.095 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:51:02.429 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:51:08.628 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:51:15.689 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:51:23.595 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:51:32.351 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:51:32.352 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 48.47916519734549 seconds
2024-01-16T19:53:32.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:53:32.462 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:34.372 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:37.144 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:40.781 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:45.274 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:50.611 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:53:56.808 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:54:03.863 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:54:11.770 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:54:20.533 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:54:20.534 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 48.51319319609083 seconds
2024-01-16T19:56:20.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:56:20.622 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:22.265 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:24.487 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:27.296 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:30.686 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:34.657 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:39.212 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:44.356 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:50.082 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:56.389 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:56:56.390 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 36.220462222478325 seconds
2024-01-16T19:58:56.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T19:58:56.465 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:58:58.152 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:59:00.461 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:59:03.445 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:59:07.014 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:59:11.207 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:59:16.045 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:59:21.498 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:59:27.584 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:59:34.303 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T19:59:34.303 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 38.277247057290595 seconds
2024-01-16T20:01:34.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:01:34.376 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:36.286 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:39.049 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:42.666 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:47.138 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:52.474 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:01:58.665 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:02:05.707 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:02:13.610 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:02:22.367 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:02:22.367 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 48.46994841295409 seconds
2024-01-16T20:04:22.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:04:22.445 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:04:24.210 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:04:26.685 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:04:29.872 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:04:33.765 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:04:38.371 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:04:43.682 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:04:49.707 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:04:56.437 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:05:03.868 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:05:03.869 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 41.89854808681667 seconds
2024-01-16T20:07:03.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:07:03.947 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:07:05.158 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:07:06.510 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:07:08.000 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:07:09.639 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:07:11.424 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:07:13.358 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:07:15.432 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:07:17.647 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:07:20.012 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:07:20.012 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 16.51581402572838 seconds
2024-01-16T20:09:20.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:09:20.088 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:09:22.082 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:09:25.003 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:09:28.862 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:09:33.647 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:09:39.365 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:09:46.016 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:09:53.601 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:10:02.120 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:10:11.582 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:10:11.582 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 51.947459614272816 seconds
2024-01-16T20:12:11.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:12:11.667 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:12:13.717 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:12:16.756 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:12:20.767 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:12:25.762 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:12:31.741 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:12:38.715 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:12:46.667 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:12:55.597 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:13:05.520 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:13:05.520 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 54.31372095756407 seconds
2024-01-16T20:15:05.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:15:05.602 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:15:06.731 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:15:07.933 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:15:09.211 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:15:10.568 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:15:11.999 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:15:13.494 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:15:15.074 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:15:16.717 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:15:18.438 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:15:18.438 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 13.2928360246148 seconds
2024-01-16T20:17:18.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:17:18.521 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:17:19.801 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:17:21.302 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:17:23.025 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:17:24.959 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:17:27.107 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:17:29.483 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:17:32.076 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:17:34.891 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:17:37.922 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:17:37.922 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 19.851929425597344 seconds
2024-01-16T20:19:37.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:19:37.995 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:19:39.596 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:19:41.744 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:19:44.429 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:19:47.663 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:19:51.446 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:19:55.772 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:20:00.635 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:20:06.052 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:20:12.007 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:20:12.007 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 34.49814439135975 seconds
2024-01-16T20:22:12.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:22:12.115 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:22:14.067 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:22:16.911 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:22:20.633 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:22:25.245 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:22:30.748 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:22:37.137 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:22:44.408 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:22:52.571 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:23:01.632 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:23:01.632 ERROR:teuthology.dispatcher.supervisor:Failed to report job status; ignoring
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 340, in run_with_watchdog
    report.try_push_job_info(job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 49.92877247574087 seconds
2024-01-16T20:25:01.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T20:25:01.712 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:25:03.577 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:25:06.248 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:25:09.723 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:25:14.022 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:25:19.118 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:25:25.021 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:25:31.734 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:25:39.257 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:25:47.583 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/rraja-2024-01-16_17:34:50-rbd:mirror-main-distro-default-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2024-01-16T20:25:47.583 ERROR:teuthology.dispatcher.supervisor:run_with_watchdog had an unhandled exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 162, in run_job
    run_with_watchdog(p, job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 357, in run_with_watchdog
    report.try_push_job_info(job_info, extra_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 46.33978590399792 seconds
2024-01-16T20:25:47.584 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 68, in main
    return run_job(
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 162, in run_job
    run_with_watchdog(p, job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/dispatcher/supervisor.py", line 357, in run_with_watchdog
    report.try_push_job_info(job_info, extra_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 512, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 474, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/report.py", line 299, in report_job
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'report job 7518307' reached maximum tries (11) after waiting for 46.33978590399792 seconds