2023-07-14T19:06:32.909 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e 2023-07-14T19:06:32.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:06:32.911 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:06:33.072 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f02ad7958b0>, signals=[15]) 2023-07-14T19:06:33.073 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2023-07-14T19:06:33.074 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T19:06:33.074 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-07-14T19:06:33.100 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2023-07-14T19:06:33.101 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T19:06:33.101 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-07-14T19:06:33.103 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /host {"name": "smithi115"} 2023-07-14T19:06:33.124 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"} 2023-07-14T19:06:33.181 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-14T19:06:33.193 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-14T19:06:33.220 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-14T19:06:33.221 DEBUG:teuthology.provision.fog.smithi115:FOG request: PUT /host/220 {"imageID": 6} 2023-07-14T19:06:33.234 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-14T19:06:33.234 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 6} 2023-07-14T19:06:33.265 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of ubuntu 22.04 2023-07-14T19:06:33.265 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-14T19:06:33.277 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of ubuntu 22.04 2023-07-14T19:06:33.278 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-14T19:06:33.339 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T19:06:33.349 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T19:06:33.376 DEBUG:teuthology.provision.fog.smithi115:FOG request: POST /host/220/task {"taskTypeID": 1} 2023-07-14T19:06:33.383 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1} 2023-07-14T19:06:33.433 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-14T19:06:33.436 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-14T19:06:33.559 INFO:teuthology.orchestra.console:Power off smithi151 2023-07-14T19:06:33.560 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T19:06:33.576 INFO:teuthology.orchestra.console:Power off smithi115 2023-07-14T19:06:33.576 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T19:06:38.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:06:38.601 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:06:42.628 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:06:43.601 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:06:43.813 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2023-07-14T19:06:43.914 INFO:teuthology.orchestra.console:Power on smithi151 2023-07-14T19:06:43.915 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T19:06:43.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:06:47.739 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:06:47.951 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2023-07-14T19:06:47.960 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:06:48.052 INFO:teuthology.orchestra.console:Power on smithi115 2023-07-14T19:06:48.053 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T19:06:48.075 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:06:52.076 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:06:52.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:06:57.189 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:06:57.210 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:07:02.301 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:07:02.321 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:07:02.534 INFO:teuthology.orchestra.console:Power on for smithi115 completed 2023-07-14T19:07:02.635 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2023-07-14T19:07:02.636 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-14T19:07:10.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T19:07:10.646 INFO:teuthology.orchestra.console:Power on for smithi151 completed 2023-07-14T19:07:10.747 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2023-07-14T19:07:10.748 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-14T19:07:22.998 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-14T19:07:38.169 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-14T19:07:38.170 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-14T19:07:53.266 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-14T19:07:58.275 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-14T19:08:18.360 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-14T19:08:18.361 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-14T19:08:43.458 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-14T19:08:43.459 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-14T19:09:08.108 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-14T19:09:13.113 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-14T19:09:29.652 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-14T19:09:34.657 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-14T19:09:54.736 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-14T19:09:54.737 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-14T19:10:04.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:10:09.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:10:14.857 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-14T19:10:17.936 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-14T19:10:20.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:10:25.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:10:30.872 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-14T19:10:33.936 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-14T19:10:36.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:10:41.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:10:46.887 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-14T19:10:49.936 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-14T19:10:52.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:10:55.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:10:55.952 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-14T19:10:58.992 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-14T19:11:01.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:11:04.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:11:05.008 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-14T19:11:11.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:11:19.088 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-14T19:11:25.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:11:33.168 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-14T19:11:39.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:12:05.016 WARNING:teuthology.provision.fog.smithi115:timed out 2023-07-14T19:12:11.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:12:16.032 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-14T19:12:16.324 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T19:12:16.325 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T19:12:16.795 INFO:teuthology.provision.fog.smithi115:Node is ready 2023-07-14T19:12:16.796 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2023-07-14T19:12:16.841 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2023-07-14T19:12:16.842 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2023-07-14T19:12:16.889 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2023-07-14T19:12:16.890 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-07-14T19:12:17.015 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2023-07-14T19:12:17.028 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2023-07-14T19:12:17.086 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2023-07-14T19:12:17.142 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-07-14T19:12:17.197 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-07-14T19:12:17.242 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-14T19:12:17.242 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Ubuntu" 2023-07-14T19:12:17.242 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="22.04" 2023-07-14T19:12:17.242 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-14T19:12:17.242 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_CODENAME=jammy 2023-07-14T19:12:17.243 INFO:teuthology.orchestra.run.smithi115.stdout:ID=ubuntu 2023-07-14T19:12:17.243 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE=debian 2023-07-14T19:12:17.243 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-14T19:12:17.243 INFO:teuthology.orchestra.run.smithi115.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-14T19:12:17.243 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-14T19:12:17.243 INFO:teuthology.orchestra.run.smithi115.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-14T19:12:17.243 INFO:teuthology.orchestra.run.smithi115.stdout:UBUNTU_CODENAME=jammy 2023-07-14T19:12:17.244 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2023-07-14T19:12:17.246 DEBUG:teuthology.parallel:result is None 2023-07-14T19:12:22.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:12:27.038 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-14T19:12:33.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:12:37.865 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T19:12:37.866 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T19:12:38.282 INFO:teuthology.provision.fog.smithi151:Node is ready 2023-07-14T19:12:38.282 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2023-07-14T19:12:38.330 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2023-07-14T19:12:38.331 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts 2023-07-14T19:12:38.378 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2023-07-14T19:12:38.379 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-07-14T19:12:38.606 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts 2023-07-14T19:12:38.620 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts 2023-07-14T19:12:38.679 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname 2023-07-14T19:12:38.739 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-07-14T19:12:38.794 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-07-14T19:12:38.842 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-14T19:12:38.843 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2023-07-14T19:12:38.843 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04" 2023-07-14T19:12:38.843 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-14T19:12:38.843 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy 2023-07-14T19:12:38.844 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2023-07-14T19:12:38.844 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2023-07-14T19:12:38.844 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-14T19:12:38.844 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-14T19:12:38.844 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-14T19:12:38.845 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-14T19:12:38.845 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy 2023-07-14T19:12:38.845 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2023-07-14T19:12:38.846 DEBUG:teuthology.parallel:result is None 2023-07-14T19:12:42.922 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2023-07-14T19:12:42.923 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-14T19:12:46.602 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2023-07-14T19:12:46.602 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-14T19:12:46.620 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2023-07-14T19:12:46.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-07-14T19:12:46.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:12:46.699 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-07-14T19:12:46.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-07-14T19:12:46.936 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2023-07-14T19:12:46.981 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2023-07-14T19:12:46.981 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-07-14T19:12:47.030 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-14T19:12:47.030 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Ubuntu" 2023-07-14T19:12:47.030 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="22.04" 2023-07-14T19:12:47.030 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-14T19:12:47.031 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_CODENAME=jammy 2023-07-14T19:12:47.031 INFO:teuthology.orchestra.run.smithi115.stdout:ID=ubuntu 2023-07-14T19:12:47.031 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE=debian 2023-07-14T19:12:47.031 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-14T19:12:47.031 INFO:teuthology.orchestra.run.smithi115.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-14T19:12:47.031 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-14T19:12:47.031 INFO:teuthology.orchestra.run.smithi115.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-14T19:12:47.031 INFO:teuthology.orchestra.run.smithi115.stdout:UBUNTU_CODENAME=jammy 2023-07-14T19:12:47.032 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-07-14T19:12:52.061 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2023-07-14T19:12:52.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-14T19:12:52.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T19:12:57.144 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-07-14T19:12:57.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-14T19:12:57.376 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-07-14T19:12:57.422 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-07-14T19:12:57.422 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-07-14T19:12:57.470 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-14T19:12:57.470 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2023-07-14T19:12:57.470 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04" 2023-07-14T19:12:57.471 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-14T19:12:57.471 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy 2023-07-14T19:12:57.471 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2023-07-14T19:12:57.471 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2023-07-14T19:12:57.471 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-14T19:12:57.471 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-14T19:12:57.471 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-14T19:12:57.472 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-14T19:12:57.472 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy 2023-07-14T19:12:57.472 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-07-14T19:13:02.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:13:02.501 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:13:07.607 INFO:teuthology.dispatcher.supervisor:Running job 7338076 2023-07-14T19:13:07.608 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-07-14_16:57:08-rgw-main-distro-default-smithi/7338076 --name cbodley-2023-07-14_16:57:08-rgw-main-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/cbodley-2023-07-14_16:57:08-rgw-main-distro-default-smithi/7338076/orig.config.yaml 2023-07-14T19:13:07.612 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-07-14_16:57:08-rgw-main-distro-default-smithi/7338076 2023-07-14T19:13:07.613 INFO:teuthology.dispatcher.supervisor:Job PID: 14609 2023-07-14T19:13:07.613 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-14T19:15:07.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:15:07.713 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:17:12.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:17:12.878 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:19:13.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:19:13.766 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:21:18.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:21:18.954 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:23:24.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:23:24.130 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:25:24.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:25:24.299 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:27:29.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:27:29.514 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:29:29.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:29:29.686 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:31:34.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:31:34.894 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:33:40.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:33:40.065 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:35:40.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:35:40.229 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:37:42.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:37:42.303 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:39:47.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:39:47.478 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:41:52.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:41:52.650 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:43:57.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:43:57.827 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:46:03.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:46:03.004 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:48:08.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:48:08.173 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:50:11.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:50:11.423 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:52:16.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:52:16.593 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:54:21.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:54:21.792 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:56:25.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:56:25.978 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T19:58:31.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T19:58:31.082 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:00:36.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:00:36.235 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:02:41.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:02:41.140 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:04:45.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:04:45.223 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:06:48.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:06:48.657 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:08:48.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:08:48.835 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:10:51.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:10:51.843 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:12:57.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:12:57.012 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:15:01.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:15:01.533 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:17:01.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:17:01.706 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:19:01.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:19:01.870 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:21:07.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:21:07.042 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:23:12.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:23:12.218 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:25:17.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:25:17.401 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:27:22.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:27:22.542 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:29:23.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:29:23.726 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:31:28.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:31:28.470 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:33:32.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:33:32.790 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:35:37.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:35:37.969 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:37:38.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:37:38.168 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:39:43.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:39:43.349 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:41:48.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:41:48.542 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:43:53.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:43:53.742 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:45:58.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:45:58.749 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:48:03.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:48:03.917 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:50:09.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:50:09.157 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:52:14.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:52:14.345 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:54:14.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:54:14.509 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:56:19.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:56:19.711 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T20:58:24.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T20:58:24.885 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:00:30.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:00:30.062 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:02:30.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:02:30.237 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:04:33.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:04:33.249 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:06:35.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:06:35.697 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:08:37.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:08:37.850 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:10:43.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:10:43.029 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:12:48.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:12:48.121 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:14:53.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:14:53.026 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:16:58.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:16:58.178 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:19:03.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:19:03.369 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:21:08.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:21:08.478 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:23:08.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:23:08.683 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:25:13.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:25:13.865 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:27:14.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:27:14.044 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:29:19.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:29:19.238 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:29:24.365 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/cbodley-2023-07-14_16:57:08-rgw-main-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-07-14T21:31:25.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:31:25.946 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:33:26.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:33:26.122 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:35:31.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:35:31.403 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:37:36.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:37:36.581 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:39:41.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:39:41.766 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:41:46.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:41:46.978 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:43:52.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:43:52.162 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:45:52.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:45:52.349 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:47:57.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:47:57.539 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:50:02.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:50:02.744 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:52:07.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:52:07.921 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:54:13.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:54:13.110 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:56:18.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:56:18.338 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:56:23.410 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-14T21:56:33.312 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-14T21:56:33.312 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T21:56:47.668 DEBUG:teuthology.nuke:shortname: smithi115 2023-07-14T21:56:47.669 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T21:56:47.692 DEBUG:teuthology.nuke:shortname: smithi151 2023-07-14T21:56:47.692 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T21:56:47.695 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-07-14_16:57:08-rgw-main-distro-default-smithi/7338076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 19:06:32.072531', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSsxF4ca+ax5/+rBfJI6WvvmsmLlMlvI0ixO84x8uD52bcVTvrpFsX4Dvi9uEEjc7g/YkaW3ot7YEnUqysX1Kw='} 2023-07-14T21:56:47.721 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-07-14_16:57:08-rgw-main-distro-default-smithi/7338076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 19:06:32.071036', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHF6uu+AxlulAYAjoDG/4y7dzmdLr9SdT57+NosdHdB6mSPL4zgYT0aapMMcSXr/Rl0NajPMDwcWElIlT8s/PHQ='} 2023-07-14T21:56:47.754 INFO:teuthology.orchestra.console:Power off smithi115 2023-07-14T21:56:47.755 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T21:56:47.777 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:56:47.794 INFO:teuthology.orchestra.console:Power off smithi151 2023-07-14T21:56:47.795 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T21:56:47.817 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:56:47.904 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2023-07-14T21:56:47.937 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2023-07-14T21:56:48.070 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2023-07-14T21:56:48.085 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com