2023-07-03T08:12:57.644 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-03T08:12:57.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:12:57.647 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:12:57.806 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3ed1c26790>, signals=[15]) 2023-07-03T08:12:57.807 INFO:teuthology.lock.ops:Start node 'smithi082.front.sepia.ceph.com' reimaging 2023-07-03T08:12:57.808 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: reset os type and version on server 2023-07-03T08:12:57.808 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-07-03T08:12:57.831 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2023-07-03T08:12:57.832 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2023-07-03T08:12:57.832 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-07-03T08:12:57.833 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /host {"name": "smithi082"} 2023-07-03T08:12:57.856 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /host {"name": "smithi184"} 2023-07-03T08:12:57.907 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-03T08:12:57.924 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-03T08:12:57.946 DEBUG:teuthology.provision.fog.smithi082:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-03T08:12:57.946 DEBUG:teuthology.provision.fog.smithi082:FOG request: PUT /host/187 {"imageID": 6} 2023-07-03T08:12:57.962 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-03T08:12:57.962 DEBUG:teuthology.provision.fog.smithi184:FOG request: PUT /host/289 {"imageID": 6} 2023-07-03T08:12:57.994 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of ubuntu 22.04 2023-07-03T08:12:57.994 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:12:57.999 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of ubuntu 22.04 2023-07-03T08:12:57.999 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:12:58.035 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /tasktype {"name": "deploy"} 2023-07-03T08:12:58.038 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /tasktype {"name": "deploy"} 2023-07-03T08:12:58.068 DEBUG:teuthology.provision.fog.smithi082:FOG request: POST /host/187/task {"taskTypeID": 1} 2023-07-03T08:12:58.072 DEBUG:teuthology.provision.fog.smithi184:FOG request: POST /host/289/task {"taskTypeID": 1} 2023-07-03T08:12:58.132 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:12:58.135 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:12:58.213 INFO:teuthology.orchestra.console:Power off smithi184 2023-07-03T08:12:58.214 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T08:12:58.230 INFO:teuthology.orchestra.console:Power off smithi082 2023-07-03T08:12:58.231 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T08:12:58.240 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T08:12:58.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T08:12:58.362 INFO:teuthology.orchestra.console:Power off for smithi184 completed 2023-07-03T08:12:58.372 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2023-07-03T08:12:58.463 INFO:teuthology.orchestra.console:Power on smithi184 2023-07-03T08:12:58.464 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-03T08:12:58.472 INFO:teuthology.orchestra.console:Power on smithi082 2023-07-03T08:12:58.473 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-03T08:12:58.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T08:12:58.494 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T08:13:02.508 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T08:13:02.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T08:13:02.719 INFO:teuthology.orchestra.console:Power on for smithi184 completed 2023-07-03T08:13:02.726 INFO:teuthology.orchestra.console:Power on for smithi082 completed 2023-07-03T08:13:02.821 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2023-07-03T08:13:02.821 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:13:02.828 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2023-07-03T08:13:02.828 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:13:17.877 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:13:17.878 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:13:32.942 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:13:32.944 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:13:48.008 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:13:48.009 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:14:03.076 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:14:03.078 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:14:18.140 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:14:18.142 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:14:33.210 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:14:33.211 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:14:48.295 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:14:48.297 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:15:03.361 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:15:03.362 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:15:18.436 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:15:18.438 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:15:33.504 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:15:33.505 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:15:48.572 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:15:48.573 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:16:03.644 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:16:03.645 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:16:18.716 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-07-03T08:16:18.717 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-03T08:16:18.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:16:18.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:16:21.844 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-07-03T08:16:21.845 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-03T08:16:27.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:16:27.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:16:30.928 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-03T08:16:30.929 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-07-03T08:16:36.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:16:36.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:16:39.984 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-03T08:16:39.985 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-07-03T08:16:45.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:16:45.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:16:49.072 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-03T08:16:49.073 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-07-03T08:16:55.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:16:55.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:16:58.128 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-03T08:16:58.129 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-07-03T08:17:04.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:17:04.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:17:07.216 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-03T08:17:13.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:17:44.817 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-03T08:17:50.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:17:50.825 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-03T08:17:56.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:17:56.832 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-03T08:18:02.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:18:02.839 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-03T08:18:04.140 WARNING:teuthology.provision.fog.smithi184:timed out 2023-07-03T08:18:08.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:18:09.102 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-03T08:18:09.103 DEBUG:teuthology.orchestra.run.smithi082:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-03T08:18:09.986 INFO:teuthology.provision.fog.smithi082:Node is ready 2023-07-03T08:18:09.986 DEBUG:teuthology.orchestra.run.smithi082:> hostname 2023-07-03T08:18:10.033 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com 2023-07-03T08:18:10.033 DEBUG:teuthology.orchestra.run.smithi082:> grep smithi082.front.sepia.ceph.com /etc/hosts 2023-07-03T08:18:10.081 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082 2023-07-03T08:18:10.082 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2023-07-03T08:18:10.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:18:10.207 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hosts 2023-07-03T08:18:10.220 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/172.21.15.82/172.21.15.82/g' /etc/hosts 2023-07-03T08:18:10.276 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hostname 2023-07-03T08:18:10.325 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-03T08:18:10.325 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-03T08:18:10.355 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2023-07-03T08:18:10.409 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-07-03T08:18:10.457 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-03T08:18:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Ubuntu" 2023-07-03T08:18:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="22.04" 2023-07-03T08:18:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-03T08:18:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_CODENAME=jammy 2023-07-03T08:18:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:ID=ubuntu 2023-07-03T08:18:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE=debian 2023-07-03T08:18:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-03T08:18:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-03T08:18:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-03T08:18:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-03T08:18:10.459 INFO:teuthology.orchestra.run.smithi082.stdout:UBUNTU_CODENAME=jammy 2023-07-03T08:18:10.460 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2023-07-03T08:18:10.461 DEBUG:teuthology.parallel:result is None 2023-07-03T08:18:10.719 INFO:teuthology.provision.fog.smithi184:Node is ready 2023-07-03T08:18:10.719 DEBUG:teuthology.orchestra.run.smithi184:> hostname 2023-07-03T08:18:10.766 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2023-07-03T08:18:10.767 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts 2023-07-03T08:18:10.815 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2023-07-03T08:18:10.815 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-07-03T08:18:10.935 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts 2023-07-03T08:18:10.948 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts 2023-07-03T08:18:11.002 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname 2023-07-03T08:18:11.057 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-07-03T08:18:11.116 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-07-03T08:18:11.162 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-03T08:18:11.162 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2023-07-03T08:18:11.163 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="22.04" 2023-07-03T08:18:11.163 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-03T08:18:11.163 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=jammy 2023-07-03T08:18:11.164 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2023-07-03T08:18:11.164 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2023-07-03T08:18:11.164 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-03T08:18:11.164 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-03T08:18:11.165 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-03T08:18:11.165 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-03T08:18:11.165 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=jammy 2023-07-03T08:18:11.166 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2023-07-03T08:18:11.167 DEBUG:teuthology.parallel:result is None 2023-07-03T08:18:11.365 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2023-07-03T08:18:11.366 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-03T08:18:11.395 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2023-07-03T08:18:11.395 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-03T08:18:11.416 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2023-07-03T08:18:11.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-07-03T08:18:11.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:18:11.489 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-07-03T08:18:11.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-07-03T08:18:11.604 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2023-07-03T08:18:11.648 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2023-07-03T08:18:11.649 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-07-03T08:18:11.697 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-03T08:18:11.697 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Ubuntu" 2023-07-03T08:18:11.697 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="22.04" 2023-07-03T08:18:11.698 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-03T08:18:11.698 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_CODENAME=jammy 2023-07-03T08:18:11.698 INFO:teuthology.orchestra.run.smithi082.stdout:ID=ubuntu 2023-07-03T08:18:11.698 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE=debian 2023-07-03T08:18:11.698 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-03T08:18:11.698 INFO:teuthology.orchestra.run.smithi082.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-03T08:18:11.698 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-03T08:18:11.699 INFO:teuthology.orchestra.run.smithi082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-03T08:18:11.699 INFO:teuthology.orchestra.run.smithi082.stdout:UBUNTU_CODENAME=jammy 2023-07-03T08:18:11.699 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-07-03T08:18:11.720 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2023-07-03T08:18:11.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-03T08:18:11.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:18:11.794 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-07-03T08:18:11.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-03T08:18:11.900 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-07-03T08:18:11.944 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-07-03T08:18:11.945 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-07-03T08:18:11.988 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-03T08:18:11.989 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2023-07-03T08:18:11.989 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="22.04" 2023-07-03T08:18:11.989 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-03T08:18:11.989 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=jammy 2023-07-03T08:18:11.989 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2023-07-03T08:18:11.989 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2023-07-03T08:18:11.990 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-03T08:18:11.990 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-03T08:18:11.990 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-03T08:18:11.990 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-03T08:18:11.990 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=jammy 2023-07-03T08:18:11.990 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-07-03T08:18:12.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:18:12.012 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:18:12.118 INFO:teuthology.dispatcher.supervisor:Running job 7324590 2023-07-03T08:18:12.119 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-07-03_07:51:01-rgw-wip-T52363-xrmeng8756-i001-distro-default-smithi/7324590 --name mkogan-2023-07-03_07:51:01-rgw-wip-T52363-xrmeng8756-i001-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} -- /home/teuthworker/archive/mkogan-2023-07-03_07:51:01-rgw-wip-T52363-xrmeng8756-i001-distro-default-smithi/7324590/orig.config.yaml 2023-07-03T08:18:12.122 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-07-03_07:51:01-rgw-wip-T52363-xrmeng8756-i001-distro-default-smithi/7324590 2023-07-03T08:18:12.123 INFO:teuthology.dispatcher.supervisor:Job PID: 2421 2023-07-03T08:18:12.123 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-03T08:20:12.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:20:12.226 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:22:12.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:22:12.397 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:24:12.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:24:12.567 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:26:12.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:26:12.726 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:28:12.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:28:12.894 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:30:13.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:30:13.067 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:32:13.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:32:13.235 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:34:13.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:34:13.418 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:36:13.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:36:13.590 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:38:13.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:38:13.767 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:40:13.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:40:13.942 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:42:14.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:42:14.130 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:44:14.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:44:14.307 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:46:14.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:46:14.464 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:48:14.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:48:14.634 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:50:14.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:50:14.795 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:52:14.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:52:14.933 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:54:15.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:54:15.071 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:56:15.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:56:15.242 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:58:15.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:58:15.406 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:00:15.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:00:15.558 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:02:15.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:02:15.711 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:04:15.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:04:15.874 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:06:16.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:06:16.055 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:08:16.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:08:16.225 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:10:16.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:10:16.394 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:12:16.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:12:16.564 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:14:16.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:14:16.685 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:16:16.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:16:16.847 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:18:16.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:18:16.948 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:20:17.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:20:17.038 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:22:17.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:22:17.166 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:24:17.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:24:17.327 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:26:17.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:26:17.434 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:28:17.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:28:17.566 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:30:17.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:30:17.734 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:32:17.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:32:17.906 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:34:17.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T09:34:17.981 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T09:34:18.042 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-03T09:34:18.197 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-03T09:34:18.198 INFO:teuthology.nuke:Checking targets against current locks 2023-07-03T09:34:18.249 DEBUG:teuthology.nuke:shortname: smithi082 2023-07-03T09:34:18.249 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-03T09:34:18.266 DEBUG:teuthology.nuke:shortname: smithi184 2023-07-03T09:34:18.266 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-03T09:34:18.274 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-07-03_07:51:01-rgw-wip-T52363-xrmeng8756-i001-distro-default-smithi/7324590', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-03 08:12:56.856970', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH45F7rJpEZgjvyYIw4LKzw0Ge2IWSS3Pp/okNrYAfwJ4X/RsJK+PZtRRvPETUAX62ZtDlGlrt0uV1Iur5H3MRY='} 2023-07-03T09:34:18.288 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-07-03_07:51:01-rgw-wip-T52363-xrmeng8756-i001-distro-default-smithi/7324590', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-03 08:12:56.854580', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFG/z9zdkU5U+Hdm0NKwajsSwgXMxPd33T5SNZegL/2jHF1EAkenryUYKc11ljAgSUky9mW+u028TAWe+D3o4nc='} 2023-07-03T09:34:18.324 INFO:teuthology.orchestra.console:Power off smithi082 2023-07-03T09:34:18.325 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T09:34:18.338 INFO:teuthology.orchestra.console:Power off smithi184 2023-07-03T09:34:18.339 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T09:34:18.347 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T09:34:18.359 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T09:34:18.469 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2023-07-03T09:34:18.480 INFO:teuthology.orchestra.console:Power off for smithi184 completed 2023-07-03T09:34:18.625 INFO:teuthology.lock.ops:unlocked: smithi082.front.sepia.ceph.com 2023-07-03T09:34:18.633 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com