2023-07-20T14:35:39.899 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-20T14:35:39.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T14:35:39.901 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T14:35:40.066 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5c0d585f70>, signals=[15]) 2023-07-20T14:35:40.068 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-07-20T14:35:40.068 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T14:35:40.069 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-07-20T14:35:40.089 INFO:teuthology.lock.ops:Start node 'smithi182.front.sepia.ceph.com' reimaging 2023-07-20T14:35:40.089 INFO:teuthology.lock.ops:Updating [smithi182.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T14:35:40.089 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2023-07-20T14:35:40.091 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"} 2023-07-20T14:35:40.113 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /host {"name": "smithi182"} 2023-07-20T14:35:40.169 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-20T14:35:40.193 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-20T14:35:40.220 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-20T14:35:40.221 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 6} 2023-07-20T14:35:40.264 DEBUG:teuthology.provision.fog.smithi182:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-20T14:35:40.264 DEBUG:teuthology.provision.fog.smithi182:FOG request: PUT /host/287 {"imageID": 6} 2023-07-20T14:35:40.278 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of ubuntu 22.04 2023-07-20T14:35:40.278 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:35:40.324 INFO:teuthology.provision.fog.smithi182:Scheduling deploy of ubuntu 22.04 2023-07-20T14:35:40.324 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:35:40.622 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T14:35:40.660 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1} 2023-07-20T14:35:40.681 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T14:35:40.723 DEBUG:teuthology.provision.fog.smithi182:FOG request: POST /host/287/task {"taskTypeID": 1} 2023-07-20T14:35:40.729 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:35:40.787 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:35:41.026 INFO:teuthology.orchestra.console:Power off smithi161 2023-07-20T14:35:41.027 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T14:35:41.050 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T14:35:41.141 INFO:teuthology.orchestra.console:Power off smithi182 2023-07-20T14:35:41.142 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T14:35:41.163 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T14:35:41.172 INFO:teuthology.orchestra.console:Power off for smithi161 completed 2023-07-20T14:35:41.273 INFO:teuthology.orchestra.console:Power on smithi161 2023-07-20T14:35:41.274 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T14:35:41.294 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T14:35:45.188 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T14:35:45.316 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T14:35:49.300 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T14:35:49.426 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T14:35:49.512 INFO:teuthology.orchestra.console:Power off for smithi182 completed 2023-07-20T14:35:49.613 INFO:teuthology.orchestra.console:Power on smithi182 2023-07-20T14:35:49.613 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T14:35:49.633 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T14:35:49.641 INFO:teuthology.orchestra.console:Power on for smithi161 completed 2023-07-20T14:35:49.742 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-07-20T14:35:49.743 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:35:53.657 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T14:35:57.770 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T14:35:57.981 INFO:teuthology.orchestra.console:Power on for smithi182 completed 2023-07-20T14:35:58.082 INFO:teuthology.provision.fog.smithi182:Waiting for deploy to finish 2023-07-20T14:35:58.083 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:36:05.036 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:36:13.364 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:36:20.286 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:36:28.709 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:36:35.547 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:36:44.029 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:36:50.808 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:36:59.366 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:37:06.136 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:37:14.720 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:37:21.640 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:37:30.112 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:37:37.893 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:37:45.473 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:37:54.512 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:38:01.040 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:38:12.470 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:38:17.124 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:38:29.836 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:38:34.355 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:38:46.420 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:38:51.536 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:39:03.306 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:39:08.841 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:39:20.034 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:39:26.492 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:39:35.471 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:39:43.943 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:39:51.688 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:40:01.705 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:40:09.817 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:40:17.433 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:40:28.840 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-20T14:40:30.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:40:32.936 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:40:49.268 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:40:49.270 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-07-20T14:40:55.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:40:58.352 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-07-20T14:41:04.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:41:06.228 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:41:07.408 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-07-20T14:41:13.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:41:16.464 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-07-20T14:41:22.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:41:23.103 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:41:39.934 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:41:56.369 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:42:12.394 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:42:22.474 WARNING:teuthology.provision.fog.smithi161:timed out 2023-07-20T14:42:28.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:42:28.499 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:42:28.677 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T14:42:28.678 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T14:42:29.105 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-07-20T14:42:29.105 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-07-20T14:42:29.153 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2023-07-20T14:42:29.154 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2023-07-20T14:42:29.202 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-07-20T14:42:29.202 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-07-20T14:42:29.400 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2023-07-20T14:42:29.414 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-07-20T14:42:29.472 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2023-07-20T14:42:29.525 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-07-20T14:42:29.584 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-07-20T14:42:29.633 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-20T14:42:29.634 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2023-07-20T14:42:29.634 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2023-07-20T14:42:29.634 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-20T14:42:29.634 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2023-07-20T14:42:29.634 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2023-07-20T14:42:29.634 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2023-07-20T14:42:29.634 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-20T14:42:29.635 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-20T14:42:29.635 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-20T14:42:29.635 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-20T14:42:29.635 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2023-07-20T14:42:29.636 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-07-20T14:42:29.637 DEBUG:teuthology.parallel:result is None 2023-07-20T14:42:44.459 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:43:00.434 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:43:16.379 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:43:32.223 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:43:47.748 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:44:03.273 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:44:18.755 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:44:34.068 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:44:49.480 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:45:04.840 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:45:20.280 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:45:35.720 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:45:51.024 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:46:06.352 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:46:21.748 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:46:37.040 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:46:52.320 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:47:07.588 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:47:22.845 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:47:38.116 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:47:53.356 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:48:08.592 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:48:23.820 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:48:39.036 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:48:54.256 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:49:09.468 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:49:24.648 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:49:39.786 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-07-20T14:49:39.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:49:40.006 ERROR:teuthology.orchestra.connection:Error authenticating with smithi182.front.sepia.ceph.com: Authentication failed. 2023-07-20T14:49:40.007 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T14:49:40.008 DEBUG:teuthology.orchestra.run.smithi182:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T14:49:40.008 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-20T14:51:31.825 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-20T14:51:31.826 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi182 2023-07-20T14:51:40.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-07-20T14:51:40.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:51:40.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.182 2023-07-20T14:51:49.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-07-20T14:51:49.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:51:50.055 DEBUG:teuthology.orchestra.run.smithi182:> true 2023-07-20T14:51:50.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-07-20T14:51:50.437 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T14:51:50.437 DEBUG:teuthology.orchestra.run.smithi182:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T14:51:50.483 INFO:teuthology.provision.fog.smithi182:Node is ready 2023-07-20T14:51:50.484 DEBUG:teuthology.orchestra.run.smithi182:> hostname 2023-07-20T14:51:50.533 INFO:teuthology.orchestra.run.smithi182.stdout:smithi182.front.sepia.ceph.com 2023-07-20T14:51:50.533 DEBUG:teuthology.orchestra.run.smithi182:> grep smithi182.front.sepia.ceph.com /etc/hosts 2023-07-20T14:51:50.582 INFO:teuthology.orchestra.run.smithi182.stdout:172.21.15.182 smithi182.front.sepia.ceph.com smithi182 2023-07-20T14:51:50.583 DEBUG:teuthology.orchestra.run.smithi182:> sudo hostname smithi182 2023-07-20T14:51:50.752 DEBUG:teuthology.orchestra.run.smithi182:> sudo sed -i -e 's/smithi182.front.sepia.ceph.com/smithi182/g' /etc/hosts 2023-07-20T14:51:50.766 DEBUG:teuthology.orchestra.run.smithi182:> sudo sed -i -e 's/172.21.15.182/172.21.15.182/g' /etc/hosts 2023-07-20T14:51:50.820 DEBUG:teuthology.orchestra.run.smithi182:> sudo sed -i -e 's/smithi182.front.sepia.ceph.com/smithi182/g' /etc/hostname 2023-07-20T14:51:50.875 DEBUG:teuthology.orchestra.run.smithi182:> sudo hostname smithi182 2023-07-20T14:51:50.927 DEBUG:teuthology.orchestra.run.smithi182:> cat /etc/os-release 2023-07-20T14:51:50.972 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-20T14:51:50.972 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="Ubuntu" 2023-07-20T14:51:50.973 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="22.04" 2023-07-20T14:51:50.973 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-20T14:51:50.973 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_CODENAME=jammy 2023-07-20T14:51:50.973 INFO:teuthology.orchestra.run.smithi182.stdout:ID=ubuntu 2023-07-20T14:51:50.973 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE=debian 2023-07-20T14:51:50.973 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-20T14:51:50.973 INFO:teuthology.orchestra.run.smithi182.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-20T14:51:50.974 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-20T14:51:50.974 INFO:teuthology.orchestra.run.smithi182.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-20T14:51:50.974 INFO:teuthology.orchestra.run.smithi182.stdout:UBUNTU_CODENAME=jammy 2023-07-20T14:51:50.974 INFO:teuthology.provision.fog.smithi182:Deploy complete! 2023-07-20T14:51:50.975 DEBUG:teuthology.parallel:result is None 2023-07-20T14:51:51.143 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-07-20T14:51:51.144 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T14:51:51.174 INFO:teuthology.lock.ops:Checking smithi182.front.sepia.ceph.com 2023-07-20T14:51:51.174 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T14:51:51.200 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-07-20T14:51:51.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-07-20T14:51:51.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:51:51.280 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-07-20T14:51:51.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-07-20T14:51:51.514 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-07-20T14:51:51.559 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-07-20T14:51:51.559 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-07-20T14:51:51.606 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-20T14:51:51.607 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2023-07-20T14:51:51.607 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2023-07-20T14:51:51.607 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-20T14:51:51.607 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2023-07-20T14:51:51.607 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2023-07-20T14:51:51.607 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2023-07-20T14:51:51.608 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-20T14:51:51.608 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-20T14:51:51.608 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-20T14:51:51.608 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-20T14:51:51.608 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2023-07-20T14:51:51.609 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-07-20T14:51:51.632 INFO:teuthology.lock.ops:Updating [smithi182.front.sepia.ceph.com]: set os type and version on server 2023-07-20T14:51:51.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-07-20T14:51:51.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T14:51:51.711 DEBUG:teuthology.orchestra.run.smithi182:> true 2023-07-20T14:51:51.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-07-20T14:51:51.804 DEBUG:teuthology.orchestra.run.smithi182:> uname -m 2023-07-20T14:51:51.853 INFO:teuthology.orchestra.run.smithi182.stdout:x86_64 2023-07-20T14:51:51.853 DEBUG:teuthology.orchestra.run.smithi182:> cat /etc/os-release 2023-07-20T14:51:51.899 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-20T14:51:51.899 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="Ubuntu" 2023-07-20T14:51:51.899 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="22.04" 2023-07-20T14:51:51.900 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-20T14:51:51.900 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_CODENAME=jammy 2023-07-20T14:51:51.900 INFO:teuthology.orchestra.run.smithi182.stdout:ID=ubuntu 2023-07-20T14:51:51.900 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE=debian 2023-07-20T14:51:51.900 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-20T14:51:51.900 INFO:teuthology.orchestra.run.smithi182.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-20T14:51:51.901 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-20T14:51:51.901 INFO:teuthology.orchestra.run.smithi182.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-20T14:51:51.901 INFO:teuthology.orchestra.run.smithi182.stdout:UBUNTU_CODENAME=jammy 2023-07-20T14:51:51.901 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2023-07-20T14:51:51.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T14:51:51.999 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T14:51:52.123 INFO:teuthology.dispatcher.supervisor:Running job 7344754 2023-07-20T14:51:52.124 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344754 --name yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi --description rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} -- /home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344754/orig.config.yaml 2023-07-20T14:51:52.131 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344754 2023-07-20T14:51:52.132 INFO:teuthology.dispatcher.supervisor:Job PID: 31810 2023-07-20T14:51:52.132 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-20T14:53:52.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T14:53:52.235 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T14:55:52.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T14:55:52.437 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T14:57:52.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T14:57:52.708 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T14:59:52.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T14:59:52.950 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T15:01:53.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T15:01:53.377 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T15:03:53.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T15:03:53.651 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T15:05:53.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T15:05:53.886 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T15:07:54.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T15:07:54.066 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T15:07:54.144 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-20T15:07:54.221 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-20T15:07:54.222 INFO:teuthology.nuke:Checking targets against current locks 2023-07-20T15:07:54.268 DEBUG:teuthology.nuke:shortname: smithi161 2023-07-20T15:07:54.268 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T15:07:54.291 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344754', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 14:35:39.142477', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHqd7qQRosF3aWcJlWORnxnu5R+pBbI1ionC1NJhCPbYLTtyoR/uACHF7WW5u4eYXni4XPo146a5JDGRdp/B6Fk='} 2023-07-20T15:07:54.301 DEBUG:teuthology.nuke:shortname: smithi182 2023-07-20T15:07:54.301 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T15:07:54.325 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi182.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-20_14:33:07-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7344754', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 14:35:39.143956', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDL4ww2idDAmVez/HPtDOGh1FJvSgynh7F75ePrOd42G'} 2023-07-20T15:07:54.338 INFO:teuthology.orchestra.console:Power off smithi161 2023-07-20T15:07:54.339 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T15:07:54.360 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T15:07:54.385 INFO:teuthology.orchestra.console:Power off smithi182 2023-07-20T15:07:54.386 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T15:07:54.407 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T15:07:54.497 INFO:teuthology.orchestra.console:Power off for smithi161 completed 2023-07-20T15:07:54.529 INFO:teuthology.orchestra.console:Power off for smithi182 completed 2023-07-20T15:07:54.660 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com 2023-07-20T15:07:54.683 INFO:teuthology.lock.ops:unlocked: smithi182.front.sepia.ceph.com