2023-07-08T06:31:47.083 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-08T06:31:47.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:31:47.085 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:31:47.225 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f43252998b0>, signals=[15]) 2023-07-08T06:31:47.226 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2023-07-08T06:31:47.227 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2023-07-08T06:31:47.227 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-07-08T06:31:47.247 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-07-08T06:31:47.247 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-07-08T06:31:47.248 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-07-08T06:31:47.249 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /host {"name": "smithi022"} 2023-07-08T06:31:47.272 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /host {"name": "smithi072"} 2023-07-08T06:31:47.323 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-08T06:31:47.341 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-08T06:31:47.365 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-08T06:31:47.365 DEBUG:teuthology.provision.fog.smithi022:FOG request: PUT /host/128 {"imageID": 2} 2023-07-08T06:31:47.383 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-08T06:31:47.384 DEBUG:teuthology.provision.fog.smithi072:FOG request: PUT /host/177 {"imageID": 2} 2023-07-08T06:31:47.411 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of ubuntu 20.04 2023-07-08T06:31:47.411 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:31:47.429 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of ubuntu 20.04 2023-07-08T06:31:47.429 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:31:47.505 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /tasktype {"name": "deploy"} 2023-07-08T06:31:47.509 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /tasktype {"name": "deploy"} 2023-07-08T06:31:47.535 DEBUG:teuthology.provision.fog.smithi022:FOG request: POST /host/128/task {"taskTypeID": 1} 2023-07-08T06:31:47.543 DEBUG:teuthology.provision.fog.smithi072:FOG request: POST /host/177/task {"taskTypeID": 1} 2023-07-08T06:31:47.588 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:31:47.590 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:31:47.722 INFO:teuthology.orchestra.console:Power off smithi022 2023-07-08T06:31:47.723 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T06:31:47.738 INFO:teuthology.orchestra.console:Power off smithi072 2023-07-08T06:31:47.739 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T06:31:47.748 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:47.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:47.871 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2023-07-08T06:31:47.972 INFO:teuthology.orchestra.console:Power on smithi022 2023-07-08T06:31:47.972 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-08T06:31:47.993 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:51.786 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:52.016 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:52.225 INFO:teuthology.orchestra.console:Power on for smithi022 completed 2023-07-08T06:31:52.326 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2023-07-08T06:31:52.326 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:31:55.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:32:00.008 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:32:00.218 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2023-07-08T06:32:00.319 INFO:teuthology.orchestra.console:Power on smithi072 2023-07-08T06:32:00.319 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-08T06:32:00.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:32:04.364 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:32:04.573 INFO:teuthology.orchestra.console:Power on for smithi072 completed 2023-07-08T06:32:04.674 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-07-08T06:32:04.675 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:32:07.484 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:32:19.998 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:32:22.896 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:32:35.241 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:32:38.213 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:32:50.500 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:32:53.560 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:33:05.768 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:33:08.964 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:33:21.039 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:33:24.427 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:33:36.319 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:33:39.807 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:33:51.808 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:33:55.470 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:34:07.368 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:34:11.045 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:34:23.162 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:34:26.563 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:34:40.364 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:34:44.772 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:34:56.896 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:35:01.392 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:35:13.808 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:35:16.820 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:35:30.981 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:35:32.355 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-08T06:35:36.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:35:39.472 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-07-08T06:35:45.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:35:48.560 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-07-08T06:35:49.663 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:35:54.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:35:57.616 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-07-08T06:36:03.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:36:05.151 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:36:06.672 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-07-08T06:36:12.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:36:15.728 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-07-08T06:36:20.610 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:36:21.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:36:38.001 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:36:54.626 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:37:11.212 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:37:21.740 WARNING:teuthology.provision.fog.smithi022:timed out 2023-07-08T06:37:27.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:37:27.859 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:37:27.961 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T06:37:27.962 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T06:37:28.410 INFO:teuthology.provision.fog.smithi022:Node is ready 2023-07-08T06:37:28.411 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2023-07-08T06:37:28.416 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2023-07-08T06:37:28.417 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2023-07-08T06:37:28.423 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-07-08T06:37:28.424 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-07-08T06:37:28.559 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2023-07-08T06:37:28.575 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2023-07-08T06:37:28.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2023-07-08T06:37:28.602 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-07-08T06:37:28.612 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-07-08T06:37:28.660 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Ubuntu" 2023-07-08T06:37:28.660 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-08T06:37:28.660 INFO:teuthology.orchestra.run.smithi022.stdout:ID=ubuntu 2023-07-08T06:37:28.660 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE=debian 2023-07-08T06:37:28.660 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-08T06:37:28.660 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="20.04" 2023-07-08T06:37:28.661 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-08T06:37:28.661 INFO:teuthology.orchestra.run.smithi022.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-08T06:37:28.661 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-08T06:37:28.661 INFO:teuthology.orchestra.run.smithi022.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-08T06:37:28.661 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_CODENAME=focal 2023-07-08T06:37:28.661 INFO:teuthology.orchestra.run.smithi022.stdout:UBUNTU_CODENAME=focal 2023-07-08T06:37:28.662 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2023-07-08T06:37:28.663 DEBUG:teuthology.parallel:result is None 2023-07-08T06:37:44.672 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:38:00.628 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:38:16.569 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:38:32.356 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:38:47.948 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:39:03.339 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:39:18.776 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:39:34.192 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:39:49.512 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:40:04.830 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:40:20.167 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:40:35.512 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:40:50.824 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:41:06.096 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:41:21.370 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:41:36.632 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:41:51.884 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:42:07.144 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:42:22.360 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:42:37.599 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:42:52.800 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:43:08.009 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:43:23.204 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:43:38.400 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:43:53.565 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:44:08.724 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:44:23.888 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:44:39.040 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:44:54.196 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:45:09.320 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:45:24.464 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:45:39.577 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:45:54.694 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:46:09.803 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:46:24.899 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:46:40.000 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:46:55.097 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:47:10.184 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:47:25.284 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:47:40.375 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:47:55.453 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:48:10.520 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:48:25.591 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-08T06:48:25.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:48:25.947 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-07-08T06:48:25.949 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T06:48:25.949 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T06:48:25.961 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-08T06:51:00.080 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-08T06:51:00.085 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi072 2023-07-08T06:51:09.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-08T06:51:09.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:51:09.355 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-07-08T06:51:09.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-08T06:51:09.902 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T06:51:09.903 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T06:51:09.913 INFO:teuthology.provision.fog.smithi072:Node is ready 2023-07-08T06:51:09.914 DEBUG:teuthology.orchestra.run.smithi072:> hostname 2023-07-08T06:51:09.923 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2023-07-08T06:51:09.924 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts 2023-07-08T06:51:09.972 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2023-07-08T06:51:09.973 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-07-08T06:51:10.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts 2023-07-08T06:51:10.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts 2023-07-08T06:51:10.136 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname 2023-07-08T06:51:10.196 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-07-08T06:51:10.212 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-07-08T06:51:10.263 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu" 2023-07-08T06:51:10.263 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-08T06:51:10.263 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu 2023-07-08T06:51:10.263 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian 2023-07-08T06:51:10.263 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-08T06:51:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="20.04" 2023-07-08T06:51:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-08T06:51:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-08T06:51:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-08T06:51:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-08T06:51:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=focal 2023-07-08T06:51:10.264 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=focal 2023-07-08T06:51:10.265 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2023-07-08T06:51:10.265 DEBUG:teuthology.parallel:result is None 2023-07-08T06:51:10.665 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2023-07-08T06:51:10.666 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-08T06:51:10.701 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2023-07-08T06:51:10.701 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-08T06:51:10.726 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2023-07-08T06:51:10.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-08T06:51:10.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:51:10.801 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-07-08T06:51:11.005 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-08T06:51:11.006 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-07-08T06:51:11.017 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-07-08T06:51:11.017 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-07-08T06:51:11.034 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Ubuntu" 2023-07-08T06:51:11.034 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-08T06:51:11.035 INFO:teuthology.orchestra.run.smithi022.stdout:ID=ubuntu 2023-07-08T06:51:11.035 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE=debian 2023-07-08T06:51:11.035 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-08T06:51:11.036 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="20.04" 2023-07-08T06:51:11.036 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-08T06:51:11.036 INFO:teuthology.orchestra.run.smithi022.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-08T06:51:11.037 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-08T06:51:11.037 INFO:teuthology.orchestra.run.smithi022.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-08T06:51:11.037 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_CODENAME=focal 2023-07-08T06:51:11.039 INFO:teuthology.orchestra.run.smithi022.stdout:UBUNTU_CODENAME=focal 2023-07-08T06:51:11.039 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-07-08T06:51:11.077 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2023-07-08T06:51:11.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-08T06:51:11.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:51:11.145 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-07-08T06:51:11.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-08T06:51:11.263 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-07-08T06:51:11.315 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-07-08T06:51:11.317 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-07-08T06:51:11.330 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu" 2023-07-08T06:51:11.330 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-08T06:51:11.330 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu 2023-07-08T06:51:11.331 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian 2023-07-08T06:51:11.331 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-08T06:51:11.331 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="20.04" 2023-07-08T06:51:11.331 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-08T06:51:11.331 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-08T06:51:11.331 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-08T06:51:11.331 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-08T06:51:11.332 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=focal 2023-07-08T06:51:11.332 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=focal 2023-07-08T06:51:11.332 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-07-08T06:51:11.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:51:11.358 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:51:11.492 INFO:teuthology.dispatcher.supervisor:Running job 7328944 2023-07-08T06:51:11.493 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328944 --name adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi --description orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} -- /home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328944/orig.config.yaml 2023-07-08T06:51:11.503 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328944 2023-07-08T06:51:11.504 INFO:teuthology.dispatcher.supervisor:Job PID: 24411 2023-07-08T06:51:11.504 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-08T06:53:11.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:53:11.606 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:55:11.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:55:11.813 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:57:12.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:57:12.007 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:59:12.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:59:12.198 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T07:01:12.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T07:01:12.369 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T07:03:12.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T07:03:12.545 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T07:05:12.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T07:05:12.718 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T07:05:12.780 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-08T07:05:12.875 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-08T07:05:12.875 INFO:teuthology.nuke:Checking targets against current locks 2023-07-08T07:05:12.928 DEBUG:teuthology.nuke:shortname: smithi022 2023-07-08T07:05:12.929 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-08T07:05:12.949 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328944', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 06:31:46.348669', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-08T07:05:12.955 DEBUG:teuthology.nuke:shortname: smithi072 2023-07-08T07:05:12.955 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-08T07:05:12.978 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328944', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 06:31:46.350123', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-08T07:05:13.005 INFO:teuthology.orchestra.console:Power off smithi022 2023-07-08T07:05:13.006 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T07:05:13.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T07:05:13.049 INFO:teuthology.orchestra.console:Power off smithi072 2023-07-08T07:05:13.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T07:05:13.071 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T07:05:13.160 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2023-07-08T07:05:13.192 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2023-07-08T07:05:13.320 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2023-07-08T07:05:13.346 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com