2023-07-21T21:24:04.398 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T21:24:04.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:24:04.400 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:24:04.549 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7811286f70>, signals=[15]) 2023-07-21T21:24:04.550 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2023-07-21T21:24:04.550 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T21:24:04.551 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-07-21T21:24:04.578 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging 2023-07-21T21:24:04.578 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T21:24:04.579 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-07-21T21:24:04.580 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /host {"name": "smithi038"} 2023-07-21T21:24:04.604 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /host {"name": "smithi117"} 2023-07-21T21:24:04.652 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-21T21:24:04.671 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-21T21:24:04.695 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-21T21:24:04.695 DEBUG:teuthology.provision.fog.smithi038:FOG request: PUT /host/143 {"imageID": 2} 2023-07-21T21:24:04.714 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-21T21:24:04.714 DEBUG:teuthology.provision.fog.smithi117:FOG request: PUT /host/222 {"imageID": 2} 2023-07-21T21:24:04.736 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of ubuntu 20.04 2023-07-21T21:24:04.736 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-21T21:24:04.757 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of ubuntu 20.04 2023-07-21T21:24:04.758 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:24:04.786 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T21:24:04.801 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T21:24:04.820 DEBUG:teuthology.provision.fog.smithi038:FOG request: POST /host/143/task {"taskTypeID": 1} 2023-07-21T21:24:04.849 DEBUG:teuthology.provision.fog.smithi117:FOG request: POST /host/222/task {"taskTypeID": 1} 2023-07-21T21:24:04.891 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-21T21:24:04.904 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:24:04.979 INFO:teuthology.orchestra.console:Power off smithi117 2023-07-21T21:24:04.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T21:24:04.994 INFO:teuthology.orchestra.console:Power off smithi038 2023-07-21T21:24:04.995 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T21:24:05.004 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:05.016 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:09.029 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:10.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:14.140 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:15.138 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:19.250 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:20.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:24.360 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:25.360 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:29.471 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:30.472 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:34.581 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:35.583 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:39.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:40.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:44.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:45.808 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:49.912 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:50.918 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:55.022 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:55.233 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2023-07-21T21:24:55.334 INFO:teuthology.orchestra.console:Power on smithi117 2023-07-21T21:24:55.334 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T21:24:55.355 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:56.029 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:24:59.380 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:25:01.139 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:25:03.494 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:25:03.783 INFO:teuthology.orchestra.console:Power on for smithi117 completed 2023-07-21T21:25:03.884 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2023-07-21T21:25:03.884 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:25:08.889 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:25:14.004 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:25:19.116 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:25:20.228 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-07-21T21:25:20.229 ERROR:teuthology.orchestra.console:Failed to power off smithi038 2023-07-21T21:25:20.229 INFO:teuthology.orchestra.console:Power on smithi038 2023-07-21T21:25:20.230 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T21:25:23.960 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:25:29.646 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:25:34.658 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:25:39.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:25:44.707 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:25:49.716 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:25:54.827 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T21:25:55.039 INFO:teuthology.orchestra.console:Power on for smithi038 completed 2023-07-21T21:25:55.141 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2023-07-21T21:25:55.141 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-21T21:26:04.784 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:26:11.704 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-21T21:26:24.856 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:26:31.772 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-21T21:26:39.918 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:26:51.836 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-21T21:26:59.980 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:27:11.900 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-21T21:27:20.044 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:27:31.967 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-21T21:27:45.112 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:27:51.516 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-21T21:28:05.180 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:28:11.571 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-21T21:28:25.274 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:28:30.480 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-21T21:28:45.372 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T21:28:50.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:28:55.457 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-21T21:29:00.461 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-07-21T21:29:00.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:29:00.619 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: Authentication failed. 2023-07-21T21:29:00.620 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T21:29:00.621 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T21:29:00.622 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T21:29:01.629 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T21:29:02.634 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T21:29:03.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T21:29:06.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:29:14.544 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-07-21T21:29:20.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:29:23.600 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-07-21T21:29:29.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:30:34.606 WARNING:teuthology.provision.fog.smithi117:timed out 2023-07-21T21:30:40.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:30:45.828 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T21:30:45.828 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T21:30:46.359 INFO:teuthology.provision.fog.smithi117:Node is ready 2023-07-21T21:30:46.359 DEBUG:teuthology.orchestra.run.smithi117:> hostname 2023-07-21T21:30:46.365 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com 2023-07-21T21:30:46.366 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts 2023-07-21T21:30:46.416 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117 2023-07-21T21:30:46.416 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2023-07-21T21:30:46.536 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts 2023-07-21T21:30:46.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts 2023-07-21T21:30:46.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname 2023-07-21T21:30:46.622 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2023-07-21T21:30:46.631 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-07-21T21:30:46.636 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2023-07-21T21:30:46.636 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-21T21:30:46.636 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2023-07-21T21:30:46.636 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2023-07-21T21:30:46.636 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-21T21:30:46.636 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="20.04" 2023-07-21T21:30:46.637 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T21:30:46.637 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T21:30:46.637 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T21:30:46.637 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T21:30:46.637 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=focal 2023-07-21T21:30:46.637 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=focal 2023-07-21T21:30:46.638 INFO:teuthology.provision.fog.smithi117:Deploy complete! 2023-07-21T21:30:46.639 DEBUG:teuthology.parallel:result is None 2023-07-21T21:30:52.400 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-21T21:30:52.402 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi038 2023-07-21T21:31:01.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-21T21:31:01.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:31:06.612 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-07-21T21:31:07.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-21T21:31:07.143 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T21:31:07.144 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T21:31:07.191 INFO:teuthology.provision.fog.smithi038:Node is ready 2023-07-21T21:31:07.191 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2023-07-21T21:31:07.198 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2023-07-21T21:31:07.199 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2023-07-21T21:31:07.248 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2023-07-21T21:31:07.249 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-07-21T21:31:07.328 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2023-07-21T21:31:07.345 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2023-07-21T21:31:07.406 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2023-07-21T21:31:07.416 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-07-21T21:31:07.426 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-07-21T21:31:07.431 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Ubuntu" 2023-07-21T21:31:07.431 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-21T21:31:07.431 INFO:teuthology.orchestra.run.smithi038.stdout:ID=ubuntu 2023-07-21T21:31:07.431 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE=debian 2023-07-21T21:31:07.431 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-21T21:31:07.432 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="20.04" 2023-07-21T21:31:07.432 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T21:31:07.432 INFO:teuthology.orchestra.run.smithi038.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T21:31:07.432 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T21:31:07.432 INFO:teuthology.orchestra.run.smithi038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T21:31:07.433 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_CODENAME=focal 2023-07-21T21:31:07.433 INFO:teuthology.orchestra.run.smithi038.stdout:UBUNTU_CODENAME=focal 2023-07-21T21:31:07.433 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2023-07-21T21:31:07.434 DEBUG:teuthology.parallel:result is None 2023-07-21T21:31:31.843 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2023-07-21T21:31:31.844 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T21:31:35.173 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com 2023-07-21T21:31:35.175 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2023-07-21T21:31:35.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-21T21:31:35.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:31:35.227 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-07-21T21:31:35.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-21T21:31:35.438 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-07-21T21:31:35.444 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-07-21T21:31:35.445 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-07-21T21:31:35.451 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Ubuntu" 2023-07-21T21:31:35.451 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-21T21:31:35.451 INFO:teuthology.orchestra.run.smithi038.stdout:ID=ubuntu 2023-07-21T21:31:35.451 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE=debian 2023-07-21T21:31:35.451 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-21T21:31:35.452 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="20.04" 2023-07-21T21:31:35.452 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T21:31:35.452 INFO:teuthology.orchestra.run.smithi038.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T21:31:35.452 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T21:31:35.452 INFO:teuthology.orchestra.run.smithi038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T21:31:35.452 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_CODENAME=focal 2023-07-21T21:31:35.452 INFO:teuthology.orchestra.run.smithi038.stdout:UBUNTU_CODENAME=focal 2023-07-21T21:31:35.453 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-07-21T21:31:35.482 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server 2023-07-21T21:31:35.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-07-21T21:31:35.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:31:35.530 DEBUG:teuthology.orchestra.run.smithi117:> true 2023-07-21T21:31:35.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-07-21T21:31:35.742 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2023-07-21T21:31:35.748 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2023-07-21T21:31:35.749 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-07-21T21:31:35.755 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2023-07-21T21:31:35.755 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-21T21:31:35.755 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2023-07-21T21:31:35.755 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2023-07-21T21:31:35.756 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-21T21:31:35.756 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="20.04" 2023-07-21T21:31:35.756 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T21:31:35.756 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T21:31:35.756 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T21:31:35.756 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T21:31:35.757 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=focal 2023-07-21T21:31:35.757 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=focal 2023-07-21T21:31:35.757 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-07-21T21:31:35.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:31:35.791 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:31:35.896 INFO:teuthology.dispatcher.supervisor:Running job 7346821 2023-07-21T21:31:35.896 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346821 --name yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346821/orig.config.yaml 2023-07-21T21:31:35.900 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346821 2023-07-21T21:31:35.901 INFO:teuthology.dispatcher.supervisor:Job PID: 21298 2023-07-21T21:31:35.901 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-21T21:33:36.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:33:36.002 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:35:41.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:35:41.193 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:37:46.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:37:46.361 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:39:46.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:39:46.690 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:41:46.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:41:46.858 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:43:47.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:43:47.222 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:45:52.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:45:52.414 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:47:56.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:47:56.762 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:50:01.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:50:01.934 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:52:07.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:52:07.122 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:54:12.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:54:12.319 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:56:17.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:56:17.485 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T21:58:22.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:58:22.654 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:00:27.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:00:27.826 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:02:32.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:02:32.942 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:04:38.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:04:38.126 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:06:43.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:06:43.295 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:08:43.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:08:43.477 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:10:43.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:10:43.650 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T22:10:48.715 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-21T22:10:53.842 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-21T22:10:53.843 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T22:10:53.897 DEBUG:teuthology.nuke:shortname: smithi038 2023-07-21T22:10:53.898 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T22:10:53.915 DEBUG:teuthology.nuke:shortname: smithi117 2023-07-21T22:10:53.916 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T22:10:53.920 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346821', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:23:58.527232', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-21T22:10:53.942 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346821', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:23:58.529314', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-21T22:10:53.967 INFO:teuthology.orchestra.console:Power off smithi038 2023-07-21T22:10:53.968 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T22:10:53.994 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:10:54.012 INFO:teuthology.orchestra.console:Power off smithi117 2023-07-21T22:10:54.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T22:10:54.035 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:10:54.124 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2023-07-21T22:10:54.156 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2023-07-21T22:10:54.283 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com 2023-07-21T22:10:54.309 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com