2023-07-07T14:24:17.671 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-07T14:24:17.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T14:24:17.672 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T14:24:17.805 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2f1e6dcee0>, signals=[15]) 2023-07-07T14:24:17.807 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2023-07-07T14:24:17.807 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2023-07-07T14:24:17.808 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-07-07T14:24:17.829 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-07-07T14:24:17.830 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-07-07T14:24:17.830 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-07-07T14:24:17.831 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /host {"name": "smithi069"} 2023-07-07T14:24:17.854 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /host {"name": "smithi156"} 2023-07-07T14:24:17.899 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-07T14:24:17.921 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-07T14:24:17.947 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-07T14:24:17.947 DEBUG:teuthology.provision.fog.smithi069:FOG request: PUT /host/174 {"imageID": 2} 2023-07-07T14:24:17.962 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-07T14:24:17.962 DEBUG:teuthology.provision.fog.smithi156:FOG request: PUT /host/261 {"imageID": 2} 2023-07-07T14:24:17.996 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of ubuntu 20.04 2023-07-07T14:24:17.996 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:24:18.027 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of ubuntu 20.04 2023-07-07T14:24:18.028 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:24:18.102 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /tasktype {"name": "deploy"} 2023-07-07T14:24:18.122 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /tasktype {"name": "deploy"} 2023-07-07T14:24:18.148 DEBUG:teuthology.provision.fog.smithi069:FOG request: POST /host/174/task {"taskTypeID": 1} 2023-07-07T14:24:18.160 DEBUG:teuthology.provision.fog.smithi156:FOG request: POST /host/261/task {"taskTypeID": 1} 2023-07-07T14:24:18.211 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:24:18.231 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:24:18.339 INFO:teuthology.orchestra.console:Power off smithi069 2023-07-07T14:24:18.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-07T14:24:18.354 INFO:teuthology.orchestra.console:Power off smithi156 2023-07-07T14:24:18.355 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-07T14:24:18.365 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T14:24:18.376 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T14:24:18.488 INFO:teuthology.orchestra.console:Power off for smithi069 completed 2023-07-07T14:24:18.589 INFO:teuthology.orchestra.console:Power on smithi069 2023-07-07T14:24:18.589 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-07T14:24:18.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T14:24:22.401 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T14:24:22.633 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T14:24:26.518 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T14:24:26.730 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2023-07-07T14:24:26.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T14:24:26.832 INFO:teuthology.orchestra.console:Power on smithi156 2023-07-07T14:24:26.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-07T14:24:26.855 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T14:24:27.051 INFO:teuthology.orchestra.console:Power on for smithi069 completed 2023-07-07T14:24:27.152 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2023-07-07T14:24:27.152 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:24:30.884 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T14:24:31.094 INFO:teuthology.orchestra.console:Power on for smithi156 completed 2023-07-07T14:24:31.194 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-07-07T14:24:31.195 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:24:42.385 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:24:46.381 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:24:57.588 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:25:01.604 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:25:12.776 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:25:16.802 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:25:27.980 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:25:31.984 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:25:43.160 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:25:47.214 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:25:58.407 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:26:02.446 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:26:13.609 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:26:17.668 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:26:28.956 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:26:32.917 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:26:56.746 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:26:58.715 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:27:12.547 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:27:15.192 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:27:28.154 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:27:30.471 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:27:43.536 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:27:45.716 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:27:58.780 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:28:00.990 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:28:14.175 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:28:16.216 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:28:29.460 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:28:31.476 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:28:44.692 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:28:46.755 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:28:59.944 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-07T14:29:00.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:29:01.987 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:29:17.253 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:29:18.576 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-07T14:29:24.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:29:27.664 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-07T14:29:32.563 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:29:33.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:29:36.720 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-07T14:29:42.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:29:45.808 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-07T14:29:47.874 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:29:51.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:29:54.864 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-07T14:30:00.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:30:03.172 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:30:18.462 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:30:33.748 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:30:49.079 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:31:00.884 WARNING:teuthology.provision.fog.smithi069:timed out 2023-07-07T14:31:04.307 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:31:06.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:31:07.120 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-07T14:31:07.121 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-07T14:31:07.555 INFO:teuthology.provision.fog.smithi069:Node is ready 2023-07-07T14:31:07.556 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2023-07-07T14:31:07.562 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com 2023-07-07T14:31:07.562 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts 2023-07-07T14:31:07.613 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2023-07-07T14:31:07.613 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-07-07T14:31:07.723 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts 2023-07-07T14:31:07.739 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2023-07-07T14:31:07.749 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname 2023-07-07T14:31:07.760 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-07-07T14:31:07.817 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-07-07T14:31:07.821 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Ubuntu" 2023-07-07T14:31:07.821 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-07T14:31:07.821 INFO:teuthology.orchestra.run.smithi069.stdout:ID=ubuntu 2023-07-07T14:31:07.822 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE=debian 2023-07-07T14:31:07.822 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-07T14:31:07.822 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="20.04" 2023-07-07T14:31:07.822 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-07T14:31:07.822 INFO:teuthology.orchestra.run.smithi069.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-07T14:31:07.822 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-07T14:31:07.822 INFO:teuthology.orchestra.run.smithi069.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-07T14:31:07.823 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_CODENAME=focal 2023-07-07T14:31:07.823 INFO:teuthology.orchestra.run.smithi069.stdout:UBUNTU_CODENAME=focal 2023-07-07T14:31:07.823 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2023-07-07T14:31:07.825 DEBUG:teuthology.parallel:result is None 2023-07-07T14:31:19.593 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:31:34.856 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:31:50.113 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:32:05.428 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:32:20.685 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:32:35.941 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:32:51.180 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:33:06.408 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:33:21.628 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:33:36.874 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:33:52.065 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:34:07.272 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:34:22.468 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:34:37.657 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:34:52.871 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:35:08.064 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-07-07T14:35:08.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:35:11.284 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-07-07T14:35:17.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:35:20.368 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-07-07T14:35:26.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:35:29.456 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-07-07T14:35:35.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:35:38.512 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-07-07T14:35:44.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:35:47.600 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-07-07T14:35:53.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:35:56.688 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-07-07T14:36:02.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:36:05.776 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-07-07T14:36:11.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:37:11.844 WARNING:teuthology.provision.fog.smithi156:timed out 2023-07-07T14:37:17.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:37:18.061 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-07T14:37:18.062 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-07T14:37:18.547 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-07-07T14:37:18.548 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-07-07T14:37:18.554 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2023-07-07T14:37:18.554 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2023-07-07T14:37:18.604 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2023-07-07T14:37:18.605 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-07-07T14:37:18.709 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2023-07-07T14:37:18.724 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2023-07-07T14:37:18.783 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2023-07-07T14:37:18.794 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-07-07T14:37:18.804 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-07-07T14:37:18.808 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu" 2023-07-07T14:37:18.809 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-07T14:37:18.809 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu 2023-07-07T14:37:18.809 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian 2023-07-07T14:37:18.809 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-07T14:37:18.809 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="20.04" 2023-07-07T14:37:18.809 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-07T14:37:18.809 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-07T14:37:18.810 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-07T14:37:18.810 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-07T14:37:18.810 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=focal 2023-07-07T14:37:18.810 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=focal 2023-07-07T14:37:18.810 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-07-07T14:37:18.811 DEBUG:teuthology.parallel:result is None 2023-07-07T14:37:19.045 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2023-07-07T14:37:19.046 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-07T14:37:19.081 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2023-07-07T14:37:19.081 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-07T14:37:19.106 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2023-07-07T14:37:19.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-07-07T14:37:19.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:37:19.156 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-07-07T14:37:19.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-07-07T14:37:19.358 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-07-07T14:37:19.364 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-07-07T14:37:19.364 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-07-07T14:37:19.370 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Ubuntu" 2023-07-07T14:37:19.371 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-07T14:37:19.371 INFO:teuthology.orchestra.run.smithi069.stdout:ID=ubuntu 2023-07-07T14:37:19.371 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE=debian 2023-07-07T14:37:19.371 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-07T14:37:19.371 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="20.04" 2023-07-07T14:37:19.372 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-07T14:37:19.372 INFO:teuthology.orchestra.run.smithi069.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-07T14:37:19.372 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-07T14:37:19.372 INFO:teuthology.orchestra.run.smithi069.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-07T14:37:19.372 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_CODENAME=focal 2023-07-07T14:37:19.372 INFO:teuthology.orchestra.run.smithi069.stdout:UBUNTU_CODENAME=focal 2023-07-07T14:37:19.373 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-07-07T14:37:19.405 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2023-07-07T14:37:19.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-07-07T14:37:19.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T14:37:19.455 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-07-07T14:37:19.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-07-07T14:37:19.578 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-07-07T14:37:19.584 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-07-07T14:37:19.585 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-07-07T14:37:19.632 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu" 2023-07-07T14:37:19.632 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-07T14:37:19.632 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu 2023-07-07T14:37:19.632 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian 2023-07-07T14:37:19.632 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-07T14:37:19.632 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="20.04" 2023-07-07T14:37:19.633 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-07T14:37:19.633 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-07T14:37:19.633 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-07T14:37:19.633 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-07T14:37:19.633 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=focal 2023-07-07T14:37:19.633 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=focal 2023-07-07T14:37:19.634 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-07-07T14:37:19.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T14:37:19.655 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T14:37:19.759 INFO:teuthology.dispatcher.supervisor:Running job 7328379 2023-07-07T14:37:19.760 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-07-07_14:22:08-upgrade:octopus-x-quincy-distro-default-smithi/7328379 --name teuthology-2023-07-07_14:22:08-upgrade:octopus-x-quincy-distro-default-smithi --description upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-07-07_14:22:08-upgrade:octopus-x-quincy-distro-default-smithi/7328379/orig.config.yaml 2023-07-07T14:37:19.763 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-07-07_14:22:08-upgrade:octopus-x-quincy-distro-default-smithi/7328379 2023-07-07T14:37:19.764 INFO:teuthology.dispatcher.supervisor:Job PID: 5377 2023-07-07T14:37:19.764 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-07T14:39:19.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T14:39:19.860 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T14:41:20.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T14:41:20.033 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T14:43:20.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T14:43:20.207 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T14:45:20.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T14:45:20.403 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T14:47:20.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T14:47:20.636 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T14:49:20.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T14:49:20.837 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T14:49:20.905 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-07T14:49:21.059 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-07T14:49:21.060 INFO:teuthology.nuke:Checking targets against current locks 2023-07-07T14:49:21.119 DEBUG:teuthology.nuke:shortname: smithi069 2023-07-07T14:49:21.120 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-07T14:49:21.147 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-07-07_14:22:08-upgrade:octopus-x-quincy-distro-default-smithi/7328379', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-07 14:24:16.854297', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-07-07T14:49:21.150 DEBUG:teuthology.nuke:shortname: smithi156 2023-07-07T14:49:21.150 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-07T14:49:21.172 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-07-07_14:22:08-upgrade:octopus-x-quincy-distro-default-smithi/7328379', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-07 14:24:16.852984', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-07T14:49:21.213 INFO:teuthology.orchestra.console:Power off smithi069 2023-07-07T14:49:21.214 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-07T14:49:21.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T14:49:21.263 INFO:teuthology.orchestra.console:Power off smithi156 2023-07-07T14:49:21.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-07T14:49:21.294 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T14:49:21.377 INFO:teuthology.orchestra.console:Power off for smithi069 completed 2023-07-07T14:49:21.422 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2023-07-07T14:49:21.540 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com 2023-07-07T14:49:21.580 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com