2023-08-30T19:44:31.570 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-30T19:44:31.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T19:44:31.724 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdd470c1670>, signals=[15]) 2023-08-30T19:44:31.725 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2023-08-30T19:44:31.726 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T19:44:31.726 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-08-30T19:44:31.742 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2023-08-30T19:44:31.742 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T19:44:31.743 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-08-30T19:44:31.744 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"} 2023-08-30T19:44:31.767 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"} 2023-08-30T19:44:31.817 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-30T19:44:31.840 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-30T19:44:31.860 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-30T19:44:31.861 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 6} 2023-08-30T19:44:31.880 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-30T19:44:31.880 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 6} 2023-08-30T19:44:31.898 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of ubuntu 22.04 2023-08-30T19:44:31.899 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:44:31.924 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of ubuntu 22.04 2023-08-30T19:44:31.924 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:44:31.991 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T19:44:31.999 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T19:44:32.025 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1} 2023-08-30T19:44:32.038 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1} 2023-08-30T19:44:32.082 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:44:32.092 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:44:32.204 INFO:teuthology.orchestra.console.smithi104:Power off 2023-08-30T19:44:32.205 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T19:44:32.218 INFO:teuthology.orchestra.console.smithi111:Power off 2023-08-30T19:44:32.219 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T19:44:32.252 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-08-30T19:44:32.252 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T19:44:32.258 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-08-30T19:44:32.258 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T19:44:32.271 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-08-30T19:44:32.277 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-30T19:44:32.372 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-08-30T19:44:32.378 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-08-30T19:44:32.474 INFO:teuthology.orchestra.console.smithi111:Power on 2023-08-30T19:44:32.474 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T19:44:32.481 INFO:teuthology.orchestra.console.smithi104:Power on 2023-08-30T19:44:32.481 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T19:44:32.495 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On 2023-08-30T19:44:32.496 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T19:44:32.503 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On 2023-08-30T19:44:32.503 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T19:44:32.515 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-08-30T19:44:32.527 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-30T19:44:36.518 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T19:44:36.528 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T19:44:36.627 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-08-30T19:44:36.636 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-30T19:44:40.630 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T19:44:40.637 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T19:44:40.752 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-08-30T19:44:40.807 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-08-30T19:44:40.853 INFO:teuthology.orchestra.console.smithi104:Power on completed 2023-08-30T19:44:40.909 INFO:teuthology.orchestra.console.smithi111:Power on completed 2023-08-30T19:44:40.954 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2023-08-30T19:44:40.955 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:44:41.010 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2023-08-30T19:44:41.010 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:44:56.112 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:44:56.138 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:45:11.306 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:45:11.334 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:45:26.517 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:45:26.523 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:45:41.721 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:45:41.723 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:45:56.934 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:45:56.936 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:46:12.165 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:46:12.166 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:46:27.404 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:46:27.405 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:46:42.690 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:46:42.692 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:46:57.963 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:46:57.964 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:47:13.365 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:47:13.366 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:47:28.909 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:47:28.914 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:47:45.218 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:47:45.260 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:48:01.797 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:48:02.226 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:48:17.154 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-08-30T19:48:17.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:48:18.523 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:48:20.506 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T19:48:26.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:48:29.594 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T19:48:34.806 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:48:35.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:48:38.650 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T19:48:44.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:48:47.738 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T19:48:50.386 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:48:53.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:48:56.794 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T19:49:02.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:49:05.754 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:49:05.882 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-08-30T19:49:11.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:49:21.062 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:49:36.321 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:49:51.637 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:50:06.866 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:50:11.907 WARNING:teuthology.provision.fog.smithi104:timed out 2023-08-30T19:50:17.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:50:18.194 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T19:50:18.195 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T19:50:18.678 INFO:teuthology.provision.fog.smithi104:Node is ready 2023-08-30T19:50:18.678 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2023-08-30T19:50:18.730 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2023-08-30T19:50:18.731 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts 2023-08-30T19:50:18.778 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2023-08-30T19:50:18.779 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-08-30T19:50:18.950 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts 2023-08-30T19:50:18.964 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2023-08-30T19:50:19.022 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname 2023-08-30T19:50:19.082 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-08-30T19:50:19.137 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-08-30T19:50:19.186 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-30T19:50:19.187 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu" 2023-08-30T19:50:19.187 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="22.04" 2023-08-30T19:50:19.187 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-30T19:50:19.187 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=jammy 2023-08-30T19:50:19.188 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu 2023-08-30T19:50:19.188 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian 2023-08-30T19:50:19.188 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-30T19:50:19.188 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-30T19:50:19.188 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-30T19:50:19.189 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-30T19:50:19.189 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=jammy 2023-08-30T19:50:19.190 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2023-08-30T19:50:19.191 DEBUG:teuthology.parallel:result is None 2023-08-30T19:50:22.094 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:50:37.332 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:50:52.527 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:51:07.706 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:51:22.886 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:51:38.038 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:51:53.178 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:52:08.307 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:52:23.425 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:52:38.527 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:52:53.618 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:53:08.698 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-30T19:53:08.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:53:11.834 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-30T19:53:17.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:53:20.922 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-30T19:53:26.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:53:30.010 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-30T19:53:36.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:53:39.066 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-30T19:53:45.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:53:48.122 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-30T19:53:54.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:53:57.210 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-30T19:54:03.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:54:06.266 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-30T19:54:12.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:54:15.354 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-30T19:54:21.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:55:21.418 WARNING:teuthology.provision.fog.smithi111:timed out 2023-08-30T19:55:27.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:55:27.545 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T19:55:27.546 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T19:55:28.001 INFO:teuthology.provision.fog.smithi111:Node is ready 2023-08-30T19:55:28.002 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2023-08-30T19:55:28.047 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2023-08-30T19:55:28.048 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2023-08-30T19:55:28.096 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2023-08-30T19:55:28.097 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-08-30T19:55:28.251 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2023-08-30T19:55:28.264 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2023-08-30T19:55:28.319 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2023-08-30T19:55:28.379 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-08-30T19:55:28.434 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-08-30T19:55:28.479 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-30T19:55:28.480 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2023-08-30T19:55:28.480 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2023-08-30T19:55:28.480 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-30T19:55:28.480 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2023-08-30T19:55:28.481 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2023-08-30T19:55:28.481 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2023-08-30T19:55:28.481 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-30T19:55:28.481 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-30T19:55:28.481 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-30T19:55:28.482 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-30T19:55:28.482 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2023-08-30T19:55:28.482 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2023-08-30T19:55:28.483 DEBUG:teuthology.parallel:result is None 2023-08-30T19:55:28.660 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2023-08-30T19:55:28.660 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T19:55:28.690 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2023-08-30T19:55:28.690 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T19:55:28.707 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2023-08-30T19:55:28.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-08-30T19:55:28.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:55:28.786 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-08-30T19:55:29.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-08-30T19:55:29.014 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2023-08-30T19:55:29.065 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2023-08-30T19:55:29.065 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-08-30T19:55:29.113 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-30T19:55:29.113 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu" 2023-08-30T19:55:29.113 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="22.04" 2023-08-30T19:55:29.113 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-30T19:55:29.113 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=jammy 2023-08-30T19:55:29.114 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu 2023-08-30T19:55:29.114 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian 2023-08-30T19:55:29.114 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-30T19:55:29.114 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-30T19:55:29.114 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-30T19:55:29.115 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-30T19:55:29.115 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=jammy 2023-08-30T19:55:29.115 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-08-30T19:55:29.140 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2023-08-30T19:55:29.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-08-30T19:55:29.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T19:55:29.217 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-08-30T19:55:29.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-08-30T19:55:29.326 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2023-08-30T19:55:29.371 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2023-08-30T19:55:29.372 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-08-30T19:55:29.419 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-30T19:55:29.419 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2023-08-30T19:55:29.420 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2023-08-30T19:55:29.420 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-30T19:55:29.420 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2023-08-30T19:55:29.420 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2023-08-30T19:55:29.421 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2023-08-30T19:55:29.421 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-30T19:55:29.421 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-30T19:55:29.421 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-30T19:55:29.421 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-30T19:55:29.422 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2023-08-30T19:55:29.422 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-08-30T19:55:29.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T19:55:29.525 INFO:teuthology.dispatcher.supervisor:Running job 7384645 2023-08-30T19:55:29.525 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2023-08-30_19:44:18-rbd-wip-dis-testing-distro-default-smithi/7384645 --name dis-2023-08-30_19:44:18-rbd-wip-dis-testing-distro-default-smithi --description rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests_no_locking} -- /home/teuthworker/archive/dis-2023-08-30_19:44:18-rbd-wip-dis-testing-distro-default-smithi/7384645/orig.config.yaml 2023-08-30T19:55:29.528 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2023-08-30_19:44:18-rbd-wip-dis-testing-distro-default-smithi/7384645 2023-08-30T19:55:29.528 INFO:teuthology.dispatcher.supervisor:Job PID: 2229695 2023-08-30T19:55:29.529 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T19:57:29.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T19:57:29.687 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T19:57:29.785 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T19:57:29.785 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T19:57:29.838 DEBUG:teuthology.nuke:shortname: smithi104 2023-08-30T19:57:29.839 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T19:57:29.858 DEBUG:teuthology.nuke:shortname: smithi111 2023-08-30T19:57:29.859 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T19:57:29.862 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-08-30_19:44:18-rbd-wip-dis-testing-distro-default-smithi/7384645', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 19:44:30.821377', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICflDL9aLMEDRJKZm+e7Cx+k9cKYoAQwRFyARMDtON+O'} 2023-08-30T19:57:29.884 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-08-30_19:44:18-rbd-wip-dis-testing-distro-default-smithi/7384645', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 19:44:30.822589', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDHkwkiuLwMMraLu0frDbI4V4fdIKdkOyMktAqo7tRI6'} 2023-08-30T19:57:29.913 INFO:teuthology.orchestra.console.smithi104:Power off 2023-08-30T19:57:29.913 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T19:57:29.935 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-08-30T19:57:29.936 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T19:57:29.953 INFO:teuthology.orchestra.console.smithi111:Power off 2023-08-30T19:57:29.954 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T19:57:29.963 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-08-30T19:57:29.975 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-08-30T19:57:29.975 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T19:57:29.996 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-08-30T19:57:30.064 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-08-30T19:57:30.098 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-08-30T19:57:30.211 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com 2023-08-30T19:57:30.245 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com