2023-08-30T18:18:09.833 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-30T18:18:09.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T18:18:09.963 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feeb9753670>, signals=[15]) 2023-08-30T18:18:09.964 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging 2023-08-30T18:18:09.965 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T18:18:09.965 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-08-30T18:18:09.982 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2023-08-30T18:18:09.983 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T18:18:09.983 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-08-30T18:18:09.984 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /host {"name": "smithi053"} 2023-08-30T18:18:10.007 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /host {"name": "smithi188"} 2023-08-30T18:18:10.065 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T18:18:10.079 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T18:18:10.105 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T18:18:10.105 DEBUG:teuthology.provision.fog.smithi053:FOG request: PUT /host/158 {"imageID": 10} 2023-08-30T18:18:10.124 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T18:18:10.124 DEBUG:teuthology.provision.fog.smithi188:FOG request: PUT /host/293 {"imageID": 10} 2023-08-30T18:18:10.150 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of centos 9.stream 2023-08-30T18:18:10.150 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:18:10.170 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 9.stream 2023-08-30T18:18:10.171 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:18:10.296 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T18:18:10.314 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T18:18:10.339 DEBUG:teuthology.provision.fog.smithi053:FOG request: POST /host/158/task {"taskTypeID": 1} 2023-08-30T18:18:10.356 DEBUG:teuthology.provision.fog.smithi188:FOG request: POST /host/293/task {"taskTypeID": 1} 2023-08-30T18:18:10.390 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:18:10.494 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:18:10.653 INFO:teuthology.orchestra.console.smithi053:Power off 2023-08-30T18:18:10.654 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T18:18:10.676 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-08-30T18:18:10.676 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:10.695 INFO:teuthology.orchestra.console.smithi188:Power off 2023-08-30T18:18:10.695 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T18:18:10.704 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-08-30T18:18:10.715 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-08-30T18:18:10.716 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:10.736 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-08-30T18:18:10.837 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-08-30T18:18:10.938 INFO:teuthology.orchestra.console.smithi188:Power on 2023-08-30T18:18:10.938 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T18:18:10.958 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On 2023-08-30T18:18:10.959 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:10.979 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-08-30T18:18:14.706 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:14.813 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-08-30T18:18:14.980 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:15.088 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-08-30T18:18:18.818 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:18.926 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-08-30T18:18:19.027 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-08-30T18:18:19.089 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:19.129 INFO:teuthology.orchestra.console.smithi053:Power on 2023-08-30T18:18:19.130 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T18:18:19.150 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On 2023-08-30T18:18:19.151 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:19.173 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-08-30T18:18:19.304 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-08-30T18:18:19.405 INFO:teuthology.orchestra.console.smithi188:Power on completed 2023-08-30T18:18:19.506 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2023-08-30T18:18:19.507 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:18:23.178 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:23.287 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-08-30T18:18:27.290 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:27.399 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-08-30T18:18:27.500 INFO:teuthology.orchestra.console.smithi053:Power on completed 2023-08-30T18:18:27.601 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2023-08-30T18:18:27.602 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:18:34.690 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:18:42.862 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:18:49.902 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:18:58.079 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:19:05.116 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:19:13.310 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:19:20.322 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:19:28.569 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:19:35.572 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:19:43.866 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:19:50.874 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:19:59.194 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:20:06.276 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:20:14.614 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:20:21.585 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:20:29.972 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:20:36.897 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:20:45.366 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:20:52.176 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:21:00.790 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:21:07.524 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:21:16.194 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:21:22.922 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:21:31.539 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:21:38.305 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:21:46.903 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:21:53.743 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:22:02.206 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:22:09.053 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:22:17.513 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:22:24.338 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:22:32.810 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:22:39.577 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:22:48.038 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:22:54.782 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:23:03.287 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:23:10.019 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:23:18.476 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:23:25.229 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:23:33.666 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:23:40.458 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:23:48.871 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:23:55.690 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:24:04.043 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:24:10.866 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:24:19.216 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:24:26.056 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:24:34.381 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:24:41.232 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:24:49.517 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:24:56.366 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:25:04.654 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:25:11.490 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:25:19.808 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:25:26.626 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-30T18:25:26.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:25:29.818 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-30T18:25:34.914 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-30T18:25:35.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:25:35.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:25:38.078 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-08-30T18:25:38.874 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-30T18:25:44.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:25:44.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:25:47.162 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-08-30T18:25:47.930 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-30T18:25:53.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:25:53.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:25:56.218 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-08-30T18:25:56.986 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-30T18:26:02.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:02.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:05.278 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-08-30T18:26:06.042 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-30T18:26:11.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:12.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:15.102 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-30T18:26:21.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:39.642 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-30T18:26:45.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:48.703 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-30T18:26:54.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:54.896 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T18:26:54.897 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T18:27:11.284 WARNING:teuthology.provision.fog.smithi053:timed out 2023-08-30T18:27:17.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:27:17.493 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T18:27:17.494 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T18:27:17.802 INFO:teuthology.provision.fog.smithi053:Node is ready 2023-08-30T18:27:17.803 DEBUG:teuthology.orchestra.run.smithi053:> hostname 2023-08-30T18:27:17.818 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2023-08-30T18:27:17.819 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts 2023-08-30T18:27:17.874 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2023-08-30T18:27:17.875 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-08-30T18:27:18.014 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts 2023-08-30T18:27:18.047 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts 2023-08-30T18:27:18.119 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname 2023-08-30T18:27:18.190 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-08-30T18:27:18.261 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-08-30T18:27:18.317 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2023-08-30T18:27:18.317 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2023-08-30T18:27:18.317 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2023-08-30T18:27:18.317 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2023-08-30T18:27:18.318 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2023-08-30T18:27:18.318 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2023-08-30T18:27:18.318 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T18:27:18.318 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-08-30T18:27:18.319 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2023-08-30T18:27:18.319 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T18:27:18.319 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2023-08-30T18:27:18.319 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T18:27:18.319 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T18:27:18.320 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T18:27:18.320 INFO:teuthology.provision.fog.smithi053:Deploy complete! 2023-08-30T18:27:18.322 DEBUG:teuthology.parallel:result is None 2023-08-30T18:27:20.253 INFO:teuthology.provision.fog.smithi188:Node is ready 2023-08-30T18:27:20.253 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2023-08-30T18:27:20.272 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2023-08-30T18:27:20.272 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2023-08-30T18:27:20.330 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2023-08-30T18:27:20.331 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-08-30T18:27:20.448 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2023-08-30T18:27:20.479 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2023-08-30T18:27:20.550 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2023-08-30T18:27:20.621 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-08-30T18:27:20.690 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-08-30T18:27:20.746 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2023-08-30T18:27:20.746 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2023-08-30T18:27:20.746 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2023-08-30T18:27:20.747 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2023-08-30T18:27:20.747 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2023-08-30T18:27:20.747 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2023-08-30T18:27:20.747 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T18:27:20.747 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-08-30T18:27:20.747 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2023-08-30T18:27:20.748 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T18:27:20.748 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2023-08-30T18:27:20.748 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T18:27:20.748 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T18:27:20.748 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T18:27:20.749 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2023-08-30T18:27:20.749 DEBUG:teuthology.parallel:result is None 2023-08-30T18:27:20.904 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com 2023-08-30T18:27:20.904 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T18:27:20.929 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2023-08-30T18:27:20.929 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T18:27:20.946 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server 2023-08-30T18:27:20.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-08-30T18:27:20.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:27:21.050 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-08-30T18:27:21.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-08-30T18:27:21.126 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-08-30T18:27:21.185 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-08-30T18:27:21.185 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-08-30T18:27:21.245 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2023-08-30T18:27:21.245 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2023-08-30T18:27:21.246 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2023-08-30T18:27:21.246 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2023-08-30T18:27:21.246 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2023-08-30T18:27:21.246 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2023-08-30T18:27:21.246 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T18:27:21.247 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-08-30T18:27:21.247 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2023-08-30T18:27:21.247 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T18:27:21.247 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2023-08-30T18:27:21.248 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T18:27:21.248 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T18:27:21.248 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T18:27:21.248 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-08-30T18:27:21.271 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2023-08-30T18:27:21.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-08-30T18:27:21.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:27:21.352 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-08-30T18:27:21.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-08-30T18:27:21.422 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2023-08-30T18:27:21.478 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-08-30T18:27:21.478 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-08-30T18:27:21.534 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2023-08-30T18:27:21.534 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2023-08-30T18:27:21.534 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2023-08-30T18:27:21.534 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2023-08-30T18:27:21.535 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2023-08-30T18:27:21.535 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2023-08-30T18:27:21.535 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T18:27:21.535 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-08-30T18:27:21.535 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2023-08-30T18:27:21.536 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T18:27:21.536 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2023-08-30T18:27:21.536 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T18:27:21.536 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T18:27:21.536 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T18:27:21.537 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-08-30T18:27:21.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T18:27:21.647 INFO:teuthology.dispatcher.supervisor:Running job 7384520 2023-08-30T18:27:21.647 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-30_18:16:37-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384520 --name yuriw-2023-08-30_18:16:37-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi --description rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} -- /home/teuthworker/archive/yuriw-2023-08-30_18:16:37-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384520/orig.config.yaml 2023-08-30T18:27:21.651 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-30_18:16:37-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384520 2023-08-30T18:27:21.651 INFO:teuthology.dispatcher.supervisor:Job PID: 1836829 2023-08-30T18:27:21.652 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T18:29:21.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T18:29:21.821 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T18:29:21.903 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T18:29:21.904 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T18:29:21.953 DEBUG:teuthology.nuke:shortname: smithi053 2023-08-30T18:29:21.954 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T18:29:21.978 DEBUG:teuthology.nuke:shortname: smithi188 2023-08-30T18:29:21.979 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T18:29:21.982 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-30_18:16:37-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384520', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 18:18:09.104769', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMA55wfZuBB+apKcos/paaoav5onpk5rYpcMUjzHycvSTWPUQ8kyzKGelK//xk5uNgIZ3eFr1FskjIPkoXT5Rss='} 2023-08-30T18:29:22.004 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-30_18:16:37-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384520', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 18:18:09.102984', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBU8oE3xAgGXQWe+crpRV3s6dTtmrEGDj2NKfXrIFOVCDcHSpO9VPyJHouHZ2PdQzt90VWyYaSCl5ix6NQ40ghA='} 2023-08-30T18:29:22.038 INFO:teuthology.orchestra.console.smithi053:Power off 2023-08-30T18:29:22.038 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T18:29:22.060 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-08-30T18:29:22.060 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:29:22.073 INFO:teuthology.orchestra.console.smithi188:Power off 2023-08-30T18:29:22.074 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T18:29:22.084 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-08-30T18:29:22.095 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-08-30T18:29:22.096 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:29:22.116 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-08-30T18:29:22.186 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-08-30T18:29:22.218 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-08-30T18:29:22.336 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com 2023-08-30T18:29:22.370 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com