2023-10-18T15:48:37.073 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-18T15:48:37.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T15:48:37.202 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fda3d602670>, signals=[15]) 2023-10-18T15:48:37.203 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-10-18T15:48:37.204 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T15:48:37.204 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-10-18T15:48:37.227 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-10-18T15:48:37.228 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T15:48:37.228 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-10-18T15:48:37.229 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-10-18T15:48:37.252 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-10-18T15:48:37.301 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-18T15:48:37.323 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-18T15:48:37.342 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_centos_8.stream (ID 3) 2023-10-18T15:48:37.343 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 3} 2023-10-18T15:48:37.365 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_centos_8.stream (ID 3) 2023-10-18T15:48:37.366 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 3} 2023-10-18T15:48:37.389 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 8.stream 2023-10-18T15:48:37.389 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:48:37.414 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of centos 8.stream 2023-10-18T15:48:37.414 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:48:37.436 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T15:48:37.463 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T15:48:37.485 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-10-18T15:48:37.503 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-10-18T15:48:37.541 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:48:37.631 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:48:37.689 INFO:teuthology.orchestra.console.smithi125:Power off 2023-10-18T15:48:37.690 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T15:48:37.714 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-10-18T15:48:37.714 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T15:48:37.727 INFO:teuthology.orchestra.console.smithi139:Power off 2023-10-18T15:48:37.728 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T15:48:37.737 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-18T15:48:37.750 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-10-18T15:48:37.750 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T15:48:37.772 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-18T15:48:41.738 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T15:48:41.773 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T15:48:41.848 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-18T15:48:41.883 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-18T15:48:45.850 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T15:48:45.884 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T15:48:45.960 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-18T15:48:45.993 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-18T15:48:49.964 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T15:48:49.994 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T15:48:50.073 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-18T15:48:50.103 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-18T15:48:50.174 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-10-18T15:48:50.205 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-10-18T15:48:50.276 INFO:teuthology.orchestra.console.smithi125:Power on 2023-10-18T15:48:50.277 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T15:48:50.300 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On 2023-10-18T15:48:50.300 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T15:48:50.308 INFO:teuthology.orchestra.console.smithi139:Power on 2023-10-18T15:48:50.308 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T15:48:50.321 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-18T15:48:50.329 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On 2023-10-18T15:48:50.329 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T15:48:50.352 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-18T15:48:54.326 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T15:48:54.354 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T15:48:54.435 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-18T15:48:54.464 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-18T15:48:54.565 INFO:teuthology.orchestra.console.smithi139:Power on completed 2023-10-18T15:48:54.666 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-10-18T15:48:54.667 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:48:58.438 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T15:48:58.547 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-18T15:48:58.648 INFO:teuthology.orchestra.console.smithi125:Power on completed 2023-10-18T15:48:58.748 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-10-18T15:48:58.749 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:49:09.750 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:49:13.829 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:49:24.838 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:49:28.903 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:49:39.914 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:49:43.975 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:49:54.994 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:49:59.052 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:50:10.070 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:50:14.118 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:50:25.145 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:50:29.194 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:50:40.220 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:50:44.266 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:50:55.294 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:50:59.342 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:51:10.366 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:51:14.418 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:51:25.434 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:51:29.490 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:51:40.502 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-18T15:51:40.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:51:44.551 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-18T15:51:44.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:51:59.098 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-18T15:52:02.938 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-18T15:52:05.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:52:08.190 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-18T15:52:08.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:52:11.998 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-18T15:52:14.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:52:17.278 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-18T15:52:18.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:52:21.050 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-18T15:52:23.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:52:26.362 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-18T15:52:27.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:52:30.106 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-18T15:52:32.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:52:36.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:52:50.817 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-18T15:52:56.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:52:59.898 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-18T15:53:05.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:53:06.216 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T15:53:06.217 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T15:53:31.752 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-10-18T15:53:31.753 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-10-18T15:53:31.777 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-10-18T15:53:31.777 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-10-18T15:53:31.838 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-10-18T15:53:31.839 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-10-18T15:53:31.979 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-10-18T15:53:32.012 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-10-18T15:53:32.082 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-10-18T15:53:32.153 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-10-18T15:53:32.222 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-10-18T15:53:32.281 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2023-10-18T15:53:32.281 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8" 2023-10-18T15:53:32.282 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2023-10-18T15:53:32.282 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2023-10-18T15:53:32.282 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8" 2023-10-18T15:53:32.282 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-10-18T15:53:32.283 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-18T15:53:32.283 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-10-18T15:53:32.283 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-18T15:53:32.283 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2023-10-18T15:53:32.284 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T15:53:32.284 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T15:53:32.284 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T15:53:32.285 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-10-18T15:53:32.286 DEBUG:teuthology.parallel:result is None 2023-10-18T15:53:36.114 WARNING:teuthology.provision.fog.smithi125:timed out 2023-10-18T15:53:42.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:53:42.376 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T15:53:42.377 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T15:53:42.630 INFO:teuthology.provision.fog.smithi125:Node is ready 2023-10-18T15:53:42.630 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2023-10-18T15:53:42.652 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2023-10-18T15:53:42.652 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts 2023-10-18T15:53:42.714 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2023-10-18T15:53:42.714 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-10-18T15:53:42.813 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts 2023-10-18T15:53:42.848 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2023-10-18T15:53:42.922 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname 2023-10-18T15:53:42.995 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-10-18T15:53:43.064 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-10-18T15:53:43.124 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-10-18T15:53:43.125 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8" 2023-10-18T15:53:43.125 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-10-18T15:53:43.125 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-10-18T15:53:43.125 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8" 2023-10-18T15:53:43.125 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-10-18T15:53:43.126 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-18T15:53:43.126 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-10-18T15:53:43.126 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-18T15:53:43.126 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-10-18T15:53:43.127 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T15:53:43.127 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T15:53:43.127 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T15:53:43.127 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2023-10-18T15:53:43.128 DEBUG:teuthology.parallel:result is None 2023-10-18T15:53:43.276 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2023-10-18T15:53:43.277 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T15:53:43.305 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-10-18T15:53:43.306 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T15:53:43.331 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2023-10-18T15:53:43.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-18T15:53:43.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:53:43.401 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-10-18T15:53:43.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-18T15:53:43.427 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-10-18T15:53:43.486 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-10-18T15:53:43.486 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-10-18T15:53:43.544 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-10-18T15:53:43.545 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8" 2023-10-18T15:53:43.545 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-10-18T15:53:43.545 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-10-18T15:53:43.545 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8" 2023-10-18T15:53:43.545 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-10-18T15:53:43.546 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-18T15:53:43.546 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-10-18T15:53:43.546 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-18T15:53:43.546 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-10-18T15:53:43.547 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T15:53:43.547 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T15:53:43.547 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T15:53:43.548 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-10-18T15:53:43.572 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-10-18T15:53:43.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-10-18T15:53:43.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T15:53:43.642 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-10-18T15:53:43.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-10-18T15:53:43.777 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-10-18T15:53:43.836 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-10-18T15:53:43.885 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-10-18T15:53:43.904 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2023-10-18T15:53:43.904 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8" 2023-10-18T15:53:43.904 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2023-10-18T15:53:43.905 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2023-10-18T15:53:43.905 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8" 2023-10-18T15:53:43.905 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-10-18T15:53:43.905 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-18T15:53:43.905 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-10-18T15:53:43.905 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-18T15:53:43.906 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2023-10-18T15:53:43.906 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T15:53:43.906 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T15:53:43.906 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T15:53:43.907 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-10-18T15:53:43.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T15:53:44.022 INFO:teuthology.dispatcher.supervisor:Running job 7429066 2023-10-18T15:53:44.022 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429066 --name vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429066/orig.config.yaml 2023-10-18T15:53:44.025 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429066 2023-10-18T15:53:44.026 INFO:teuthology.dispatcher.supervisor:Job PID: 628197 2023-10-18T15:53:44.026 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-18T15:55:44.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T15:57:44.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T15:59:44.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T16:01:44.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T16:03:44.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T16:05:44.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T16:07:45.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T16:09:45.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T16:11:45.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T16:13:45.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T16:13:45.744 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-18T16:13:45.894 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-18T16:13:45.895 INFO:teuthology.nuke:Checking targets against current locks 2023-10-18T16:13:45.941 DEBUG:teuthology.nuke:shortname: smithi125 2023-10-18T16:13:45.942 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T16:13:45.969 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 15:48:36.253504', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKbcYmOyCpK8XOcS5J932GEvAxnjKaUFyoBuuxxCJqt9QcDx5Qgf4UKvaB9jd11ExKIBKf+dhqq1vCqlMUn2+lY='} 2023-10-18T16:13:45.970 DEBUG:teuthology.nuke:shortname: smithi139 2023-10-18T16:13:45.971 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T16:13:45.996 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 15:48:36.251830', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ49ybyKwh5FRxtvTucAxRFiz6TuuyPcFF8W6MrtsO0qZ3IyUi50S6PaYaJL28qdY54zAoIYmbfHBfv7Ryq8kK4='} 2023-10-18T16:13:46.024 INFO:teuthology.orchestra.console.smithi125:Power off 2023-10-18T16:13:46.025 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T16:13:46.048 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-10-18T16:13:46.049 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T16:13:46.064 INFO:teuthology.orchestra.console.smithi139:Power off 2023-10-18T16:13:46.064 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T16:13:46.074 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-18T16:13:46.084 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-10-18T16:13:46.084 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T16:13:46.108 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-18T16:13:46.175 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-10-18T16:13:46.210 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-10-18T16:13:46.335 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com 2023-10-18T16:13:46.359 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com