2023-07-28T17:26:22.412 INFO:root:teuthology version: 0.0.1.dev165+g3117e89 2023-07-28T17:26:22.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T17:26:22.415 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T17:26:43.417 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f563cd24310>, signals=[15]) 2023-07-28T17:26:43.419 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2023-07-28T17:26:43.420 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2023-07-28T17:26:43.420 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-07-28T17:26:43.441 INFO:teuthology.lock.ops:Start node 'smithi130.front.sepia.ceph.com' reimaging 2023-07-28T17:26:43.441 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: reset os type and version on server 2023-07-28T17:26:43.442 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2023-07-28T17:26:43.443 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /host {"name": "smithi045"} 2023-07-28T17:26:48.477 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /host {"name": "smithi130"} 2023-07-28T17:26:58.513 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-28T17:27:00.880 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-28T17:27:05.882 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_centos_8.stream (ID 3) 2023-07-28T17:27:05.883 DEBUG:teuthology.provision.fog.smithi045:FOG request: PUT /host/150 {"imageID": 3} 2023-07-28T17:27:10.554 DEBUG:teuthology.provision.fog.smithi130:Requesting image smithi_centos_8.stream (ID 3) 2023-07-28T17:27:10.554 DEBUG:teuthology.provision.fog.smithi130:FOG request: PUT /host/235 {"imageID": 3} 2023-07-28T17:27:10.567 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 8.stream 2023-07-28T17:27:10.568 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-28T17:27:10.598 INFO:teuthology.provision.fog.smithi130:Scheduling deploy of centos 8.stream 2023-07-28T17:27:10.598 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-28T17:27:10.626 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /tasktype {"name": "deploy"} 2023-07-28T17:27:10.658 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /tasktype {"name": "deploy"} 2023-07-28T17:27:10.670 DEBUG:teuthology.provision.fog.smithi045:FOG request: POST /host/150/task {"taskTypeID": 1} 2023-07-28T17:27:10.700 DEBUG:teuthology.provision.fog.smithi130:FOG request: POST /host/235/task {"taskTypeID": 1} 2023-07-28T17:27:10.973 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-28T17:27:15.977 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-28T17:27:21.115 INFO:teuthology.orchestra.console.smithi045:Power off 2023-07-28T17:27:21.117 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T17:27:21.135 INFO:teuthology.orchestra.console.smithi130:Power off 2023-07-28T17:27:21.137 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T17:27:21.150 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-07-28T17:27:21.151 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:21.164 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2023-07-28T17:27:21.165 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:21.176 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-07-28T17:27:21.186 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-07-28T17:27:25.180 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:25.189 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:25.291 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-07-28T17:27:25.301 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-07-28T17:27:29.296 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:29.304 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:29.406 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-07-28T17:27:29.414 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-07-28T17:27:29.509 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-07-28T17:27:29.610 INFO:teuthology.orchestra.console.smithi045:Power on 2023-07-28T17:27:29.610 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-28T17:27:29.636 DEBUG:teuthology.orchestra.console.smithi045:power on output: Chassis Power Control: Up/On 2023-07-28T17:27:29.637 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:29.659 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-07-28T17:27:33.416 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:33.660 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:34.527 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:27:34.772 DEBUG:teuthology.orchestra.console.smithi045:check power output: 2023-07-28T17:27:38.528 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:38.774 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:39.640 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:27:39.884 DEBUG:teuthology.orchestra.console.smithi045:check power output: 2023-07-28T17:27:43.645 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:43.886 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:44.756 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:27:44.998 DEBUG:teuthology.orchestra.console.smithi045:check power output: 2023-07-28T17:27:48.760 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:48.999 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:49.870 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:27:50.110 DEBUG:teuthology.orchestra.console.smithi045:check power output: 2023-07-28T17:27:53.872 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:54.112 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:54.982 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:27:55.221 DEBUG:teuthology.orchestra.console.smithi045:check power output: 2023-07-28T17:27:58.984 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:59.223 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:27:59.333 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-07-28T17:27:59.434 INFO:teuthology.orchestra.console.smithi045:Power on completed 2023-07-28T17:27:59.535 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2023-07-28T17:27:59.536 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-28T17:27:59.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T17:28:00.096 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:28:02.672 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-28T17:28:04.097 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:28:05.208 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:28:08.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T17:28:09.210 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:28:10.321 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:28:11.732 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-28T17:28:14.322 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:28:15.432 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:28:17.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T17:28:19.435 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:28:20.544 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:28:20.816 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-28T17:28:24.545 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:28:24.656 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2023-07-28T17:28:24.757 INFO:teuthology.orchestra.console.smithi130:Power off completed 2023-07-28T17:28:24.858 INFO:teuthology.orchestra.console.smithi130:Power on 2023-07-28T17:28:24.859 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-28T17:28:24.879 DEBUG:teuthology.orchestra.console.smithi130:power on output: Chassis Power Control: Up/On 2023-07-28T17:28:24.879 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:28:24.900 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2023-07-28T17:28:26.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T17:28:31.825 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:28:32.934 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:28:36.936 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:28:38.046 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:28:42.051 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:28:43.161 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:28:47.163 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:28:48.272 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:28:52.273 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:28:53.383 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:28:57.386 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:28:58.496 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:29:02.501 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:29:03.611 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:29:07.612 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:29:08.722 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:29:12.725 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:29:13.835 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:29:17.837 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:29:18.948 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:29:22.951 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:29:23.062 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-07-28T17:29:23.163 INFO:teuthology.orchestra.console.smithi130:Power on completed 2023-07-28T17:29:23.264 INFO:teuthology.provision.fog.smithi130:Waiting for deploy to finish 2023-07-28T17:29:23.264 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-28T17:29:27.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T17:29:30.352 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-07-28T17:29:31.826 WARNING:teuthology.provision.fog.smithi045:timed out 2023-07-28T17:29:36.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T17:29:41.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T17:29:46.787 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-28T17:29:46.788 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-28T17:29:47.088 INFO:teuthology.provision.fog.smithi045:Node is ready 2023-07-28T17:29:47.088 DEBUG:teuthology.orchestra.run.smithi045:> hostname 2023-07-28T17:29:47.109 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2023-07-28T17:29:47.110 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts 2023-07-28T17:29:47.169 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2023-07-28T17:29:47.170 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-07-28T17:29:47.304 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts 2023-07-28T17:29:47.336 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts 2023-07-28T17:29:47.408 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname 2023-07-28T17:29:47.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-07-28T17:29:47.547 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-07-28T17:29:47.606 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2023-07-28T17:29:47.607 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8" 2023-07-28T17:29:47.607 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2023-07-28T17:29:47.607 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2023-07-28T17:29:47.607 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8" 2023-07-28T17:29:47.607 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2023-07-28T17:29:47.607 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-28T17:29:47.608 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-07-28T17:29:47.608 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-28T17:29:47.610 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2023-07-28T17:29:47.610 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-28T17:29:47.611 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-28T17:29:47.611 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-28T17:29:47.612 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2023-07-28T17:29:47.613 DEBUG:teuthology.parallel:result is None 2023-07-28T17:30:41.416 WARNING:teuthology.provision.fog.smithi130:timed out 2023-07-28T17:30:47.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T17:30:52.636 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-28T17:30:52.637 DEBUG:teuthology.orchestra.run.smithi130:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-28T17:30:53.235 INFO:teuthology.provision.fog.smithi130:Node is ready 2023-07-28T17:30:53.236 DEBUG:teuthology.orchestra.run.smithi130:> hostname 2023-07-28T17:30:53.242 INFO:teuthology.orchestra.run.smithi130.stdout:smithi130.front.sepia.ceph.com 2023-07-28T17:30:53.242 DEBUG:teuthology.orchestra.run.smithi130:> grep smithi130.front.sepia.ceph.com /etc/hosts 2023-07-28T17:30:53.248 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.15.130 smithi130.front.sepia.ceph.com smithi130 2023-07-28T17:30:53.248 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130 2023-07-28T17:30:53.337 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hosts 2023-07-28T17:30:53.353 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/172.21.15.130/172.21.15.130/g' /etc/hosts 2023-07-28T17:30:53.369 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hostname 2023-07-28T17:30:53.383 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130 2023-07-28T17:30:53.398 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2023-07-28T17:30:53.445 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="Ubuntu" 2023-07-28T17:30:53.445 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-28T17:30:53.446 INFO:teuthology.orchestra.run.smithi130.stdout:ID=ubuntu 2023-07-28T17:30:53.446 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE=debian 2023-07-28T17:30:53.446 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-28T17:30:53.446 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="20.04" 2023-07-28T17:30:53.446 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-28T17:30:53.446 INFO:teuthology.orchestra.run.smithi130.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-28T17:30:53.446 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-28T17:30:53.447 INFO:teuthology.orchestra.run.smithi130.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-28T17:30:53.447 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_CODENAME=focal 2023-07-28T17:30:53.447 INFO:teuthology.orchestra.run.smithi130.stdout:UBUNTU_CODENAME=focal 2023-07-28T17:30:53.448 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi130's OS to be centos 8 but found ubuntu 20.04 2023-07-28T17:30:53.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T17:30:53.449 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T17:30:58.540 INFO:teuthology.nuke:Checking targets against current locks 2023-07-28T17:31:02.553 DEBUG:teuthology.nuke:shortname: smithi045 2023-07-28T17:31:02.554 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-28T17:31:02.583 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-28_14:25:29-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7355369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-28 17:26:21.564686', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4utki3hkWjZd8NLvsyMOujMrIq6Ug5stz6usnIfuuX6nI1486XwzWmkSE6OQaE2VNlcivAljdO4ZqJJXm8oEBwn9o8R0Oi1ufxdMbZNFsfsZWnS5tgyiv6EKU3Jv+3/uil3MzZoFVqdw+AEr0FE0aUg4RXpVof6Bm/6A4NlJGKtOWMfhegjjYNZ3Zv0N7PyfxFoImvO5LpNRC3Bm3BdE95prlCbls9qcMQ1g6ElRL2aevPWTCD/bQMpKVsPRy+ZxhsYwrQC8uF9jjltc2NrWOXoTI4VpY7rCfOI0LnYrOo0gantAbss+vmeFoOvMbiQ/KSGR2kap4t7cBquSWbpCLRNsYvLLlfB5GAb+gqw+riF+SDC16Y6qKAh27n53gLuacAj90qJZVtgFI/MsqDIokJcBg3IzUZ3R0hwRGPqZ5WV62IQB/DmnTw62I+Cs0V6RRwPPTgVyc5mh5sgs3aEurRui7Im3KbLkcwDXJGI9lBo/0sLMPiTlFq2vAbCyoqK8='} 2023-07-28T17:31:02.586 DEBUG:teuthology.nuke:shortname: smithi130 2023-07-28T17:31:02.586 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-28T17:31:02.619 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-28_14:25:29-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7355369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-28 17:26:21.563175', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-07-28T17:31:02.637 INFO:teuthology.orchestra.console.smithi045:Power off 2023-07-28T17:31:02.638 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T17:31:02.664 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-07-28T17:31:02.665 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:31:02.684 INFO:teuthology.orchestra.console.smithi130:Power off 2023-07-28T17:31:02.685 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T17:31:02.694 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-07-28T17:31:02.707 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2023-07-28T17:31:02.707 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:31:02.732 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-07-28T17:31:06.696 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:31:06.734 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:31:06.806 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-07-28T17:31:07.846 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:31:10.808 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:31:11.848 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:31:11.921 DEBUG:teuthology.orchestra.console.smithi045:check power output: 2023-07-28T17:31:12.959 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:31:15.923 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:31:16.960 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:31:17.035 DEBUG:teuthology.orchestra.console.smithi045:check power output: 2023-07-28T17:31:18.071 DEBUG:teuthology.orchestra.console.smithi130:check power output: 2023-07-28T17:31:21.036 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:31:22.072 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:31:22.146 DEBUG:teuthology.orchestra.console.smithi045:check power output: 2023-07-28T17:31:22.182 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2023-07-28T17:31:22.283 INFO:teuthology.orchestra.console.smithi130:Power off completed 2023-07-28T17:31:28.625 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:31:28.754 INFO:teuthology.lock.ops:unlocked: smithi130.front.sepia.ceph.com 2023-07-28T17:31:29.736 DEBUG:teuthology.orchestra.console.smithi045:check power output: 2023-07-28T17:31:33.740 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:31:34.852 DEBUG:teuthology.orchestra.console.smithi045:check power output: 2023-07-28T17:31:38.854 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T17:31:38.963 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-07-28T17:31:39.064 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-07-28T17:31:43.750 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com 2023-07-28T17:31:43.968 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi130's OS to be centos 8 but found ubuntu 20.04