2023-06-28T18:44:57.134 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a 2023-06-28T18:44:57.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:44:57.135 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:45:21.948 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff8687d2670>, signals=[15]) 2023-06-28T18:45:21.950 INFO:teuthology.lock.ops:Start node 'smithi101.front.sepia.ceph.com' reimaging 2023-06-28T18:45:21.950 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T18:45:21.950 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-06-28T18:45:26.987 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2023-06-28T18:45:26.987 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T18:45:26.987 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-06-28T18:45:26.989 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /host {"name": "smithi101"} 2023-06-28T18:45:35.277 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2023-06-28T18:45:35.278 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T18:45:35.278 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-06-28T18:45:35.279 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /host {"name": "smithi121"} 2023-06-28T18:45:50.417 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /host {"name": "smithi184"} 2023-06-28T18:46:00.424 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-28T18:46:10.437 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-28T18:46:15.442 DEBUG:teuthology.provision.fog.smithi101:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-28T18:46:15.442 DEBUG:teuthology.provision.fog.smithi101:FOG request: PUT /host/206 {"imageID": 5} 2023-06-28T18:46:20.449 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-28T18:46:20.500 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-28T18:46:20.500 DEBUG:teuthology.provision.fog.smithi121:FOG request: PUT /host/226 {"imageID": 5} 2023-06-28T18:46:20.502 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of rhel 8.6 2023-06-28T18:46:20.503 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-28T18:46:20.507 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-28T18:46:20.507 DEBUG:teuthology.provision.fog.smithi184:FOG request: PUT /host/289 {"imageID": 5} 2023-06-28T18:46:20.551 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of rhel 8.6 2023-06-28T18:46:20.552 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-06-28T18:46:25.563 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T18:46:25.564 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of rhel 8.6 2023-06-28T18:46:25.564 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-28T18:46:25.626 DEBUG:teuthology.provision.fog.smithi101:FOG request: POST /host/206/task {"taskTypeID": 1} 2023-06-28T18:46:25.682 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T18:46:25.692 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T18:46:25.712 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-28T18:46:25.729 DEBUG:teuthology.provision.fog.smithi184:FOG request: POST /host/289/task {"taskTypeID": 1} 2023-06-28T18:46:25.733 DEBUG:teuthology.provision.fog.smithi121:FOG request: POST /host/226/task {"taskTypeID": 1} 2023-06-28T18:46:25.796 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-28T18:46:25.801 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-06-28T18:46:29.810 INFO:teuthology.orchestra.console:Power off smithi184 2023-06-28T18:46:29.811 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:46:29.827 INFO:teuthology.orchestra.console:Power off smithi121 2023-06-28T18:46:29.828 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:46:29.843 INFO:teuthology.orchestra.console:Power off smithi101 2023-06-28T18:46:29.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:46:34.834 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:34.853 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:34.867 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:34.976 INFO:teuthology.orchestra.console:Power off for smithi121 completed 2023-06-28T18:46:35.077 INFO:teuthology.orchestra.console:Power on smithi121 2023-06-28T18:46:35.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T18:46:35.099 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:39.124 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:39.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:39.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:44.234 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:44.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:44.987 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:49.348 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:50.070 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:50.098 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:54.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:55.183 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:55.211 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:55.420 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-06-28T18:46:55.522 INFO:teuthology.orchestra.console:Power on smithi101 2023-06-28T18:46:55.522 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T18:46:55.544 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:59.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:59.572 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:00.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:03.676 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:03.895 INFO:teuthology.orchestra.console:Power on for smithi101 completed 2023-06-28T18:47:03.996 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2023-06-28T18:47:03.996 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-28T18:47:09.005 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:09.014 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:09.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:47:14.184 INFO:teuthology.orchestra.console:Power on for smithi121 completed 2023-06-28T18:47:14.285 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2023-06-28T18:47:14.286 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-06-28T18:47:14.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:47:19.088 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:24.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:29.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:32.464 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-28T18:47:32.720 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-06-28T18:47:34.424 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:38.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:47:38.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:47:39.534 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:41.556 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-28T18:47:41.776 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-06-28T18:47:44.645 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:47.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:47:47.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:47:49.755 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:50.644 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-28T18:47:54.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:55.977 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-06-28T18:47:55.979 ERROR:teuthology.orchestra.console:Failed to power off smithi184 2023-06-28T18:47:55.979 INFO:teuthology.orchestra.console:Power on smithi184 2023-06-28T18:47:55.979 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T18:47:56.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:48:04.720 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-28T18:48:06.005 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:48:10.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:48:15.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:48:20.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:48:25.962 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:48:31.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:48:34.160 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-28T18:48:36.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:48:40.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:48:45.169 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:48:47.217 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-28T18:48:47.780 WARNING:teuthology.provision.fog.smithi121:timed out 2023-06-28T18:48:50.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:48:53.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:48:58.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:48:58.227 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:48:58.503 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T18:48:58.504 DEBUG:teuthology.orchestra.run.smithi101:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T18:48:58.580 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T18:48:58.581 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T18:48:58.869 INFO:teuthology.provision.fog.smithi121:Node is ready 2023-06-28T18:48:58.870 DEBUG:teuthology.orchestra.run.smithi121:> hostname 2023-06-28T18:48:58.886 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121 2023-06-28T18:48:58.887 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121 /etc/hosts 2023-06-28T18:48:58.945 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2023-06-28T18:48:58.946 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121 smithi121 2023-06-28T18:48:58.946 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121 smithi121 2023-06-28T18:48:58.947 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2023-06-28T18:48:59.009 INFO:teuthology.provision.fog.smithi101:Node is ready 2023-06-28T18:48:59.009 DEBUG:teuthology.orchestra.run.smithi101:> hostname 2023-06-28T18:48:59.057 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101.front.sepia.ceph.com 2023-06-28T18:48:59.057 DEBUG:teuthology.orchestra.run.smithi101:> grep smithi101.front.sepia.ceph.com /etc/hosts 2023-06-28T18:48:59.077 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121/smithi121/g' /etc/hosts 2023-06-28T18:48:59.103 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts 2023-06-28T18:48:59.105 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101 2023-06-28T18:48:59.106 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-06-28T18:48:59.171 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121/smithi121/g' /etc/hostname 2023-06-28T18:48:59.214 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101.front.sepia.ceph.com/smithi101/g' /etc/hosts 2023-06-28T18:48:59.229 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/172.21.15.101/172.21.15.101/g' /etc/hosts 2023-06-28T18:48:59.238 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2023-06-28T18:48:59.284 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101.front.sepia.ceph.com/smithi101/g' /etc/hostname 2023-06-28T18:48:59.302 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-06-28T18:48:59.340 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-06-28T18:48:59.359 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Red Hat Enterprise Linux" 2023-06-28T18:48:59.359 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8.6 (Ootpa)" 2023-06-28T18:48:59.359 INFO:teuthology.orchestra.run.smithi121.stdout:ID="rhel" 2023-06-28T18:48:59.359 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="fedora" 2023-06-28T18:48:59.359 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8.6" 2023-06-28T18:48:59.359 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2023-06-28T18:48:59.360 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-28T18:48:59.360 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-06-28T18:48:59.360 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-28T18:48:59.360 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.redhat.com/" 2023-06-28T18:48:59.360 INFO:teuthology.orchestra.run.smithi121.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-28T18:48:59.360 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T18:48:59.360 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-06-28T18:48:59.361 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T18:48:59.361 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-28T18:48:59.361 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-28T18:48:59.361 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-28T18:48:59.362 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2023-06-28T18:48:59.363 DEBUG:teuthology.parallel:result is None 2023-06-28T18:48:59.395 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-06-28T18:48:59.440 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-28T18:48:59.440 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Ubuntu" 2023-06-28T18:48:59.441 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="22.04" 2023-06-28T18:48:59.441 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-28T18:48:59.441 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_CODENAME=jammy 2023-06-28T18:48:59.441 INFO:teuthology.orchestra.run.smithi101.stdout:ID=ubuntu 2023-06-28T18:48:59.441 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE=debian 2023-06-28T18:48:59.441 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-28T18:48:59.441 INFO:teuthology.orchestra.run.smithi101.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-28T18:48:59.442 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-28T18:48:59.442 INFO:teuthology.orchestra.run.smithi101.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-28T18:48:59.442 INFO:teuthology.orchestra.run.smithi101.stdout:UBUNTU_CODENAME=jammy 2023-06-28T18:48:59.443 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 338, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi101's OS to be rhel 8.6 but found ubuntu 22.04 2023-06-28T18:48:59.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:48:59.445 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:49:04.453 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:04.545 INFO:teuthology.nuke:Checking targets against current locks 2023-06-28T18:49:17.343 DEBUG:teuthology.nuke:shortname: smithi101 2023-06-28T18:49:17.343 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T18:49:22.351 INFO:teuthology.orchestra.console:Power on for smithi184 completed 2023-06-28T18:49:22.389 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi101.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-28_10:04:29-fs-wip-vshankar-testing-20230628.043830-testing-default-smithi/7319898', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:44:56.293861', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJhfawnl95eNxM7bP3/u1fSFFY1o+EmS9DeD8kEG9lUBKn8hu/5V1qMhus7mtw1XM1DS92of5jlTPns+QqIXsPE='} 2023-06-28T18:49:22.393 DEBUG:teuthology.nuke:shortname: smithi121 2023-06-28T18:49:22.393 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T18:49:22.421 DEBUG:teuthology.nuke:shortname: smithi184 2023-06-28T18:49:22.422 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T18:49:22.423 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-28_10:04:29-fs-wip-vshankar-testing-20230628.043830-testing-default-smithi/7319898', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:44:56.295079', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-28T18:49:22.447 INFO:teuthology.orchestra.console:Power off smithi101 2023-06-28T18:49:22.448 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:49:22.456 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2023-06-28T18:49:22.457 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-28T18:49:24.517 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-28_10:04:29-fs-wip-vshankar-testing-20230628.043830-testing-default-smithi/7319898', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:44:56.292408', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-28T18:49:34.529 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:34.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:49:34.568 INFO:teuthology.orchestra.console:Power off smithi121 2023-06-28T18:49:34.569 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:49:39.585 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-06-28T18:49:39.590 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:39.613 INFO:teuthology.orchestra.console:Power off smithi184 2023-06-28T18:49:39.613 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:49:39.636 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:44.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:44.199 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com 2023-06-28T18:49:48.086 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:48.183 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:49:48.393 INFO:teuthology.orchestra.console:Power off for smithi184 completed 2023-06-28T18:49:53.501 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-28T18:49:58.532 INFO:teuthology.orchestra.console:Power off for smithi121 completed 2023-06-28T18:49:58.560 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com 2023-06-28T18:49:59.468 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com 2023-06-28T18:49:59.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:50:04.737 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-28T18:50:04.861 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 338, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi101's OS to be rhel 8.6 but found ubuntu 22.04