2023-10-24T00:04:01.543 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-24T00:04:01.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-24T00:04:01.732 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f97f5e23670>, signals=[15]) 2023-10-24T00:04:01.734 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-10-24T00:04:01.735 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-10-24T00:04:01.735 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-10-24T00:04:01.759 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-10-24T00:04:01.760 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-10-24T00:04:01.760 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-24T00:04:01.763 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-10-24T00:04:01.784 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2023-10-24T00:04:01.784 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2023-10-24T00:04:01.785 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-24T00:04:01.787 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"} 2023-10-24T00:04:01.813 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /host {"name": "smithi183"} 2023-10-24T00:04:01.838 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-24T00:04:01.862 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-24T00:04:01.881 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-24T00:04:01.881 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 7} 2023-10-24T00:04:01.889 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-24T00:04:01.916 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-24T00:04:01.916 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 7} 2023-10-24T00:04:01.925 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-24T00:04:01.925 DEBUG:teuthology.provision.fog.smithi183:FOG request: PUT /host/288 {"imageID": 7} 2023-10-24T00:04:01.928 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of rhel 8.4 2023-10-24T00:04:01.928 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:04:01.955 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.4 2023-10-24T00:04:01.956 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-24T00:04:01.970 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of rhel 8.4 2023-10-24T00:04:01.970 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:04:01.999 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-10-24T00:04:02.016 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"} 2023-10-24T00:04:02.030 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /tasktype {"name": "deploy"} 2023-10-24T00:04:02.044 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-10-24T00:04:02.060 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1} 2023-10-24T00:04:02.063 DEBUG:teuthology.provision.fog.smithi183:FOG request: POST /host/288/task {"taskTypeID": 1} 2023-10-24T00:04:02.110 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:04:02.118 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:04:02.129 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-24T00:04:02.210 INFO:teuthology.orchestra.console.smithi003:Power off 2023-10-24T00:04:02.211 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-24T00:04:02.225 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-24T00:04:02.226 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-24T00:04:02.233 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-10-24T00:04:02.234 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:04:02.244 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-24T00:04:02.245 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:04:02.256 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-24T00:04:02.257 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-24T00:04:02.264 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-24T00:04:02.264 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-24T00:04:02.276 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-24T00:04:02.277 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:04:02.297 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-24T00:04:02.365 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-24T00:04:02.365 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-10-24T00:04:02.398 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-24T00:04:02.466 INFO:teuthology.orchestra.console.smithi183:Power on 2023-10-24T00:04:02.466 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-24T00:04:02.473 INFO:teuthology.orchestra.console.smithi003:Power on 2023-10-24T00:04:02.473 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-24T00:04:02.485 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2023-10-24T00:04:02.485 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:04:02.493 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2023-10-24T00:04:02.494 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:04:02.501 INFO:teuthology.orchestra.console.smithi124:Power on 2023-10-24T00:04:02.501 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-24T00:04:02.509 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-24T00:04:02.514 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-24T00:04:02.520 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-10-24T00:04:02.521 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:04:02.540 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-24T00:04:06.514 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:04:06.521 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:04:06.541 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:04:06.623 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-24T00:04:06.630 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-24T00:04:06.650 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-24T00:04:06.725 INFO:teuthology.orchestra.console.smithi183:Power on completed 2023-10-24T00:04:06.826 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2023-10-24T00:04:06.827 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:04:10.634 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:04:10.651 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:04:10.759 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-24T00:04:10.836 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-24T00:04:10.860 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-10-24T00:04:10.938 INFO:teuthology.orchestra.console.smithi003:Power on completed 2023-10-24T00:04:10.962 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-10-24T00:04:10.962 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-24T00:04:11.039 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-10-24T00:04:11.040 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:04:11.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:04:21.988 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:04:26.230 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:04:29.690 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:04:35.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:04:37.190 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:04:38.746 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:04:41.427 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:04:44.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:04:47.802 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:04:52.362 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:04:53.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:04:56.642 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:04:56.858 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:05:02.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:05:05.946 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:05:07.558 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:05:11.826 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:05:11.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:05:15.002 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:05:21.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:05:22.730 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:05:27.026 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:05:37.950 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:05:39.322 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:05:42.221 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:05:45.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:05:48.326 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:05:53.131 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:05:54.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:05:54.501 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:05:57.446 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:05:58.633 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:06:05.763 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:06:08.311 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:06:12.674 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:06:15.895 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:06:23.512 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:06:28.391 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:06:29.025 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:06:43.341 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:06:44.374 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:06:45.158 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:07:00.647 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:07:01.252 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:07:04.287 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:07:15.864 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:07:17.835 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-24T00:07:18.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:07:26.378 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:07:31.057 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-24T00:07:31.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:07:36.826 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-24T00:07:42.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:07:45.882 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-24T00:07:49.627 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-24T00:07:51.508 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:07:51.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:07:54.938 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-24T00:07:55.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:07:58.682 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-24T00:08:00.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:08:03.998 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-24T00:08:04.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:08:07.738 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-24T00:08:10.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:08:13.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:08:16.794 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-24T00:08:19.637 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:08:19.638 WARNING:teuthology.provision.fog.smithi124:'connect to smithi124.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds 2023-10-24T00:08:22.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:08:25.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:08:25.770 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:08:29.900 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:08:37.030 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:08:41.338 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-24T00:08:47.160 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:08:47.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:08:50.394 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-24T00:08:56.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:08:59.450 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-24T00:09:00.289 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:09:05.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:09:05.872 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-24T00:09:05.874 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-24T00:09:10.002 WARNING:teuthology.provision.fog.smithi003:timed out 2023-10-24T00:09:16.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:09:16.297 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-24T00:09:16.297 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-24T00:09:16.419 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:09:16.591 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-10-24T00:09:16.591 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-10-24T00:09:16.647 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-10-24T00:09:16.648 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-10-24T00:09:16.704 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-10-24T00:09:16.704 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-10-24T00:09:16.827 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-10-24T00:09:16.854 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-10-24T00:09:16.920 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-10-24T00:09:16.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-10-24T00:09:17.050 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-10-24T00:09:17.105 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux" 2023-10-24T00:09:17.105 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.4 (Ootpa)" 2023-10-24T00:09:17.105 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel" 2023-10-24T00:09:17.106 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora" 2023-10-24T00:09:17.106 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.4" 2023-10-24T00:09:17.106 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-10-24T00:09:17.106 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-24T00:09:17.106 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-10-24T00:09:17.106 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-24T00:09:17.107 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/" 2023-10-24T00:09:17.107 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-24T00:09:17.107 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-24T00:09:17.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-10-24T00:09:17.107 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-24T00:09:17.107 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-24T00:09:17.108 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-24T00:09:17.108 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-24T00:09:17.109 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-10-24T00:09:17.110 DEBUG:teuthology.parallel:result is None 2023-10-24T00:09:26.231 INFO:teuthology.provision.fog.smithi183:Node is ready 2023-10-24T00:09:26.232 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2023-10-24T00:09:26.247 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2023-10-24T00:09:26.248 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts 2023-10-24T00:09:26.301 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2023-10-24T00:09:26.302 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-24T00:09:26.443 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts 2023-10-24T00:09:26.467 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts 2023-10-24T00:09:26.534 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname 2023-10-24T00:09:26.601 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-24T00:09:26.666 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-24T00:09:26.723 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2023-10-24T00:09:26.723 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.4 (Ootpa)" 2023-10-24T00:09:26.723 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2023-10-24T00:09:26.724 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2023-10-24T00:09:26.724 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.4" 2023-10-24T00:09:26.724 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2023-10-24T00:09:26.724 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-24T00:09:26.724 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-10-24T00:09:26.725 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-24T00:09:26.725 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2023-10-24T00:09:26.725 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-24T00:09:26.725 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-24T00:09:26.725 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-24T00:09:26.726 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-24T00:09:26.726 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-24T00:09:26.726 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-24T00:09:26.726 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-24T00:09:26.727 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2023-10-24T00:09:26.727 DEBUG:teuthology.parallel:result is None 2023-10-24T00:09:35.510 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:09:57.601 ERROR:teuthology.orchestra.connection:Error authenticating with smithi124.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-24T00:10:32.954 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:10:38.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:10:42.010 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:10:48.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:10:48.154 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:10:54.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:10:57.214 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:11:03.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:11:06.266 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:11:12.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:11:12.410 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-24T00:11:18.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:12:18.415 WARNING:teuthology.provision.fog.smithi124:timed out 2023-10-24T00:12:24.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:12:24.644 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-24T00:12:24.645 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-24T00:12:24.885 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-10-24T00:12:24.886 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-10-24T00:12:24.908 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2023-10-24T00:12:24.909 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts 2023-10-24T00:12:24.970 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-10-24T00:12:24.971 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-24T00:12:25.079 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts 2023-10-24T00:12:25.114 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-10-24T00:12:25.188 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname 2023-10-24T00:12:25.262 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-24T00:12:25.335 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-24T00:12:25.397 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2023-10-24T00:12:25.398 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8" 2023-10-24T00:12:25.398 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2023-10-24T00:12:25.398 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2023-10-24T00:12:25.398 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8" 2023-10-24T00:12:25.399 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-10-24T00:12:25.399 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-24T00:12:25.399 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-10-24T00:12:25.399 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-24T00:12:25.399 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2023-10-24T00:12:25.399 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-24T00:12:25.400 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-24T00:12:25.400 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-24T00:12:25.402 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi124's OS to be rhel 8.4 but found centos 8 2023-10-24T00:12:25.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-24T00:12:25.552 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=39e588dcc4e046baaa77164982e52931 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi124's OS to be rhel 8.4 but found centos 8 2023-10-24T00:12:25.554 INFO:teuthology.nuke:Checking targets against current locks 2023-10-24T00:12:25.632 DEBUG:teuthology.nuke:shortname: smithi003 2023-10-24T00:12:25.632 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-24T00:12:25.654 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434942', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-24 00:04:00.692640', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-24T00:12:25.655 DEBUG:teuthology.nuke:shortname: smithi124 2023-10-24T00:12:25.656 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-24T00:12:25.675 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434943', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-24 00:04:01.056251', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-24T00:12:25.680 DEBUG:teuthology.nuke:shortname: smithi183 2023-10-24T00:12:25.681 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-24T00:12:25.707 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434942', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-24 00:04:00.689273', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-24T00:12:25.713 INFO:teuthology.orchestra.console.smithi003:Power off 2023-10-24T00:12:25.714 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-24T00:12:25.742 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-10-24T00:12:25.743 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:12:25.758 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-24T00:12:25.759 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-24T00:12:25.771 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-24T00:12:25.783 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-24T00:12:25.783 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:12:25.797 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-24T00:12:25.799 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-24T00:12:25.816 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-24T00:12:25.824 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-24T00:12:25.824 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:12:25.847 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-24T00:12:29.772 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:12:29.818 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:12:29.849 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:12:29.884 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-24T00:12:29.928 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-24T00:12:29.959 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-24T00:12:33.885 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:12:33.928 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:12:33.960 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:12:33.995 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-24T00:12:34.037 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-24T00:12:34.070 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-24T00:12:34.138 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-24T00:12:34.171 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-24T00:12:34.298 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com 2023-10-24T00:12:34.320 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com 2023-10-24T00:12:37.997 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T00:12:38.107 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-24T00:12:38.209 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-10-24T00:12:38.361 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-10-24T00:12:38.695 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi124's OS to be rhel 8.4 but found centos 8