2023-07-11T07:04:28.348 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T07:04:28.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T07:04:28.350 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T07:04:28.546 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9b3175f670>, signals=[15]) 2023-07-11T07:04:28.548 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2023-07-11T07:04:28.548 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T07:04:28.549 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-07-11T07:04:28.579 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2023-07-11T07:04:28.580 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T07:04:28.580 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-07-11T07:04:28.583 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /host {"name": "smithi142"} 2023-07-11T07:04:29.236 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-07-11T07:04:29.236 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T07:04:29.237 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-07-11T07:04:29.238 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"} 2023-07-11T07:04:54.261 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"} 2023-07-11T07:05:04.266 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-11T07:05:04.294 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-11T07:05:04.317 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_8.stream (ID 3) 2023-07-11T07:05:04.317 DEBUG:teuthology.provision.fog.smithi142:FOG request: PUT /host/247 {"imageID": 3} 2023-07-11T07:05:09.188 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_centos_8.stream (ID 3) 2023-07-11T07:05:09.188 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 3} 2023-07-11T07:05:14.198 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 8.stream 2023-07-11T07:05:14.199 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-11T07:05:19.208 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-11T07:05:19.277 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_centos_8.stream (ID 3) 2023-07-11T07:05:19.278 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 3} 2023-07-11T07:05:19.309 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of centos 8.stream 2023-07-11T07:05:19.309 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-11T07:05:19.313 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T07:05:19.342 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 8.stream 2023-07-11T07:05:19.343 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-07-11T07:05:19.373 DEBUG:teuthology.provision.fog.smithi142:FOG request: POST /host/247/task {"taskTypeID": 1} 2023-07-11T07:05:19.404 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T07:05:19.417 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T07:05:19.437 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-11T07:05:19.441 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1} 2023-07-11T07:05:19.463 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1} 2023-07-11T07:05:19.493 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-11T07:05:24.516 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-07-11T07:05:29.553 INFO:teuthology.orchestra.console:Power off smithi151 2023-07-11T07:05:29.555 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T07:05:29.575 INFO:teuthology.orchestra.console:Power off smithi142 2023-07-11T07:05:29.575 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T07:05:29.585 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:34.605 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:34.639 INFO:teuthology.orchestra.console:Power off smithi186 2023-07-11T07:05:34.639 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T07:05:38.609 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:38.650 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:43.720 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:43.762 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:48.836 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:48.874 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:49.672 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:53.699 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:53.948 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:53.986 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:57.809 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:58.020 INFO:teuthology.orchestra.console:Power off for smithi186 completed 2023-07-11T07:05:58.121 INFO:teuthology.orchestra.console:Power on smithi186 2023-07-11T07:05:58.121 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T07:05:58.143 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:59.061 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:05:59.098 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:02.170 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:04.176 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:04.210 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:06.283 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:09.287 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:09.322 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:09.533 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2023-07-11T07:06:09.634 INFO:teuthology.orchestra.console:Power on smithi142 2023-07-11T07:06:09.634 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T07:06:11.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:14.401 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:14.611 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2023-07-11T07:06:14.713 INFO:teuthology.orchestra.console:Power on smithi151 2023-07-11T07:06:14.713 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T07:06:14.737 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:16.510 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:18.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:19.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:21.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:23.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:23.873 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:24.084 INFO:teuthology.orchestra.console:Power on for smithi151 completed 2023-07-11T07:06:24.185 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2023-07-11T07:06:24.186 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-11T07:06:29.193 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:29.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:06:29.303 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2023-07-11T07:06:29.404 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2023-07-11T07:06:29.404 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-11T07:06:32.340 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:06:34.303 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:38.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:06:43.349 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:44.477 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-11T07:06:49.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T07:06:49.492 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:06:49.695 INFO:teuthology.orchestra.console:Power on for smithi186 completed 2023-07-11T07:06:49.795 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-07-11T07:06:49.796 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-07-11T07:06:54.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:06:59.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:07:04.904 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-11T07:07:04.906 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-07-11T07:07:09.909 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:07:10.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:07:15.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:07:18.997 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-07-11T07:07:18.997 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:07:24.972 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-11T07:07:29.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:07:34.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:07:39.988 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-07-11T07:07:45.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:07:46.467 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-07-11T07:07:52.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:07:52.592 ERROR:teuthology.orchestra.connection:Error authenticating with smithi186.front.sepia.ceph.com: Authentication failed. 2023-07-11T07:07:52.595 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T07:07:52.596 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T07:07:52.598 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:07:55.057 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-11T07:08:00.065 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:08:06.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:08:14.128 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:08:15.136 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-11T07:08:20.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:08:28.212 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:08:34.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:08:37.264 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:08:40.210 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-11T07:08:45.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:08:53.296 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:08:59.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:09:02.352 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:09:05.282 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-11T07:09:10.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:09:10.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:09:13.360 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:09:13.425 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-11T07:09:19.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:09:24.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:09:29.369 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:09:32.432 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-11T07:09:35.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:09:38.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:09:43.437 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:09:46.516 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-11T07:09:49.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:09:52.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:10:07.993 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-11T07:10:13.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:10:14.109 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: Authentication failed. 2023-07-11T07:10:14.109 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T07:10:14.109 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T07:10:14.111 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:15.118 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:16.127 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:17.136 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:18.146 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:19.154 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:20.162 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:21.172 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:22.179 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:23.186 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:24.193 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:25.200 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:26.207 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:27.214 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:28.221 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:29.228 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:30.237 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:31.244 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:32.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:33.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:34.269 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:35.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:36.285 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:36.657 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-11T07:10:36.658 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi186 2023-07-11T07:10:37.291 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:38.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:39.305 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:40.311 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:41.316 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:42.323 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:43.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:44.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:45.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:45.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-07-11T07:10:45.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:10:45.742 ERROR:teuthology.orchestra.connection:Error authenticating with smithi186.front.sepia.ceph.com: Authentication failed. 2023-07-11T07:10:45.743 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-07-11T07:10:45.744 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:46.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:47.356 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:48.364 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:49.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:50.383 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:51.390 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:52.401 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:53.411 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:54.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:55.430 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:56.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:57.450 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:57.524 WARNING:teuthology.provision.fog.smithi142:timed out 2023-07-11T07:10:58.458 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:10:59.468 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:11:00.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:11:01.486 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:11:02.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:11:03.510 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:11:03.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:11:03.815 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T07:11:03.815 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T07:11:04.081 INFO:teuthology.provision.fog.smithi142:Node is ready 2023-07-11T07:11:04.081 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2023-07-11T07:11:04.101 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2023-07-11T07:11:04.102 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2023-07-11T07:11:04.162 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2023-07-11T07:11:04.162 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-07-11T07:11:04.259 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2023-07-11T07:11:04.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2023-07-11T07:11:04.359 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2023-07-11T07:11:04.428 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-07-11T07:11:04.495 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-07-11T07:11:04.518 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:11:04.554 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2023-07-11T07:11:04.554 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2023-07-11T07:11:04.554 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2023-07-11T07:11:04.554 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2023-07-11T07:11:04.555 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2023-07-11T07:11:04.555 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-07-11T07:11:04.555 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-11T07:11:04.555 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-07-11T07:11:04.556 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-11T07:11:04.556 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2023-07-11T07:11:04.556 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T07:11:04.556 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T07:11:04.557 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-11T07:11:04.558 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2023-07-11T07:11:04.560 DEBUG:teuthology.parallel:result is None 2023-07-11T07:11:05.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:11:06.541 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:11:07.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:11:08.557 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:11:09.565 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:11:10.574 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T07:13:24.592 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-11T07:13:24.593 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi151 2023-07-11T07:13:33.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-11T07:13:33.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T07:13:38.667 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-07-11T07:13:38.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-11T07:13:38.808 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T07:13:38.809 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T07:13:38.866 INFO:teuthology.provision.fog.smithi151:Node is ready 2023-07-11T07:13:38.867 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2023-07-11T07:13:38.924 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151 2023-07-11T07:13:38.925 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151 /etc/hosts 2023-07-11T07:13:38.983 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151 smithi151 2023-07-11T07:13:38.984 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-07-11T07:13:39.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151/smithi151/g' /etc/hosts 2023-07-11T07:13:39.120 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts 2023-07-11T07:13:39.188 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151/smithi151/g' /etc/hostname 2023-07-11T07:13:39.255 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-07-11T07:13:39.322 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-07-11T07:13:39.381 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2023-07-11T07:13:39.381 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8" 2023-07-11T07:13:39.381 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2023-07-11T07:13:39.381 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2023-07-11T07:13:39.381 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8" 2023-07-11T07:13:39.382 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-07-11T07:13:39.382 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-11T07:13:39.382 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-07-11T07:13:39.382 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-11T07:13:39.382 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2023-07-11T07:13:39.382 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T07:13:39.382 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T07:13:39.382 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-11T07:13:39.383 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2023-07-11T07:13:39.383 DEBUG:teuthology.parallel:result is None 2023-07-11T08:10:54.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-07-11T08:10:54.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:10:54.904 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-07-11T08:10:55.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-07-11T08:10:55.022 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T08:10:55.022 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T08:10:55.027 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-07-11T08:10:55.028 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-07-11T08:10:55.077 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186 2023-07-11T08:10:55.078 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186 /etc/hosts 2023-07-11T08:10:55.086 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2023-07-11T08:10:55.086 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186 smithi186 2023-07-11T08:10:55.087 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-07-11T08:10:55.103 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186/smithi186/g' /etc/hosts 2023-07-11T08:10:55.161 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2023-07-11T08:10:55.177 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186/smithi186/g' /etc/hostname 2023-07-11T08:10:55.192 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-07-11T08:10:55.204 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-07-11T08:10:55.253 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Ubuntu" 2023-07-11T08:10:55.253 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-11T08:10:55.254 INFO:teuthology.orchestra.run.smithi186.stdout:ID=ubuntu 2023-07-11T08:10:55.254 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE=debian 2023-07-11T08:10:55.254 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-11T08:10:55.254 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="20.04" 2023-07-11T08:10:55.254 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-11T08:10:55.254 INFO:teuthology.orchestra.run.smithi186.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-11T08:10:55.255 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-11T08:10:55.255 INFO:teuthology.orchestra.run.smithi186.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-11T08:10:55.255 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_CODENAME=focal 2023-07-11T08:10:55.255 INFO:teuthology.orchestra.run.smithi186.stdout:UBUNTU_CODENAME=focal 2023-07-11T08:10:55.257 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi186's OS to be centos 8 but found ubuntu 20.04 2023-07-11T08:10:55.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:10:55.259 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:10:55.353 INFO:teuthology.nuke:Checking targets against current locks 2023-07-11T08:10:55.406 DEBUG:teuthology.nuke:shortname: smithi142 2023-07-11T08:10:55.407 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T08:10:55.439 DEBUG:teuthology.nuke:shortname: smithi151 2023-07-11T08:10:55.439 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T08:10:55.445 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-11_06:48:53-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333389', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 07:04:27.525892', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJC4aNUiQ3SfnkVpHJsNTfrkDrhuEMT5IMf8k/4qjFRru5GJMqdyiNocUZtJjJQs5hvqkvuo8IGKAV1jiP2p2SE='} 2023-07-11T08:10:55.469 DEBUG:teuthology.nuke:shortname: smithi186 2023-07-11T08:10:55.469 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T08:10:55.472 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-11_06:48:53-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333468', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 07:57:35.669217', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-11T08:10:55.499 INFO:teuthology.orchestra.console:Power off smithi142 2023-07-11T08:10:55.500 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T08:10:55.512 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-11_06:48:53-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333451', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 07:45:19.663709', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-11T08:10:55.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:10:55.545 INFO:teuthology.orchestra.console:Power off smithi151 2023-07-11T08:10:55.545 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T08:10:55.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:10:55.583 INFO:teuthology.orchestra.console:Power off smithi186 2023-07-11T08:10:55.584 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T08:10:55.604 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:10:59.556 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:10:59.594 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:10:59.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:11:04.666 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:11:04.704 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:11:04.740 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:11:04.877 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2023-07-11T08:11:15.016 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:11:15.024 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:11:15.062 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com 2023-07-11T08:11:15.232 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2023-07-11T08:11:21.577 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com 2023-07-11T08:11:24.342 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:11:29.453 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:11:34.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:11:39.679 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:11:39.890 INFO:teuthology.orchestra.console:Power off for smithi186 completed 2023-07-11T08:11:50.066 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com 2023-07-11T08:12:05.502 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi186's OS to be centos 8 but found ubuntu 20.04