2023-11-15T12:16:14.035 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-15T12:16:14.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T12:16:14.210 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8f78dccaf0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8f798bd670>, signals=[15])
2023-11-15T12:16:14.211 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging
2023-11-15T12:16:14.212 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server
2023-11-15T12:16:14.212 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server
2023-11-15T12:16:14.230 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging
2023-11-15T12:16:14.230 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server
2023-11-15T12:16:14.230 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2023-11-15T12:16:14.232 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /host {"name": "smithi080"}
2023-11-15T12:16:14.254 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging
2023-11-15T12:16:14.255 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server
2023-11-15T12:16:14.255 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2023-11-15T12:16:14.257 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"}
2023-11-15T12:16:14.279 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"}
2023-11-15T12:16:14.306 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-15T12:16:14.333 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-15T12:16:14.371 DEBUG:teuthology.provision.fog.smithi080:Requesting image smithi_centos_9.stream (ID 10)
2023-11-15T12:16:14.371 DEBUG:teuthology.provision.fog.smithi080:FOG request: PUT /host/185 {"imageID": 10}
2023-11-15T12:16:14.375 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_centos_9.stream (ID 10)
2023-11-15T12:16:14.376 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 10}
2023-11-15T12:16:14.377 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-15T12:16:14.420 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of centos 9.stream
2023-11-15T12:16:14.420 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-15T12:16:14.423 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_centos_9.stream (ID 10)
2023-11-15T12:16:14.423 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 10}
2023-11-15T12:16:14.431 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 9.stream
2023-11-15T12:16:14.432 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:16:14.464 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of centos 9.stream
2023-11-15T12:16:14.465 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:16:14.481 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /tasktype {"name": "deploy"}
2023-11-15T12:16:14.487 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"}
2023-11-15T12:16:14.519 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"}
2023-11-15T12:16:14.522 DEBUG:teuthology.provision.fog.smithi080:FOG request: POST /host/185/task {"taskTypeID": 1}
2023-11-15T12:16:14.525 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1}
2023-11-15T12:16:14.561 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1}
2023-11-15T12:16:14.593 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:16:14.597 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-15T12:16:14.623 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:16:14.691 INFO:teuthology.orchestra.console.smithi103:Power off
2023-11-15T12:16:14.692 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T12:16:14.711 INFO:teuthology.orchestra.console.smithi080:Power off
2023-11-15T12:16:14.712 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T12:16:14.721 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off
2023-11-15T12:16:14.722 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:16:14.735 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off
2023-11-15T12:16:14.735 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:16:14.745 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2023-11-15T12:16:14.761 INFO:teuthology.orchestra.console.smithi140:Power off
2023-11-15T12:16:14.762 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T12:16:14.771 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on
2023-11-15T12:16:14.785 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off
2023-11-15T12:16:14.785 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:16:14.808 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2023-11-15T12:16:14.847 INFO:teuthology.orchestra.console.smithi103:Power off completed
2023-11-15T12:16:14.909 INFO:teuthology.orchestra.console.smithi140:Power off completed
2023-11-15T12:16:14.948 INFO:teuthology.orchestra.console.smithi103:Power on
2023-11-15T12:16:14.949 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-15T12:16:14.970 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On
2023-11-15T12:16:14.971 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:16:14.996 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2023-11-15T12:16:15.010 INFO:teuthology.orchestra.console.smithi140:Power on
2023-11-15T12:16:15.011 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-15T12:16:15.033 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On
2023-11-15T12:16:15.034 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:16:15.058 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2023-11-15T12:16:18.774 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:16:18.888 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on
2023-11-15T12:16:18.998 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:16:19.059 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:16:19.107 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2023-11-15T12:16:19.171 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2023-11-15T12:16:19.209 INFO:teuthology.orchestra.console.smithi103:Power on completed
2023-11-15T12:16:19.309 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish
2023-11-15T12:16:19.310 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:16:22.891 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:16:23.000 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2023-11-15T12:16:23.101 INFO:teuthology.orchestra.console.smithi080:Power off completed
2023-11-15T12:16:23.172 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:16:23.202 INFO:teuthology.orchestra.console.smithi080:Power on
2023-11-15T12:16:23.203 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-15T12:16:23.226 DEBUG:teuthology.orchestra.console.smithi080:power on output: Chassis Power Control: Up/On
2023-11-15T12:16:23.226 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:16:23.251 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2023-11-15T12:16:23.284 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2023-11-15T12:16:23.385 INFO:teuthology.orchestra.console.smithi140:Power on completed
2023-11-15T12:16:23.486 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish
2023-11-15T12:16:23.486 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:16:27.254 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:16:27.363 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2023-11-15T12:16:31.366 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:16:31.585 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on
2023-11-15T12:16:31.686 INFO:teuthology.orchestra.console.smithi080:Power on completed
2023-11-15T12:16:31.787 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish
2023-11-15T12:16:31.787 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-15T12:16:34.394 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:16:38.574 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:16:46.878 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-15T12:16:49.476 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:16:53.654 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:17:01.948 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-15T12:17:04.542 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:17:08.724 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:17:17.026 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-15T12:17:19.606 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:17:23.786 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:17:32.090 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-15T12:17:34.677 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:17:38.850 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:17:47.151 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-15T12:17:49.734 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:17:53.908 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:18:02.222 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-15T12:18:04.803 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:18:08.970 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:18:17.298 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-15T12:18:19.861 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:18:24.026 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:18:32.374 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-15T12:18:34.922 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:18:39.094 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:18:47.430 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-15T12:18:49.972 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:18:54.162 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:19:02.487 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None
2023-11-15T12:19:02.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:05.025 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None
2023-11-15T12:19:05.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:05.365 ERROR:teuthology.orchestra.connection:Error authenticating with smithi103.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-15T12:19:05.594 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-15T12:19:09.211 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-11-15T12:19:09.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:11.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:12.314 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:19:14.654 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-15T12:19:18.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:20.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:21.375 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:19:23.740 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-15T12:19:27.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:29.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:30.458 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:19:32.794 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-15T12:19:36.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:38.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:39.518 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:19:41.850 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-15T12:19:43.867 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-15T12:19:45.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:47.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:48.570 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:19:49.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:50.906 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-15T12:19:52.922 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-15T12:19:54.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:56.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:57.626 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:19:58.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:19:59.966 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-15T12:20:01.978 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-15T12:20:03.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:20:05.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:20:07.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:20:11.034 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-15T12:20:17.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:20:20.090 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2023-11-15T12:20:24.314 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-15T12:20:26.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:20:30.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:20:33.374 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-15T12:20:39.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:20:42.458 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2023-11-15T12:20:48.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:20:49.014 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-15T12:20:49.015 DEBUG:teuthology.orchestra.run.smithi080:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-15T12:21:03.630 WARNING:teuthology.provision.fog.smithi140:timed out
2023-11-15T12:21:04.497 INFO:teuthology.provision.fog.smithi080:Node is ready
2023-11-15T12:21:04.498 DEBUG:teuthology.orchestra.run.smithi080:> hostname
2023-11-15T12:21:04.516 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com
2023-11-15T12:21:04.516 DEBUG:teuthology.orchestra.run.smithi080:> grep smithi080.front.sepia.ceph.com /etc/hosts
2023-11-15T12:21:04.573 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080
2023-11-15T12:21:04.574 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080
2023-11-15T12:21:04.692 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hosts
2023-11-15T12:21:04.724 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts
2023-11-15T12:21:04.794 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hostname
2023-11-15T12:21:04.863 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080
2023-11-15T12:21:04.932 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release
2023-11-15T12:21:04.989 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream"
2023-11-15T12:21:04.989 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9"
2023-11-15T12:21:04.989 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos"
2023-11-15T12:21:04.989 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora"
2023-11-15T12:21:04.990 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9"
2023-11-15T12:21:04.990 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9"
2023-11-15T12:21:04.990 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-15T12:21:04.990 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31"
2023-11-15T12:21:04.991 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon"
2023-11-15T12:21:04.991 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-15T12:21:04.991 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/"
2023-11-15T12:21:04.991 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-15T12:21:04.991 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-15T12:21:04.992 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-15T12:21:04.993 INFO:teuthology.provision.fog.smithi080:Deploy complete!
2023-11-15T12:21:04.994 DEBUG:teuthology.parallel:result is None
2023-11-15T12:21:09.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:21:12.699 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:21:18.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:21:21.754 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:21:26.095 WARNING:teuthology.provision.fog.smithi103:timed out
2023-11-15T12:21:27.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:21:30.810 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:21:32.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:21:32.312 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-15T12:21:32.312 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-15T12:21:32.656 INFO:teuthology.provision.fog.smithi103:Node is ready
2023-11-15T12:21:32.656 DEBUG:teuthology.orchestra.run.smithi103:> hostname
2023-11-15T12:21:32.671 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com
2023-11-15T12:21:32.671 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts
2023-11-15T12:21:32.730 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103
2023-11-15T12:21:32.731 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103
2023-11-15T12:21:32.847 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts
2023-11-15T12:21:32.876 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts
2023-11-15T12:21:32.946 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname
2023-11-15T12:21:33.016 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103
2023-11-15T12:21:33.087 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release
2023-11-15T12:21:33.145 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream"
2023-11-15T12:21:33.145 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9"
2023-11-15T12:21:33.145 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos"
2023-11-15T12:21:33.146 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora"
2023-11-15T12:21:33.146 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9"
2023-11-15T12:21:33.146 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9"
2023-11-15T12:21:33.146 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-15T12:21:33.146 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31"
2023-11-15T12:21:33.147 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon"
2023-11-15T12:21:33.147 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-15T12:21:33.147 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/"
2023-11-15T12:21:33.147 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-15T12:21:33.147 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-15T12:21:33.148 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-15T12:21:33.148 INFO:teuthology.provision.fog.smithi103:Deploy complete!
2023-11-15T12:21:33.149 DEBUG:teuthology.parallel:result is None
2023-11-15T12:21:36.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:21:39.870 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:21:45.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:21:48.926 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:21:54.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:21:57.979 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:22:03.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:22:07.038 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:22:13.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:22:16.090 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:22:22.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:22:25.146 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:22:31.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:22:34.206 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:22:40.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:22:43.258 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:22:49.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:22:52.318 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:22:58.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:23:01.370 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:23:07.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:23:10.426 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:23:16.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:23:19.518 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:23:25.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:23:28.570 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:23:34.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:23:37.630 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:23:43.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:23:46.717 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:23:52.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:23:55.802 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:24:01.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:24:04.862 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:24:10.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:24:13.950 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:24:19.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:24:23.005 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:24:29.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:24:32.062 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:24:38.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:24:41.147 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:24:47.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:24:50.202 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:24:56.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:24:59.262 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:25:05.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:25:08.350 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:25:14.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:25:17.402 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:25:23.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:25:26.462 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:25:32.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:25:35.514 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:25:41.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:25:44.574 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:25:50.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:25:53.630 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:25:59.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:26:02.686 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:26:08.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:26:11.774 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:26:17.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:26:20.830 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:26:26.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:26:29.914 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:26:35.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:26:38.970 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:26:44.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:26:48.026 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:26:54.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:26:57.086 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:27:03.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:27:06.139 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:27:12.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:27:15.194 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:27:21.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:27:24.250 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:27:30.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:27:33.306 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:27:39.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:27:42.362 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:27:48.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:27:51.418 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:27:57.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:28:00.474 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:28:06.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:28:09.530 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:28:15.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:28:18.586 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:28:24.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:28:27.644 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:28:33.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:28:36.702 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:28:42.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:28:45.754 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:28:51.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:28:54.814 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:29:00.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:29:03.870 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:29:09.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:29:12.954 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:29:18.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:29:22.014 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:29:28.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:29:31.066 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:29:37.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:29:40.122 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:29:46.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:29:49.178 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:29:55.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:29:58.235 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:30:04.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:30:07.290 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:30:13.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:30:16.346 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:30:22.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:30:25.402 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:30:31.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:30:34.458 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:30:40.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:30:43.514 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:30:49.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:30:52.574 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:30:58.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:31:01.626 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:31:07.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:31:10.682 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:31:16.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:31:19.738 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:31:25.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:31:28.794 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:31:34.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:31:37.854 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:31:43.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:31:46.906 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:31:52.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:31:55.966 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:32:01.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:32:05.050 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:32:11.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:32:14.106 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:32:20.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:32:23.162 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:32:29.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:32:32.218 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:32:38.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:32:41.274 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:32:47.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:32:50.331 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:32:56.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:32:59.386 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:33:05.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:33:08.442 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:33:14.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:33:17.502 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:33:23.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:33:26.558 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:33:32.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:33:35.610 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:33:41.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:33:44.666 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:33:50.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:33:53.726 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:33:59.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:34:02.782 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:34:08.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:34:11.866 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:34:17.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:34:20.922 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:34:26.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:34:29.978 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:34:35.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:34:39.034 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:34:45.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:34:48.094 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:34:54.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:34:57.146 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:35:03.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T12:35:06.202 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-15T12:35:06.204 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 276, in _wait_for_ready
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds
2023-11-15T12:35:06.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T12:35:06.352 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=06f46b9eba6a45c8a04152cf907d26f7
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 276, in _wait_for_ready
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds
2023-11-15T12:35:06.355 INFO:teuthology.nuke:Checking targets against current locks
2023-11-15T12:35:06.425 DEBUG:teuthology.nuke:shortname: smithi080
2023-11-15T12:35:06.426 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-15T12:35:06.451 DEBUG:teuthology.nuke:shortname: smithi103
2023-11-15T12:35:06.452 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-15T12:35:06.456 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-15_09:32:33-fs-wip-vshankar-testing2-2023-11-15-1128-reef-testing-default-smithi/7459005', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 12:16:13.145192', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHo/Wk8YI/Jwl3yKITdS4QLaVerYVcC52nAzvkNfxL1ZbhfMmVfogvZGFvjITHI0Drip3rznNV1aXLysxujFoiI='}
2023-11-15T12:35:06.479 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-15_09:32:33-fs-wip-vshankar-testing2-2023-11-15-1128-reef-testing-default-smithi/7459005', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 12:16:13.142809', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKPFLYuRrrU2yfW83XcuL9PXWK9UrXTCJ1urNfPasIDHkMw0awg8BKd7LzB47mTj5mxiqld+Z9CaCm7ZH32hpgM='}
2023-11-15T12:35:06.484 DEBUG:teuthology.nuke:shortname: smithi140
2023-11-15T12:35:06.485 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-15T12:35:06.507 INFO:teuthology.orchestra.console.smithi080:Power off
2023-11-15T12:35:06.508 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T12:35:06.520 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-15_09:32:33-fs-wip-vshankar-testing2-2023-11-15-1128-reef-testing-default-smithi/7459005', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 12:16:13.144346', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOoxrL42Ldn1b7w3iJhhuGkGIJJ4s2hD57LP+UXbkWmE8JIYABXlhqpeuiNBPPrQHuPT9E7NH56WyGFLGedXzlw='}
2023-11-15T12:35:06.531 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off
2023-11-15T12:35:06.531 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:35:06.555 INFO:teuthology.orchestra.console.smithi103:Power off
2023-11-15T12:35:06.556 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T12:35:06.568 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on
2023-11-15T12:35:06.577 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off
2023-11-15T12:35:06.578 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:35:06.598 INFO:teuthology.orchestra.console.smithi140:Power off
2023-11-15T12:35:06.599 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T12:35:06.607 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2023-11-15T12:35:06.621 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off
2023-11-15T12:35:06.622 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:35:06.644 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2023-11-15T12:35:10.569 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:35:10.609 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:35:10.645 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:35:10.681 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on
2023-11-15T12:35:10.719 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2023-11-15T12:35:10.757 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2023-11-15T12:35:14.682 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:35:14.720 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:35:14.758 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:35:14.792 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2023-11-15T12:35:14.830 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2023-11-15T12:35:14.869 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2023-11-15T12:35:14.894 INFO:teuthology.orchestra.console.smithi080:Power off completed
2023-11-15T12:35:14.970 INFO:teuthology.orchestra.console.smithi140:Power off completed
2023-11-15T12:35:15.047 INFO:teuthology.lock.ops:unlocked: smithi080.front.sepia.ceph.com
2023-11-15T12:35:15.114 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com
2023-11-15T12:35:18.831 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T12:35:18.941 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2023-11-15T12:35:19.043 INFO:teuthology.orchestra.console.smithi103:Power off completed
2023-11-15T12:35:19.188 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com
2023-11-15T12:35:19.550 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 276, in _wait_for_ready
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds