2023-09-06T01:20:27.188 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-06T01:20:27.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T01:20:27.347 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9a5a21d670>, signals=[15]) 2023-09-06T01:20:27.348 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging 2023-09-06T01:20:27.349 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server 2023-09-06T01:20:27.349 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-09-06T01:20:27.368 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-09-06T01:20:27.368 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-09-06T01:20:27.368 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-09-06T01:20:27.370 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /host {"name": "smithi002"} 2023-09-06T01:20:27.392 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-09-06T01:20:27.393 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-09-06T01:20:27.393 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-09-06T01:20:27.394 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-09-06T01:20:27.417 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /host {"name": "smithi156"} 2023-09-06T01:20:27.447 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-06T01:20:27.457 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-06T01:20:27.483 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-06T01:20:27.486 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-06T01:20:27.487 DEBUG:teuthology.provision.fog.smithi002:FOG request: PUT /host/108 {"imageID": 5} 2023-09-06T01:20:27.501 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-06T01:20:27.501 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5} 2023-09-06T01:20:27.521 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-06T01:20:27.521 DEBUG:teuthology.provision.fog.smithi156:FOG request: PUT /host/261 {"imageID": 5} 2023-09-06T01:20:27.527 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of rhel 8.6 2023-09-06T01:20:27.527 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-06T01:20:27.544 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-09-06T01:20:27.545 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:20:27.569 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /tasktype {"name": "deploy"} 2023-09-06T01:20:27.573 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of rhel 8.6 2023-09-06T01:20:27.573 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:20:27.592 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-09-06T01:20:27.618 DEBUG:teuthology.provision.fog.smithi002:FOG request: POST /host/108/task {"taskTypeID": 1} 2023-09-06T01:20:27.629 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /tasktype {"name": "deploy"} 2023-09-06T01:20:27.634 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-09-06T01:20:27.668 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-06T01:20:27.675 DEBUG:teuthology.provision.fog.smithi156:FOG request: POST /host/261/task {"taskTypeID": 1} 2023-09-06T01:20:27.687 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:20:27.735 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:20:27.758 INFO:teuthology.orchestra.console.smithi140:Power off 2023-09-06T01:20:27.759 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T01:20:27.773 INFO:teuthology.orchestra.console.smithi002:Power off 2023-09-06T01:20:27.773 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T01:20:27.784 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-09-06T01:20:27.785 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:27.793 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-09-06T01:20:27.794 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:27.804 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-06T01:20:27.812 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-06T01:20:27.818 INFO:teuthology.orchestra.console.smithi156:Power off 2023-09-06T01:20:27.819 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T01:20:27.839 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-09-06T01:20:27.840 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:27.861 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-06T01:20:27.905 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-09-06T01:20:27.914 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-09-06T01:20:28.007 INFO:teuthology.orchestra.console.smithi140:Power on 2023-09-06T01:20:28.007 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-06T01:20:28.015 INFO:teuthology.orchestra.console.smithi002:Power on 2023-09-06T01:20:28.015 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-06T01:20:28.025 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-09-06T01:20:28.026 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:28.034 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On 2023-09-06T01:20:28.034 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:28.045 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-06T01:20:28.053 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-06T01:20:31.866 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:31.974 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-06T01:20:32.046 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:32.055 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:32.158 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-06T01:20:32.165 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-06T01:20:35.980 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:36.089 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-06T01:20:36.159 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:36.167 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:36.269 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-06T01:20:36.334 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-09-06T01:20:36.371 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-09-06T01:20:36.435 INFO:teuthology.orchestra.console.smithi002:Power on completed 2023-09-06T01:20:36.472 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-09-06T01:20:36.472 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:20:36.536 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2023-09-06T01:20:36.537 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-06T01:20:40.094 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:40.203 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-06T01:20:40.304 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-09-06T01:20:40.405 INFO:teuthology.orchestra.console.smithi156:Power on 2023-09-06T01:20:40.405 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-06T01:20:40.429 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-09-06T01:20:40.429 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:40.457 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-06T01:20:44.462 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:44.571 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-06T01:20:48.575 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:20:48.683 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-06T01:20:48.784 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-09-06T01:20:48.885 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-09-06T01:20:48.885 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:20:51.532 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:20:51.598 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-06T01:21:03.953 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:21:06.595 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:21:06.646 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-06T01:21:19.018 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:21:21.646 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:21:21.699 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-06T01:21:34.088 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:21:36.702 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:21:36.745 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-06T01:21:49.161 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:21:51.757 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:21:51.824 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-06T01:22:04.223 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:22:06.815 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:22:06.876 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-06T01:22:19.291 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:22:21.882 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:22:21.936 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-06T01:22:34.374 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:22:36.968 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:22:36.997 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-06T01:22:49.457 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:22:52.034 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:22:52.058 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-06T01:23:04.534 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:23:07.104 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:23:07.123 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-06T01:23:07.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:23:10.266 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-06T01:23:16.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:23:19.322 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-06T01:23:19.615 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:23:22.207 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-06T01:23:22.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:23:25.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:23:28.378 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-06T01:23:34.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:23:34.709 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:23:37.466 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-06T01:23:40.826 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:23:43.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:23:46.526 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-06T01:23:46.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:23:49.802 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:23:49.886 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:23:52.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:23:55.614 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-06T01:23:55.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:23:58.938 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:24:01.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:24:04.915 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-06T01:24:04.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:24:05.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:24:07.998 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:24:14.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:24:17.082 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:24:23.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:24:23.322 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-06T01:24:29.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:24:32.378 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-06T01:24:38.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:24:41.434 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-06T01:24:47.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:24:50.494 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-06T01:24:56.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:24:59.578 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-06T01:25:01.622 WARNING:teuthology.provision.fog.smithi002:timed out 2023-09-06T01:25:05.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:25:07.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:25:07.963 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-06T01:25:07.964 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-06T01:25:08.280 INFO:teuthology.provision.fog.smithi002:Node is ready 2023-09-06T01:25:08.280 DEBUG:teuthology.orchestra.run.smithi002:> hostname 2023-09-06T01:25:08.299 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2023-09-06T01:25:08.299 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts 2023-09-06T01:25:08.357 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2023-09-06T01:25:08.357 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-09-06T01:25:08.469 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts 2023-09-06T01:25:08.499 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts 2023-09-06T01:25:08.569 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname 2023-09-06T01:25:08.637 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-09-06T01:25:08.704 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-09-06T01:25:08.761 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Red Hat Enterprise Linux" 2023-09-06T01:25:08.762 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8.6 (Ootpa)" 2023-09-06T01:25:08.762 INFO:teuthology.orchestra.run.smithi002.stdout:ID="rhel" 2023-09-06T01:25:08.762 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="fedora" 2023-09-06T01:25:08.763 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8.6" 2023-09-06T01:25:08.763 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2023-09-06T01:25:08.763 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-06T01:25:08.763 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-09-06T01:25:08.763 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-06T01:25:08.764 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.redhat.com/" 2023-09-06T01:25:08.764 INFO:teuthology.orchestra.run.smithi002.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-06T01:25:08.764 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-06T01:25:08.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-09-06T01:25:08.764 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-06T01:25:08.765 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-06T01:25:08.765 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-06T01:25:08.765 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-06T01:25:08.769 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2023-09-06T01:25:08.770 DEBUG:teuthology.parallel:result is None 2023-09-06T01:25:23.102 WARNING:teuthology.provision.fog.smithi140:timed out 2023-09-06T01:25:29.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:25:47.546 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:25:53.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:25:56.602 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:26:02.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:26:05.586 WARNING:teuthology.provision.fog.smithi156:timed out 2023-09-06T01:26:05.658 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:26:11.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:26:11.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:26:11.828 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-06T01:26:11.828 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-06T01:26:12.105 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-09-06T01:26:12.106 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-09-06T01:26:12.124 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2023-09-06T01:26:12.124 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2023-09-06T01:26:12.186 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2023-09-06T01:26:12.187 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-09-06T01:26:12.333 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2023-09-06T01:26:12.361 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2023-09-06T01:26:12.431 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2023-09-06T01:26:12.502 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-09-06T01:26:12.571 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-09-06T01:26:12.630 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-09-06T01:26:12.631 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-09-06T01:26:12.631 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-09-06T01:26:12.631 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-09-06T01:26:12.631 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-09-06T01:26:12.631 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-09-06T01:26:12.632 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-06T01:26:12.632 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-09-06T01:26:12.632 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-06T01:26:12.632 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-09-06T01:26:12.632 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-06T01:26:12.633 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-06T01:26:12.633 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-06T01:26:12.633 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-06T01:26:12.633 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-06T01:26:12.633 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-06T01:26:12.634 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-06T01:26:12.634 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-09-06T01:26:12.635 DEBUG:teuthology.parallel:result is None 2023-09-06T01:26:14.714 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:26:20.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:26:23.802 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:26:29.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:26:32.858 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:26:38.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:26:41.946 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:26:47.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:26:51.002 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:26:57.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:27:00.058 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:27:06.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:27:09.114 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:27:15.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:27:18.202 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:27:24.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:27:27.294 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:27:33.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:27:36.378 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:27:42.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:27:45.434 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:27:51.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:27:54.490 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:28:00.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:28:03.546 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:28:09.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:28:12.602 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:28:18.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:28:21.658 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:28:27.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:28:30.714 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:28:36.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:28:39.802 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:28:45.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:28:48.858 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:28:54.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:28:57.946 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:29:03.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:29:07.038 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:29:13.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:29:16.122 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:29:22.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:29:25.182 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:29:31.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:29:34.270 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:29:40.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:29:43.354 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:29:49.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:29:52.410 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:29:58.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:30:01.466 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:30:07.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:30:10.554 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:30:16.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:30:19.642 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:30:25.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:30:28.698 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:30:34.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:30:37.757 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:30:43.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:30:46.846 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:30:52.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:30:55.930 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:31:01.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:31:04.986 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:31:10.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:31:14.042 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:31:20.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:31:23.130 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:31:29.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:31:32.186 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:31:38.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:31:41.242 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:31:47.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:31:50.298 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:31:56.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:31:59.390 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:32:05.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:32:08.474 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:32:14.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:32:17.562 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:32:23.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:32:26.621 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:32:32.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:32:35.710 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:32:41.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:32:44.798 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:32:50.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:32:53.886 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:32:59.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:33:02.974 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:33:08.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:33:12.062 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:33:18.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:33:21.146 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:33:27.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:33:30.202 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:33:36.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:33:39.262 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:33:45.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:33:48.349 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:33:54.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:33:57.434 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:34:03.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:34:06.490 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:34:12.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:34:15.546 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:34:21.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:34:24.638 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:34:30.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:34:33.722 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:34:39.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:34:42.782 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:34:48.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:34:51.870 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:34:57.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:35:00.958 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:35:06.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:35:10.046 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:35:16.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:35:19.134 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:35:25.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:35:28.218 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:35:34.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:35:37.274 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:35:43.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:35:46.330 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:35:52.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:35:55.386 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:36:01.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:36:04.474 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:36:10.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:36:13.534 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:36:19.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:36:22.618 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:36:28.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:36:31.674 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:36:37.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:36:40.730 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:36:46.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:36:49.786 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:36:55.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:36:58.846 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:37:04.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:37:07.930 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:37:13.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:37:16.986 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:37:22.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:37:26.046 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:37:32.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:37:35.134 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:37:41.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:37:44.222 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:37:50.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:37:53.310 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:37:59.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:38:02.394 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:38:08.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:38:11.450 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:38:17.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:38:20.514 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:38:26.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:38:29.594 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:38:35.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:38:38.650 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:38:44.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:38:47.742 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:38:53.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:38:56.798 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:39:02.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:39:05.882 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:39:11.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:39:14.938 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:39:20.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:39:24.030 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:39:30.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:39:33.118 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:39:39.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:39:42.202 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:39:48.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-06T01:39:51.258 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-06T01:39:51.260 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-09-06T01:39:51.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-06T01:39:51.414 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8b3e050e4a794cf2896f1977f1e86390 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-09-06T01:39:51.416 INFO:teuthology.nuke:Checking targets against current locks 2023-09-06T01:39:51.489 DEBUG:teuthology.nuke:shortname: smithi002 2023-09-06T01:39:51.489 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-06T01:39:51.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-05_23:49:08-rbd-wip-dis-testing-distro-default-smithi/7389550', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-06 01:20:26.392672', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-09-06T01:39:51.515 DEBUG:teuthology.nuke:shortname: smithi140 2023-09-06T01:39:51.515 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-06T01:39:51.532 DEBUG:teuthology.nuke:shortname: smithi156 2023-09-06T01:39:51.532 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-06T01:39:51.536 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-05_23:49:08-rbd-wip-dis-testing-distro-default-smithi/7389550', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-06 01:20:26.391026', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-09-06T01:39:51.558 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-05_23:49:08-rbd-wip-dis-testing-distro-default-smithi/7389550', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-06 01:20:26.393950', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCaczhrtQZg/3MbHn6LVS93VocHJnyhMVjE+3Av0ZIwOfUWJ2X18rU8s48Tdjf6VKYRfagm+Z6fRNl5rwVBDoFo='} 2023-09-06T01:39:51.567 INFO:teuthology.orchestra.console.smithi002:Power off 2023-09-06T01:39:51.568 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T01:39:51.589 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-09-06T01:39:51.589 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:39:51.606 INFO:teuthology.orchestra.console.smithi140:Power off 2023-09-06T01:39:51.608 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T01:39:51.622 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-09-06T01:39:51.632 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-09-06T01:39:51.633 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:39:51.650 INFO:teuthology.orchestra.console.smithi156:Power off 2023-09-06T01:39:51.651 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-06T01:39:51.660 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-06T01:39:51.674 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-09-06T01:39:51.674 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:39:51.698 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-06T01:39:55.626 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:39:55.662 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:39:55.699 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:39:55.735 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-09-06T01:39:55.771 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-06T01:39:55.808 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-06T01:39:59.739 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:39:59.772 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:39:59.809 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-06T01:39:59.849 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-06T01:39:59.881 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-06T01:39:59.918 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-06T01:39:59.950 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-09-06T01:39:59.982 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-09-06T01:40:00.019 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-09-06T01:40:00.096 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2023-09-06T01:40:00.129 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-09-06T01:40:00.162 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com 2023-09-06T01:40:00.550 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds