2023-09-01T23:33:01.500 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-01T23:33:01.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T23:33:01.662 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f77450e0670>, signals=[15]) 2023-09-01T23:33:01.663 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-09-01T23:33:01.664 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-09-01T23:33:01.664 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-09-01T23:33:01.684 INFO:teuthology.lock.ops:Start node 'smithi122.front.sepia.ceph.com' reimaging 2023-09-01T23:33:01.685 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: reset os type and version on server 2023-09-01T23:33:01.685 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2023-09-01T23:33:01.688 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"} 2023-09-01T23:33:01.708 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-09-01T23:33:01.709 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-09-01T23:33:01.709 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-09-01T23:33:01.710 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /host {"name": "smithi122"} 2023-09-01T23:33:01.733 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-09-01T23:33:01.765 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-01T23:33:01.781 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-01T23:33:01.796 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-01T23:33:01.805 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_centos_9.stream (ID 10) 2023-09-01T23:33:01.805 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 10} 2023-09-01T23:33:01.832 DEBUG:teuthology.provision.fog.smithi122:Requesting image smithi_centos_9.stream (ID 10) 2023-09-01T23:33:01.833 DEBUG:teuthology.provision.fog.smithi122:FOG request: PUT /host/227 {"imageID": 10} 2023-09-01T23:33:01.841 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_centos_9.stream (ID 10) 2023-09-01T23:33:01.842 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 10} 2023-09-01T23:33:01.854 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 9.stream 2023-09-01T23:33:01.855 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T23:33:01.883 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of centos 9.stream 2023-09-01T23:33:01.884 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:33:01.893 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of centos 9.stream 2023-09-01T23:33:01.893 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:33:01.902 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"} 2023-09-01T23:33:01.925 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-09-01T23:33:01.933 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /tasktype {"name": "deploy"} 2023-09-01T23:33:01.938 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1} 2023-09-01T23:33:01.963 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-09-01T23:33:01.975 DEBUG:teuthology.provision.fog.smithi122:FOG request: POST /host/227/task {"taskTypeID": 1} 2023-09-01T23:33:01.999 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T23:33:02.014 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:33:02.025 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:33:02.082 INFO:teuthology.orchestra.console.smithi031:Power off 2023-09-01T23:33:02.082 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-01T23:33:02.102 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-09-01T23:33:02.103 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:02.123 INFO:teuthology.orchestra.console.smithi122:Power off 2023-09-01T23:33:02.124 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-01T23:33:02.137 INFO:teuthology.orchestra.console.smithi140:Power off 2023-09-01T23:33:02.137 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-01T23:33:02.144 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-09-01T23:33:02.146 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off 2023-09-01T23:33:02.146 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:02.158 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-09-01T23:33:02.158 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:02.167 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2023-09-01T23:33:02.179 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-01T23:33:02.246 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-09-01T23:33:02.281 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-09-01T23:33:02.347 INFO:teuthology.orchestra.console.smithi031:Power on 2023-09-01T23:33:02.348 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-01T23:33:02.368 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2023-09-01T23:33:02.369 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:02.382 INFO:teuthology.orchestra.console.smithi140:Power on 2023-09-01T23:33:02.382 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-01T23:33:02.390 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-09-01T23:33:02.402 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-09-01T23:33:02.402 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:02.424 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-01T23:33:06.170 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:06.278 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2023-09-01T23:33:06.392 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:06.426 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:06.501 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-09-01T23:33:06.535 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-01T23:33:10.282 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:10.391 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2023-09-01T23:33:10.502 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:10.536 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:10.612 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-09-01T23:33:10.645 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-01T23:33:10.713 INFO:teuthology.orchestra.console.smithi031:Power on completed 2023-09-01T23:33:10.746 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-09-01T23:33:10.814 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-09-01T23:33:10.815 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T23:33:10.848 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-09-01T23:33:10.848 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:33:14.394 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:14.502 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2023-09-01T23:33:14.603 INFO:teuthology.orchestra.console.smithi122:Power off completed 2023-09-01T23:33:14.704 INFO:teuthology.orchestra.console.smithi122:Power on 2023-09-01T23:33:14.704 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-01T23:33:14.726 DEBUG:teuthology.orchestra.console.smithi122:power on output: Chassis Power Control: Up/On 2023-09-01T23:33:14.726 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:14.747 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2023-09-01T23:33:18.750 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:33:18.858 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2023-09-01T23:33:18.961 INFO:teuthology.orchestra.console.smithi122:Power on completed 2023-09-01T23:33:19.062 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish 2023-09-01T23:33:19.062 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:33:25.884 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T23:33:25.904 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:33:34.134 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:33:40.958 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T23:33:40.963 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:33:49.211 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:33:56.030 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T23:33:56.032 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:34:04.290 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:34:11.110 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:34:11.113 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T23:34:19.375 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:34:26.188 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T23:34:26.189 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:34:34.462 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:34:41.269 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T23:34:41.276 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:34:49.545 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:34:56.362 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T23:34:56.367 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:35:04.618 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:35:11.434 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T23:35:11.435 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:35:19.706 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:35:26.510 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:35:26.515 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T23:35:26.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:35:29.658 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-09-01T23:35:34.786 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:35:35.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:35:38.718 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-09-01T23:35:41.586 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:35:44.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:35:47.806 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-09-01T23:35:49.870 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:35:53.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:35:56.644 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-01T23:35:56.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:35:56.890 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-09-01T23:35:59.806 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:36:02.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:04.962 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-09-01T23:36:05.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:05.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:05.946 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-09-01T23:36:08.122 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-09-01T23:36:08.890 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:36:11.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:14.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:14.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:17.178 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-09-01T23:36:17.950 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:36:23.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:23.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:26.238 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-09-01T23:36:27.034 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:36:32.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:33.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:35.326 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-09-01T23:36:36.094 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:36:41.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:42.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:44.410 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-09-01T23:36:45.182 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:36:50.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:51.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:36:53.470 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-09-01T23:36:54.266 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:36:59.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:37:00.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:37:11.962 WARNING:teuthology.provision.fog.smithi031:timed out 2023-09-01T23:37:17.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:37:18.281 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-01T23:37:18.282 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-01T23:37:18.653 INFO:teuthology.provision.fog.smithi031:Node is ready 2023-09-01T23:37:18.653 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2023-09-01T23:37:18.668 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2023-09-01T23:37:18.668 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2023-09-01T23:37:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2023-09-01T23:37:18.724 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-09-01T23:37:18.844 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2023-09-01T23:37:18.877 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2023-09-01T23:37:18.949 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2023-09-01T23:37:19.020 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-09-01T23:37:19.095 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-09-01T23:37:19.152 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2023-09-01T23:37:19.152 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2023-09-01T23:37:19.153 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2023-09-01T23:37:19.153 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2023-09-01T23:37:19.153 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2023-09-01T23:37:19.153 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2023-09-01T23:37:19.153 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-01T23:37:19.154 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-09-01T23:37:19.154 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2023-09-01T23:37:19.154 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-01T23:37:19.154 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2023-09-01T23:37:19.154 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-01T23:37:19.155 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-01T23:37:19.155 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-01T23:37:19.156 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2023-09-01T23:37:19.157 DEBUG:teuthology.parallel:result is None 2023-09-01T23:37:59.513 WARNING:teuthology.provision.fog.smithi122:timed out 2023-09-01T23:38:00.271 WARNING:teuthology.provision.fog.smithi140:timed out 2023-09-01T23:38:05.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:38:05.783 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-01T23:38:05.784 DEBUG:teuthology.orchestra.run.smithi122:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-01T23:38:06.137 INFO:teuthology.provision.fog.smithi122:Node is ready 2023-09-01T23:38:06.137 DEBUG:teuthology.orchestra.run.smithi122:> hostname 2023-09-01T23:38:06.153 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com 2023-09-01T23:38:06.154 DEBUG:teuthology.orchestra.run.smithi122:> grep smithi122.front.sepia.ceph.com /etc/hosts 2023-09-01T23:38:06.208 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122 2023-09-01T23:38:06.209 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122 2023-09-01T23:38:06.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:38:06.358 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hosts 2023-09-01T23:38:06.390 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/172.21.15.122/172.21.15.122/g' /etc/hosts 2023-09-01T23:38:06.459 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hostname 2023-09-01T23:38:06.530 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122 2023-09-01T23:38:06.599 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2023-09-01T23:38:06.654 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2023-09-01T23:38:06.655 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2023-09-01T23:38:06.655 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2023-09-01T23:38:06.655 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2023-09-01T23:38:06.655 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2023-09-01T23:38:06.656 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2023-09-01T23:38:06.656 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-01T23:38:06.656 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2023-09-01T23:38:06.656 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2023-09-01T23:38:06.656 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-01T23:38:06.657 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2023-09-01T23:38:06.657 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-01T23:38:06.657 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-01T23:38:06.658 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-01T23:38:06.658 INFO:teuthology.provision.fog.smithi122:Deploy complete! 2023-09-01T23:38:06.659 DEBUG:teuthology.parallel:result is None 2023-09-01T23:38:09.338 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:38:15.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:38:18.398 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:38:24.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:38:27.450 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:38:33.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:38:36.506 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:38:42.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:38:45.562 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:38:51.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:38:54.618 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:39:00.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:39:03.674 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:39:09.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:39:12.730 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:39:18.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:39:21.786 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:39:27.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:39:30.842 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:39:36.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:39:39.902 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:39:45.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:39:48.954 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:39:54.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:39:58.014 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:40:04.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:40:07.098 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:40:13.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:40:16.154 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:40:22.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:40:25.214 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:40:31.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:40:34.266 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:40:40.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:40:43.322 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:40:49.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:40:52.382 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:40:58.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:41:01.438 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:41:07.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:41:10.490 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:41:16.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:41:19.546 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:41:25.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:41:28.602 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:41:34.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:41:37.662 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:41:43.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:41:46.714 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:41:52.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:41:55.774 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:42:01.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:42:04.862 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:42:10.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:42:13.914 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:42:19.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:42:22.970 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:42:28.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:42:32.026 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:42:38.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:42:41.086 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:42:47.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:42:50.174 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:42:56.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:42:59.226 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:43:05.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:43:08.282 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:43:14.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:43:17.338 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:43:23.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:43:26.394 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:43:32.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:43:35.450 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:43:41.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:43:44.506 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:43:50.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:43:53.562 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:43:59.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:44:02.622 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:44:08.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:44:11.678 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:44:17.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:44:20.762 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:44:26.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:44:29.818 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:44:35.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:44:38.874 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:44:44.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:44:47.934 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:44:53.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:44:56.986 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:45:02.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:45:06.046 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:45:12.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:45:15.098 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:45:21.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:45:24.158 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:45:30.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:45:33.214 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:45:39.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:45:42.266 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:45:48.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:45:51.322 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:45:57.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:46:00.378 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:46:06.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:46:09.434 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:46:15.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:46:18.490 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:46:24.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:46:27.546 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:46:33.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:46:36.602 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:46:42.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:46:45.658 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:46:51.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:46:54.714 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:47:00.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:47:03.770 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:47:09.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:47:12.826 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:47:18.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:47:21.882 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:47:27.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:47:30.938 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:47:36.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:47:39.994 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:47:45.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:47:49.050 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:47:55.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:47:58.106 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:48:04.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:48:07.162 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:48:13.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:48:16.218 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:48:22.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:48:25.274 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:48:31.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:48:34.330 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:48:40.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:48:43.386 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:48:49.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:48:52.442 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:48:58.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:49:01.498 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:49:07.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:49:10.554 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:49:16.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:49:19.611 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:49:25.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:49:28.666 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:49:34.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:49:37.722 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:49:43.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:49:46.778 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:49:52.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:49:55.834 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:50:01.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:50:04.890 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:50:10.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:50:13.950 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:50:19.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:50:23.034 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:50:29.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:50:32.090 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:50:38.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:50:41.146 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:50:47.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:50:50.209 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:50:56.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:50:59.290 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:51:05.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:51:08.346 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:51:14.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:51:17.402 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:51:23.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:51:26.458 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:51:32.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:51:35.514 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:51:41.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:51:44.570 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:51:50.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T23:51:53.626 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-01T23:51:53.628 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-09-01T23:51:53.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T23:51:53.760 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=91ad795547dc41279851404ca5513918 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-09-01T23:51:53.762 INFO:teuthology.nuke:Checking targets against current locks 2023-09-01T23:51:53.828 DEBUG:teuthology.nuke:shortname: smithi031 2023-09-01T23:51:53.828 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-01T23:51:53.856 DEBUG:teuthology.nuke:shortname: smithi122 2023-09-01T23:51:53.856 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-01T23:51:53.860 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-01_23:19:02-rbd-wip-dis-testing-distro-default-smithi/7386673', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-01 23:33:00.661971', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1PoiI1pFMSjbA9n576TtAJJQ/RfuzEbndfHcYuT1Q3fUtYBk6/LHvMqv9D/Kaip+ngy1AvJjdA6x7PerbCCMQXKIsvRTSXM/W+l1aU1mL08PI1mV42u0Jjj4xl3a/HQ2Ke4nHnX/uwBISukUQcnGodrBooH4o0rRN82al0hC3y9CTZIu3tcRB143kTJb4x7dIo9QDwDLm7Sf94pNCCIfMLSClxL+8ggAsmci0zh23Z46Xh/5glA6zPE5uIcGb3X7Cne+WCpw/Qi315CPTrn2GA89FnsNmHFHS87HuDGKNBNEZvMl5Qx/QHp6RWgq+NyoKwgMgCcI/CLjMb2EyZ4BsZRIMRp0pCgijW1lZozk2LLV+kHYwZRBywXIa2XZ8w4k7LidPZ4hUPaXYk6GnyxRpWdGWLC21X1BXB7Ngs4hEDp0k+zTMxl/NA/arbXhW8nThkI7ZVE/hkuV98q+ekcizAVFPto6mNauROTPQLvlu1u63awltzngjNgkXpoa5bN0='} 2023-09-01T23:51:53.884 DEBUG:teuthology.nuke:shortname: smithi140 2023-09-01T23:51:53.885 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-01T23:51:53.889 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-01_23:19:02-rbd-wip-dis-testing-distro-default-smithi/7386673', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-01 23:33:00.660467', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBENQ2ciupEnRHr77FLVSIXJaT6klpW9krR6o3aGK80nw7padKbd3fTZDdE0BdKxduVheBoc4U9sK0rvClNxxh4g='} 2023-09-01T23:51:53.917 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-01_23:19:02-rbd-wip-dis-testing-distro-default-smithi/7386673', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-01 23:33:00.663169', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDX4sR5jmZcR6XurK2ngKmOp+rxCJtShUF8kPRNB5QYOT/vyyQMQuRG7WXUSulQNu0SHSbDG7tVgKoy1ypvf+1CQAtbo16cZunkf+BlbdN1sa2mEWLE0sK+npW+A+T7I18LflhRaRLRY10bJ2/cxUBk++bFhp2bOEpJ/bSNjvZJ+Ao++bWYXwWCCLE+HFM1dmK0PQNC43KXKIia36eHqH9eGutbjBJ550FehVJXiNX+fz8YZDv3i4rdWsbiIr73Z2jSojVhtXcif2NHEsqvIL//5O4wlvl3rpIyrTh3qHqTAO4Ik5D3SnnAsgthAOEhTv8nuR/jsDDb9syfmHc9UyhVHlwTAKF//lMJuhqwX2WoJyLvezubJd/WKMpvpPO1B+ex+CuoHpHXsoOl5UFjlVEL7WyzSqUdcgwxQ1R5SEVa8m22oar3dy064ye5jrnWyAq2XPnMUuae49iDmKPMGLfEP6bj125NUVohvTqLJdWhAQ1ThFPe94PDdM+qOPKzU50='} 2023-09-01T23:51:53.922 INFO:teuthology.orchestra.console.smithi031:Power off 2023-09-01T23:51:53.923 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-01T23:51:53.945 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-09-01T23:51:53.946 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:51:53.958 INFO:teuthology.orchestra.console.smithi122:Power off 2023-09-01T23:51:53.959 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-01T23:51:53.970 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-09-01T23:51:53.986 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off 2023-09-01T23:51:53.987 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:51:53.999 INFO:teuthology.orchestra.console.smithi140:Power off 2023-09-01T23:51:54.000 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-01T23:51:54.007 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2023-09-01T23:51:54.020 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-09-01T23:51:54.020 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:51:54.042 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-01T23:51:57.975 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:51:58.008 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:51:58.043 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:51:58.086 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-09-01T23:51:58.117 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2023-09-01T23:51:58.152 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-01T23:52:02.091 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:52:02.119 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:52:02.153 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:52:02.199 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-09-01T23:52:02.227 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2023-09-01T23:52:02.261 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-01T23:52:02.301 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-09-01T23:52:02.362 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-09-01T23:52:02.457 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com 2023-09-01T23:52:02.514 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-09-01T23:52:06.229 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T23:52:06.338 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2023-09-01T23:52:06.439 INFO:teuthology.orchestra.console.smithi122:Power off completed 2023-09-01T23:52:06.588 INFO:teuthology.lock.ops:unlocked: smithi122.front.sepia.ceph.com 2023-09-01T23:52:06.954 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds