2023-08-25T04:31:37.834 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-25T04:31:37.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T04:31:38.012 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa57f525310>, signals=[15]) 2023-08-25T04:31:38.013 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2023-08-25T04:31:38.014 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2023-08-25T04:31:38.014 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-08-25T04:31:38.040 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-08-25T04:31:38.040 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-08-25T04:31:38.041 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-08-25T04:31:38.043 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /host {"name": "smithi073"} 2023-08-25T04:31:38.064 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-08-25T04:31:38.064 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-08-25T04:31:38.065 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-08-25T04:31:38.066 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-08-25T04:31:38.089 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-08-25T04:31:38.114 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-25T04:31:38.141 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-25T04:31:38.160 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-25T04:31:38.160 DEBUG:teuthology.provision.fog.smithi073:FOG request: PUT /host/178 {"imageID": 5} 2023-08-25T04:31:38.164 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-25T04:31:38.183 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-25T04:31:38.183 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 5} 2023-08-25T04:31:38.208 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-25T04:31:38.208 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5} 2023-08-25T04:31:38.212 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of rhel 8.6 2023-08-25T04:31:38.212 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-25T04:31:38.234 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of rhel 8.6 2023-08-25T04:31:38.234 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:31:38.262 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-08-25T04:31:38.262 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:31:38.291 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /tasktype {"name": "deploy"} 2023-08-25T04:31:38.306 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-08-25T04:31:38.332 DEBUG:teuthology.provision.fog.smithi073:FOG request: POST /host/178/task {"taskTypeID": 1} 2023-08-25T04:31:38.336 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-08-25T04:31:38.344 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-08-25T04:31:38.381 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-08-25T04:31:38.394 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-25T04:31:38.402 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:31:38.432 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:31:38.509 INFO:teuthology.orchestra.console.smithi098:Power off 2023-08-25T04:31:38.509 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T04:31:38.531 INFO:teuthology.orchestra.console.smithi140:Power off 2023-08-25T04:31:38.531 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T04:31:38.547 INFO:teuthology.orchestra.console.smithi073:Power off 2023-08-25T04:31:38.549 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T04:31:38.560 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-08-25T04:31:38.561 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:38.569 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-08-25T04:31:38.571 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:38.581 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-08-25T04:31:38.582 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:38.593 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-25T04:31:38.595 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-25T04:31:38.606 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-08-25T04:31:42.597 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:42.606 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:42.614 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:42.708 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-25T04:31:42.716 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-25T04:31:42.728 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-08-25T04:31:46.712 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:46.720 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:46.729 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:46.823 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-25T04:31:46.831 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-25T04:31:46.840 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-08-25T04:31:46.933 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-08-25T04:31:46.941 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-08-25T04:31:47.034 INFO:teuthology.orchestra.console.smithi098:Power on 2023-08-25T04:31:47.035 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-25T04:31:47.043 INFO:teuthology.orchestra.console.smithi073:Power on 2023-08-25T04:31:47.043 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-25T04:31:47.056 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2023-08-25T04:31:47.057 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:47.069 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On 2023-08-25T04:31:47.070 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:47.080 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-25T04:31:47.094 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-08-25T04:31:50.826 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:50.937 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-08-25T04:31:51.038 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-08-25T04:31:51.082 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:51.096 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:51.139 INFO:teuthology.orchestra.console.smithi140:Power on 2023-08-25T04:31:51.140 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-25T04:31:51.162 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-08-25T04:31:51.163 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:51.184 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-08-25T04:31:51.195 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-25T04:31:51.206 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-08-25T04:31:55.188 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:55.197 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:55.208 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:55.299 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-08-25T04:31:55.310 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-25T04:31:55.319 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-08-25T04:31:55.413 INFO:teuthology.orchestra.console.smithi098:Power on completed 2023-08-25T04:31:55.420 INFO:teuthology.orchestra.console.smithi073:Power on completed 2023-08-25T04:31:55.514 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-08-25T04:31:55.515 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:31:55.521 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2023-08-25T04:31:55.521 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-25T04:31:59.304 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:31:59.498 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-25T04:31:59.600 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-08-25T04:31:59.701 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-08-25T04:31:59.701 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:32:10.607 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-25T04:32:10.608 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:32:14.800 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:32:25.684 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-25T04:32:25.686 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:32:29.884 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:32:40.773 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:32:40.774 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-25T04:32:44.964 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:32:55.848 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:32:55.851 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-25T04:33:00.043 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:33:10.932 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:33:10.933 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-25T04:33:15.117 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:33:25.996 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:33:26.074 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-25T04:33:30.188 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:33:41.152 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-25T04:33:41.153 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:33:45.268 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:33:56.236 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-25T04:33:56.237 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:34:00.344 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:34:11.316 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:34:11.318 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-25T04:34:15.412 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:34:26.388 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:34:26.390 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-25T04:34:26.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:34:30.473 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:34:41.447 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-25T04:34:41.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:34:44.560 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-25T04:34:45.531 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-25T04:34:45.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:34:48.660 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:34:50.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:34:53.616 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-25T04:34:54.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:34:57.712 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:34:59.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:35:02.672 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-25T04:35:03.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:35:06.768 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:35:08.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:35:11.730 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-25T04:35:12.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:35:15.824 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:35:17.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:35:20.816 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-25T04:35:21.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:35:24.880 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:35:26.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:35:27.199 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: Authentication timeout. 2023-08-25T04:35:27.201 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-25T04:35:27.203 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-25T04:35:29.876 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-25T04:35:30.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:35:33.936 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:35:35.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:35:39.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:35:42.992 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:35:48.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:35:52.048 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:35:58.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:36:18.672 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-25T04:36:18.674 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi073 2023-08-25T04:36:27.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-25T04:36:27.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:36:28.032 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-08-25T04:36:28.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-25T04:36:28.337 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-25T04:36:28.337 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-25T04:36:28.354 INFO:teuthology.provision.fog.smithi073:Node is ready 2023-08-25T04:36:28.355 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2023-08-25T04:36:28.411 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073 2023-08-25T04:36:28.411 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073 /etc/hosts 2023-08-25T04:36:28.468 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2023-08-25T04:36:28.469 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-08-25T04:36:28.590 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073/smithi073/g' /etc/hosts 2023-08-25T04:36:28.617 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts 2023-08-25T04:36:28.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073/smithi073/g' /etc/hostname 2023-08-25T04:36:28.750 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-08-25T04:36:28.816 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-08-25T04:36:28.872 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T04:36:28.873 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T04:36:28.873 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel" 2023-08-25T04:36:28.873 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora" 2023-08-25T04:36:28.873 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.6" 2023-08-25T04:36:28.873 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-08-25T04:36:28.874 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T04:36:28.874 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-08-25T04:36:28.874 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T04:36:28.874 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T04:36:28.874 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T04:36:28.874 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T04:36:28.875 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-25T04:36:28.875 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T04:36:28.875 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T04:36:28.875 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T04:36:28.875 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T04:36:28.876 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2023-08-25T04:36:28.877 DEBUG:teuthology.parallel:result is None 2023-08-25T04:36:35.884 WARNING:teuthology.provision.fog.smithi098:timed out 2023-08-25T04:36:41.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:36:42.134 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-25T04:36:42.134 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-25T04:36:42.410 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-08-25T04:36:42.411 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-08-25T04:36:42.427 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-08-25T04:36:42.428 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-08-25T04:36:42.484 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-08-25T04:36:42.485 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-08-25T04:36:42.599 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-08-25T04:36:42.628 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-08-25T04:36:42.695 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-08-25T04:36:42.761 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-08-25T04:36:42.826 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-08-25T04:36:42.883 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T04:36:42.883 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T04:36:42.883 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel" 2023-08-25T04:36:42.884 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora" 2023-08-25T04:36:42.884 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.6" 2023-08-25T04:36:42.884 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-08-25T04:36:42.884 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T04:36:42.884 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-08-25T04:36:42.884 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T04:36:42.885 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T04:36:42.885 INFO:teuthology.orchestra.run.smithi098.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T04:36:42.885 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T04:36:42.885 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-08-25T04:36:42.885 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T04:36:42.885 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T04:36:42.885 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T04:36:42.886 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T04:36:42.886 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-08-25T04:36:42.886 DEBUG:teuthology.parallel:result is None 2023-08-25T04:36:58.065 WARNING:teuthology.provision.fog.smithi140:timed out 2023-08-25T04:37:04.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:37:07.152 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:37:13.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:37:16.208 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:37:22.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:37:25.268 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:37:31.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:37:34.352 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:37:40.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:37:43.408 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:37:49.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:37:52.464 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:37:58.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:38:01.520 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:38:07.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:38:10.576 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:38:16.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:38:19.664 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:38:25.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:38:28.756 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:38:34.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:38:37.840 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:38:43.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:38:46.896 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:38:52.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:38:55.952 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:39:01.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:39:05.040 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:39:11.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:39:14.096 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:39:20.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:39:23.189 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:39:29.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:39:32.276 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:39:38.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:39:41.361 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:39:47.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:39:50.416 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:39:56.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:39:59.476 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:40:05.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:40:08.560 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:40:14.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:40:17.616 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:40:23.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:40:26.672 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:40:32.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:40:35.728 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:40:41.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:40:44.785 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:40:50.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:40:53.940 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:40:59.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:41:03.024 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:41:09.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:41:12.080 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:41:18.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:41:21.136 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:41:27.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:41:30.196 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:41:36.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:41:39.284 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:41:45.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:41:48.368 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:41:54.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:41:57.428 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:42:03.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:42:06.512 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:42:12.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:42:15.568 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:42:21.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:42:24.624 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:42:30.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:42:33.684 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:42:39.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:42:42.768 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:42:48.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:42:51.824 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:42:57.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:43:00.884 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:43:06.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:43:09.968 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:43:15.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:43:19.024 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:43:25.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:43:28.080 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:43:34.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:43:37.136 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:43:43.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:43:46.228 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:43:52.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:43:55.312 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:44:01.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:44:04.369 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:44:10.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:44:13.460 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:44:19.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:44:22.544 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:44:28.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:44:31.600 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:44:37.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:44:40.660 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:44:46.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:44:49.748 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:44:55.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:44:58.836 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:45:04.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:45:07.920 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:45:13.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:45:17.008 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:45:23.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:45:26.064 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:45:32.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:45:35.120 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:45:41.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:45:44.180 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:45:50.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:45:53.264 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:45:59.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:46:02.320 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:46:08.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:46:11.376 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:46:17.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:46:20.432 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:46:26.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:46:29.493 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:46:35.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:46:38.576 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:46:44.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:46:47.636 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:46:53.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:46:56.720 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:47:02.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:47:05.808 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:47:11.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:47:14.864 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:47:20.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:47:23.920 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:47:29.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:47:33.012 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:47:39.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:47:42.096 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:47:48.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:47:51.184 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:47:57.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:48:00.240 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:48:06.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:48:09.296 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:48:15.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:48:18.352 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:48:24.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:48:27.408 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:48:33.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:48:36.464 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:48:42.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:48:45.552 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:48:51.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:48:54.640 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:49:00.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:49:03.700 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:49:09.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:49:12.788 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:49:18.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:49:21.872 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:49:27.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:49:30.928 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:49:36.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:49:39.988 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:49:45.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:49:49.072 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:49:55.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:49:58.128 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:50:04.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:50:07.184 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:50:13.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:50:16.273 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:50:22.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:50:25.360 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:50:31.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:50:34.448 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:50:40.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:50:43.536 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-25T04:50:43.538 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-08-25T04:50:43.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T04:50:43.690 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b43c1f99696846179d87d7a1b2cf00b4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-08-25T04:50:43.693 INFO:teuthology.nuke:Checking targets against current locks 2023-08-25T04:50:43.763 DEBUG:teuthology.nuke:shortname: smithi073 2023-08-25T04:50:43.766 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T04:50:43.791 DEBUG:teuthology.nuke:shortname: smithi098 2023-08-25T04:50:43.792 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T04:50:43.796 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379094', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 04:31:36.919723', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-25T04:50:43.802 DEBUG:teuthology.nuke:shortname: smithi140 2023-08-25T04:50:43.803 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T04:50:43.821 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379094', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 04:31:36.916185', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPfulN+UM5xPt+dh+eeWnVdOiRaaPoSIpB8r9ttLdh3Ewg3tO4C3JCZhhhKy6mQokkxxduCwe4ikEJKnP+HDFPmHKJ+czcDju0ZlhVzB9Is+CcRbk6gGOXOJjQAz6iNjnYIxb+MEYmrnayCb1ywednuQ9IdnjadtRj0yAYBRTAzqo0WggEdhCiIgNukNW1JdSdnFKzxhuflGli6vux7jA/GmUAseJtJsEsqpszELTyvWA+lp2BHq/oSaSYV65qZCdpXxTkhmiuqdi8P9rijTEL1EKgPjwyQBi9mVqy/w5qnHVsgpMLQxNNZAR7ikRaTc448PRJ2ZRmijz8zQNVYVuohb1QYdGP+ISp+TDU6UmtA6jkZ9GhXSTVLAVq5gaN+PWeXg9p+qsqrNJAwdvzJhgF3Nlhoi1CQhGllwt2YSdADa+58e55Lt2gWQeJG+gnoXz9TqYE2pZE+FngNFtCdPfsyjuUd3dIGnN2NofrLjVEeEKlw/ZvVIRqZKWVaVDuDrs='} 2023-08-25T04:50:43.826 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379094', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 04:31:36.918210', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNAta3djC85IeizlfccCC2Lvzy9nCxVCcb1keV9pBmJQYCH+rGn/dn1knB3E8CpVOrr6tBL7EKdGLs4sV9mwco0='} 2023-08-25T04:50:43.848 INFO:teuthology.orchestra.console.smithi073:Power off 2023-08-25T04:50:43.849 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T04:50:43.872 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-08-25T04:50:43.872 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:50:43.893 INFO:teuthology.orchestra.console.smithi140:Power off 2023-08-25T04:50:43.895 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T04:50:43.913 INFO:teuthology.orchestra.console.smithi098:Power off 2023-08-25T04:50:43.914 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T04:50:43.923 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-08-25T04:50:43.925 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-08-25T04:50:43.925 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:50:43.936 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-08-25T04:50:43.937 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:50:43.950 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-25T04:50:43.962 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-25T04:50:47.928 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:50:47.952 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:50:47.964 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:50:48.042 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-08-25T04:50:48.065 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-25T04:50:48.079 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-25T04:50:52.044 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:50:52.066 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:50:52.081 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:50:52.156 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-08-25T04:50:52.179 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-25T04:50:52.194 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-25T04:50:56.160 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:50:56.180 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:50:56.196 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T04:50:56.272 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-08-25T04:50:56.291 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-08-25T04:50:56.309 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-25T04:50:56.374 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-08-25T04:50:56.393 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-08-25T04:50:56.410 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-08-25T04:50:56.524 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com 2023-08-25T04:50:56.549 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-08-25T04:50:56.557 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com 2023-08-25T04:50:56.972 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds