2023-08-23T06:30:04.488 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-23T06:30:04.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T06:30:04.680 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7ec6603310>, signals=[15]) 2023-08-23T06:30:04.682 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-08-23T06:30:04.683 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T06:30:04.683 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-08-23T06:30:04.708 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-08-23T06:30:04.709 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T06:30:04.709 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-08-23T06:30:04.710 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"} 2023-08-23T06:30:04.732 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-08-23T06:30:04.732 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T06:30:04.733 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-08-23T06:30:04.734 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"} 2023-08-23T06:30:04.757 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-08-23T06:30:04.786 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-23T06:30:04.820 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-23T06:30:04.821 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 5} 2023-08-23T06:30:04.827 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-23T06:30:04.838 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-23T06:30:04.863 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of rhel 8.6 2023-08-23T06:30:04.863 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:30:04.868 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-23T06:30:04.868 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 5} 2023-08-23T06:30:04.879 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-23T06:30:04.879 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5} 2023-08-23T06:30:04.915 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T06:30:04.919 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.6 2023-08-23T06:30:04.920 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:30:04.922 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-08-23T06:30:04.924 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:30:04.945 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1} 2023-08-23T06:30:04.971 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T06:30:04.975 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T06:30:05.013 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1} 2023-08-23T06:30:05.017 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:30:05.019 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-08-23T06:30:05.079 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:30:05.088 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:30:05.112 INFO:teuthology.orchestra.console.smithi064:Power off 2023-08-23T06:30:05.115 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T06:30:05.149 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-08-23T06:30:05.150 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:05.176 INFO:teuthology.orchestra.console.smithi140:Power off 2023-08-23T06:30:05.176 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T06:30:05.196 INFO:teuthology.orchestra.console.smithi124:Power off 2023-08-23T06:30:05.197 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T06:30:05.206 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-08-23T06:30:05.213 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-08-23T06:30:05.214 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:05.227 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-08-23T06:30:05.228 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:05.243 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-23T06:30:05.259 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-08-23T06:30:09.212 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:09.245 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:09.260 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:09.323 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-08-23T06:30:09.357 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-23T06:30:09.373 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-08-23T06:30:13.328 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:13.358 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:13.374 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:13.439 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-08-23T06:30:13.470 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-23T06:30:13.485 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-08-23T06:30:17.444 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:17.471 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:17.486 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:17.556 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-08-23T06:30:17.582 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-08-23T06:30:17.596 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-08-23T06:30:17.658 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-08-23T06:30:17.684 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-08-23T06:30:17.697 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-08-23T06:30:17.759 INFO:teuthology.orchestra.console.smithi064:Power on 2023-08-23T06:30:17.760 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T06:30:17.784 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2023-08-23T06:30:17.785 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:17.795 INFO:teuthology.orchestra.console.smithi140:Power on 2023-08-23T06:30:17.796 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T06:30:17.807 INFO:teuthology.orchestra.console.smithi124:Power on 2023-08-23T06:30:17.807 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T06:30:17.816 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-08-23T06:30:17.818 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-08-23T06:30:17.818 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:17.828 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-08-23T06:30:17.828 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:17.841 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-08-23T06:30:17.852 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-08-23T06:30:21.820 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:21.843 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:21.853 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:21.932 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-08-23T06:30:21.954 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-08-23T06:30:21.965 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-08-23T06:30:22.066 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-08-23T06:30:22.168 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-08-23T06:30:22.168 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:30:25.936 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:25.954 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:30:26.047 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-08-23T06:30:26.149 INFO:teuthology.orchestra.console.smithi064:Power on completed 2023-08-23T06:30:26.171 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-23T06:30:26.250 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-08-23T06:30:26.251 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:30:26.272 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-08-23T06:30:26.374 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-08-23T06:30:26.374 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:30:37.232 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:30:41.304 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:30:41.427 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:30:52.296 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:30:56.363 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:30:56.478 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:31:07.356 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:31:11.420 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:31:11.528 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:31:22.412 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:31:26.480 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:31:26.592 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:31:37.480 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:31:41.556 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:31:41.651 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:31:52.552 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:31:56.628 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:31:56.712 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:32:07.624 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:32:11.704 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:32:11.774 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:32:22.694 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:32:26.788 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:32:26.853 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:32:37.768 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:32:41.872 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:32:41.908 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:32:52.845 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:32:56.948 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:32:56.966 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:33:07.924 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-23T06:33:07.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:11.056 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-23T06:33:12.023 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-08-23T06:33:12.032 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:33:12.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:15.152 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-08-23T06:33:17.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:20.116 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-23T06:33:21.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:24.208 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-08-23T06:33:26.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:27.099 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T06:33:27.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:29.168 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-23T06:33:30.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:30.260 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:33:33.264 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-08-23T06:33:35.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:36.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:38.224 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-23T06:33:39.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:39.313 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:33:42.320 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-08-23T06:33:44.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:45.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:47.284 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-23T06:33:48.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:48.368 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:33:51.380 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-08-23T06:33:53.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:54.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:56.368 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-23T06:33:57.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:33:57.424 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:34:00.464 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-08-23T06:34:02.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:34:03.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:34:05.424 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-23T06:34:06.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:34:06.480 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:34:11.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:34:12.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:34:15.536 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:34:21.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:35:06.512 WARNING:teuthology.provision.fog.smithi064:timed out 2023-08-23T06:35:11.432 WARNING:teuthology.provision.fog.smithi124:timed out 2023-08-23T06:35:12.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:35:12.854 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T06:35:12.855 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T06:35:13.146 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-08-23T06:35:13.147 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-08-23T06:35:13.165 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-08-23T06:35:13.165 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-08-23T06:35:13.224 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-08-23T06:35:13.224 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-08-23T06:35:13.342 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-08-23T06:35:13.371 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-08-23T06:35:13.439 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-08-23T06:35:13.507 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-08-23T06:35:13.574 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-08-23T06:35:13.631 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Red Hat Enterprise Linux" 2023-08-23T06:35:13.631 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8.6 (Ootpa)" 2023-08-23T06:35:13.632 INFO:teuthology.orchestra.run.smithi064.stdout:ID="rhel" 2023-08-23T06:35:13.632 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="fedora" 2023-08-23T06:35:13.632 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8.6" 2023-08-23T06:35:13.632 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-08-23T06:35:13.632 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-23T06:35:13.633 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-08-23T06:35:13.633 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-23T06:35:13.633 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.redhat.com/" 2023-08-23T06:35:13.633 INFO:teuthology.orchestra.run.smithi064.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-23T06:35:13.633 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T06:35:13.633 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-08-23T06:35:13.633 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-23T06:35:13.634 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-23T06:35:13.634 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-23T06:35:13.634 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-23T06:35:13.634 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-08-23T06:35:13.636 DEBUG:teuthology.parallel:result is None 2023-08-23T06:35:17.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:35:17.665 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T06:35:17.665 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T06:35:17.974 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-08-23T06:35:17.974 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-08-23T06:35:17.993 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2023-08-23T06:35:17.993 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts 2023-08-23T06:35:18.052 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-08-23T06:35:18.053 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-08-23T06:35:18.188 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts 2023-08-23T06:35:18.222 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-08-23T06:35:18.294 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname 2023-08-23T06:35:18.366 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-08-23T06:35:18.438 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-08-23T06:35:18.498 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-08-23T06:35:18.498 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)" 2023-08-23T06:35:18.499 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-08-23T06:35:18.499 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-08-23T06:35:18.499 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6" 2023-08-23T06:35:18.499 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-08-23T06:35:18.499 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-23T06:35:18.499 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-08-23T06:35:18.500 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-23T06:35:18.500 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-08-23T06:35:18.500 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-23T06:35:18.500 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T06:35:18.500 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-08-23T06:35:18.500 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-23T06:35:18.501 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-23T06:35:18.501 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-23T06:35:18.501 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-23T06:35:18.501 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-08-23T06:35:18.502 DEBUG:teuthology.parallel:result is None 2023-08-23T06:35:21.544 WARNING:teuthology.provision.fog.smithi140:timed out 2023-08-23T06:35:27.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:35:45.908 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:35:51.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:35:54.992 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:36:00.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:36:04.048 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:36:10.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:36:13.136 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:36:19.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:36:22.192 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:36:28.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:36:31.248 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:36:37.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:36:40.304 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:36:46.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:36:49.360 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:36:55.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:36:58.420 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:37:04.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:37:07.504 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:37:13.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:37:16.564 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:37:22.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:37:25.648 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:37:31.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:37:34.704 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:37:40.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:37:43.760 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:37:49.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:37:52.820 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:37:58.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:38:01.904 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:38:07.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:38:10.960 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:38:16.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:38:20.016 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:38:26.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:38:29.072 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:38:35.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:38:38.132 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:38:44.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:38:47.216 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:38:53.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:38:56.272 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:39:02.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:39:05.328 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:39:11.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:39:14.384 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:39:20.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:39:23.440 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:39:29.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:39:32.528 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:39:38.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:39:41.584 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:39:47.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:39:50.640 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:39:56.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:39:59.700 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:40:05.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:40:08.788 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:40:14.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:40:17.872 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:40:23.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:40:26.928 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:40:32.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:40:36.016 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:40:42.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:40:45.076 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:40:51.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:40:54.164 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:41:00.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:41:03.248 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:41:09.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:41:12.304 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:41:18.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:41:21.360 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:41:27.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:41:30.416 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:41:36.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:41:39.472 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:41:45.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:41:48.560 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:41:54.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:41:57.616 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:42:03.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:42:06.704 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:42:12.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:42:15.760 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:42:21.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:42:24.816 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:42:30.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:42:33.872 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:42:39.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:42:42.964 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:42:48.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:42:52.048 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:42:58.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:43:01.104 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:43:07.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:43:10.160 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:43:16.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:43:19.216 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:43:25.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:43:28.272 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:43:34.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:43:37.328 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:43:43.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:43:46.384 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:43:52.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:43:55.440 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:44:01.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:44:04.500 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:44:10.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:44:13.584 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:44:19.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:44:22.640 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:44:28.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:44:31.696 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:44:37.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:44:40.752 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:44:46.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:44:49.808 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:44:55.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:44:58.896 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:45:04.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:45:07.952 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:45:13.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:45:17.040 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:45:23.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:45:26.096 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:45:32.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:45:35.184 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:45:41.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:45:44.240 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:45:50.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:45:53.300 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:45:59.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:46:02.385 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:46:08.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:46:11.728 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:46:17.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:46:20.788 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:46:26.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:46:29.872 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:46:35.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:46:38.928 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:46:44.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:46:47.984 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:46:53.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:46:57.040 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:47:03.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:47:06.096 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:47:12.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:47:15.152 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:47:21.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:47:24.208 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:47:30.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:47:33.264 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:47:39.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:47:42.352 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:47:48.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:47:51.408 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:47:57.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:48:00.464 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:48:06.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:48:09.520 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:48:15.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:48:18.576 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:48:24.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:48:27.632 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:48:33.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:48:36.720 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:48:42.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:48:45.776 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:48:51.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:48:54.864 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:49:00.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:49:03.920 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:49:09.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:49:12.976 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:49:18.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:49:22.032 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:49:28.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:49:31.088 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:49:37.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T06:49:40.144 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T06:49:40.146 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-08-23T06:49:40.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T06:49:40.482 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=6d66e13e8c654bfca8825e6ababaefcd Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-08-23T06:49:40.485 INFO:teuthology.nuke:Checking targets against current locks 2023-08-23T06:49:40.557 DEBUG:teuthology.nuke:shortname: smithi064 2023-08-23T06:49:40.558 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T06:49:40.577 DEBUG:teuthology.nuke:shortname: smithi124 2023-08-23T06:49:40.578 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T06:49:40.581 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-23_03:59:53-fs-wip-vshankar-testing-20230822.060131-testing-default-smithi/7377276', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 06:30:03.594433', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFIQG8OEdKXriWGd3JrVe/jgTKpNNniMqaAluyq4dGAeW7zY/Q5hBDJXFrcD6m/vbwwusgh/uitHyq+HjqUrlS4='} 2023-08-23T06:49:40.603 DEBUG:teuthology.nuke:shortname: smithi140 2023-08-23T06:49:40.604 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T06:49:40.612 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-23_03:59:53-fs-wip-vshankar-testing-20230822.060131-testing-default-smithi/7377276', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 06:30:03.592841', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPnIFtJzhnGBuRsXQXVSPcZca9hg3eWWSMa9/yhUJgUuWJj7ZmbUwhOBrHejq9JV3fg2bGjrywRAQzAif5pyY80='} 2023-08-23T06:49:40.644 INFO:teuthology.orchestra.console.smithi064:Power off 2023-08-23T06:49:40.645 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T06:49:40.656 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-23_03:59:53-fs-wip-vshankar-testing-20230822.060131-testing-default-smithi/7377276', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 06:30:03.591299', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDh7l6NxNfm7P5hEupSeOgR3XnlR0sFJwtUsvZSw1gDmqYAwb8C6fCPixdy3uZ5qP+gOtVKgSKE2rxF+kyYq2RZfyyNH0h1RZk3wHP9sBlXuXwj3pcfeNrrKGDmOmvAZ9DsAeJgDc/kYr+Sc7ybu3CVpuudaHe22hcF8jbaOWlJERb9gf14HWfda9GESsF52L/YnqhvIebP7JShPBtFwG/Cs91MiJoDQSsux+D6vgFljK6h2s7ni5A84Lx3IwljvDJOwLrNL1fII4WX+OYygCLtmHvG16xNwQ87ADQZVOJzsGEwQ/DnZntRSu+n4aLaRGlY6PkcLnNO98I4mSwqNYjtZZt5oeQiCvWkkCVTIN/1uX3Hbz8pUn6h/L2/RyoN3Xavh3A2c9j8aW8xcLVV79hZrSaaxa70ONhdQK58UouZoKYzQBwaaU+/10fkr/rSgE5y7pLuqSPMJm+xm6cGMejseS0aJPuL09OyoR7c04YfxEsYsf0IiHk2j20yU8ab+uE='} 2023-08-23T06:49:40.670 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-08-23T06:49:40.671 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:49:40.693 INFO:teuthology.orchestra.console.smithi124:Power off 2023-08-23T06:49:40.694 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T06:49:40.705 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-08-23T06:49:40.717 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-08-23T06:49:40.718 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:49:40.734 INFO:teuthology.orchestra.console.smithi140:Power off 2023-08-23T06:49:40.735 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T06:49:40.746 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-08-23T06:49:40.760 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-08-23T06:49:40.760 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:49:40.785 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-23T06:49:44.710 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:49:44.747 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:49:44.788 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:49:44.820 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-08-23T06:49:44.859 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-08-23T06:49:44.903 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-23T06:49:48.824 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:49:48.860 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:49:48.904 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:49:48.936 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-08-23T06:49:48.972 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-08-23T06:49:49.017 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-23T06:49:49.037 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-08-23T06:49:49.073 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-08-23T06:49:49.196 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-08-23T06:49:49.221 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com 2023-08-23T06:49:53.020 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:49:53.131 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-08-23T06:49:53.232 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-08-23T06:49:53.380 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-08-23T06:49:53.728 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds