2023-08-23T05:32:59.297 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-23T05:32:59.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T05:32:59.523 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f20ac09fee0>, signals=[15]) 2023-08-23T05:32:59.525 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2023-08-23T05:32:59.525 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T05:32:59.526 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-08-23T05:32:59.548 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2023-08-23T05:32:59.548 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T05:32:59.549 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-08-23T05:32:59.552 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"} 2023-08-23T05:32:59.573 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-08-23T05:32:59.574 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T05:32:59.574 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-08-23T05:32:59.576 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /host {"name": "smithi135"} 2023-08-23T05:32:59.597 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2023-08-23T05:32:59.598 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T05:32:59.598 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-08-23T05:32:59.600 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-08-23T05:32:59.624 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /host {"name": "smithi188"} 2023-08-23T05:32:59.632 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-23T05:32:59.642 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-23T05:32:59.667 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-23T05:32:59.682 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-23T05:32:59.682 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 5} 2023-08-23T05:32:59.688 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-23T05:32:59.688 DEBUG:teuthology.provision.fog.smithi135:FOG request: PUT /host/240 {"imageID": 5} 2023-08-23T05:32:59.693 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-23T05:32:59.712 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-23T05:32:59.712 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5} 2023-08-23T05:32:59.731 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of rhel 8.6 2023-08-23T05:32:59.732 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:32:59.735 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-23T05:32:59.735 DEBUG:teuthology.provision.fog.smithi188:FOG request: PUT /host/293 {"imageID": 5} 2023-08-23T05:32:59.738 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of rhel 8.6 2023-08-23T05:32:59.738 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:32:59.761 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-08-23T05:32:59.762 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:32:59.782 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of rhel 8.6 2023-08-23T05:32:59.782 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:32:59.798 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T05:32:59.807 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T05:32:59.840 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T05:32:59.845 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1} 2023-08-23T05:32:59.848 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T05:32:59.855 DEBUG:teuthology.provision.fog.smithi135:FOG request: POST /host/240/task {"taskTypeID": 1} 2023-08-23T05:32:59.883 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-08-23T05:32:59.887 DEBUG:teuthology.provision.fog.smithi188:FOG request: POST /host/293/task {"taskTypeID": 1} 2023-08-23T05:32:59.901 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:32:59.918 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:32:59.940 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:32:59.943 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:33:00.018 INFO:teuthology.orchestra.console.smithi111:Power off 2023-08-23T05:33:00.019 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T05:33:00.038 INFO:teuthology.orchestra.console.smithi140:Power off 2023-08-23T05:33:00.039 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T05:33:00.055 INFO:teuthology.orchestra.console.smithi188:Power off 2023-08-23T05:33:00.056 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T05:33:00.074 INFO:teuthology.orchestra.console.smithi135:Power off 2023-08-23T05:33:00.074 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T05:33:00.086 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-08-23T05:33:00.087 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:00.098 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-08-23T05:33:00.099 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:00.110 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-08-23T05:33:00.111 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:00.120 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-08-23T05:33:00.120 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:00.131 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-23T05:33:00.132 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-08-23T05:33:00.132 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-08-23T05:33:00.145 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-08-23T05:33:04.136 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:04.147 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:04.155 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:04.164 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:04.250 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-23T05:33:04.257 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-08-23T05:33:04.266 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-08-23T05:33:04.279 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-08-23T05:33:08.252 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:08.261 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:08.269 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:08.281 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:08.364 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-08-23T05:33:08.371 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-08-23T05:33:08.384 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-08-23T05:33:08.395 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-08-23T05:33:08.466 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-08-23T05:33:08.473 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-08-23T05:33:08.568 INFO:teuthology.orchestra.console.smithi140:Power on 2023-08-23T05:33:08.568 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T05:33:08.578 INFO:teuthology.orchestra.console.smithi188:Power on 2023-08-23T05:33:08.578 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T05:33:08.590 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-08-23T05:33:08.591 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:08.603 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On 2023-08-23T05:33:08.604 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:08.615 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-08-23T05:33:08.627 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-08-23T05:33:12.388 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:12.397 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:12.499 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-08-23T05:33:12.508 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-08-23T05:33:12.601 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-08-23T05:33:12.609 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-08-23T05:33:12.617 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:12.628 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:12.702 INFO:teuthology.orchestra.console.smithi111:Power on 2023-08-23T05:33:12.702 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T05:33:12.711 INFO:teuthology.orchestra.console.smithi135:Power on 2023-08-23T05:33:12.712 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T05:33:12.725 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On 2023-08-23T05:33:12.727 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:12.736 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On 2023-08-23T05:33:12.736 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:12.745 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-08-23T05:33:12.747 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-08-23T05:33:12.748 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-08-23T05:33:12.758 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-08-23T05:33:16.748 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:16.758 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:16.771 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:16.781 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:33:16.860 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-23T05:33:16.873 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-08-23T05:33:16.882 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-08-23T05:33:16.895 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-08-23T05:33:16.962 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-08-23T05:33:16.975 INFO:teuthology.orchestra.console.smithi188:Power on completed 2023-08-23T05:33:16.984 INFO:teuthology.orchestra.console.smithi111:Power on completed 2023-08-23T05:33:16.997 INFO:teuthology.orchestra.console.smithi135:Power on completed 2023-08-23T05:33:17.064 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-08-23T05:33:17.065 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:33:17.076 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2023-08-23T05:33:17.077 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:33:17.085 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2023-08-23T05:33:17.086 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:33:17.098 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2023-08-23T05:33:17.098 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:33:32.154 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:33:32.155 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:33:32.158 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:33:32.159 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:33:47.232 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:33:47.234 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:33:47.235 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:33:47.239 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:34:02.309 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:34:02.310 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:34:02.311 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:34:02.312 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:34:17.380 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:34:17.381 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:34:17.383 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:34:17.388 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:34:32.460 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:34:32.462 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:34:32.467 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:34:32.470 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:34:47.542 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:34:47.543 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:34:47.544 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:34:47.547 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:35:02.620 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:35:02.621 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:35:02.622 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:35:02.623 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:35:17.708 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:35:17.709 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:35:17.712 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:35:17.713 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:35:32.804 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:35:32.806 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:35:32.807 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:35:32.808 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:35:47.896 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:35:47.898 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:35:47.899 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:35:47.900 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:36:02.996 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-08-23T05:36:02.997 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-08-23T05:36:02.998 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:36:03.000 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-08-23T05:36:03.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:03.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:03.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:06.128 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-23T05:36:06.132 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-08-23T05:36:06.164 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:36:12.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:12.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:12.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:15.184 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-23T05:36:15.185 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-08-23T05:36:15.216 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:36:18.076 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-08-23T05:36:18.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:21.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:21.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:21.200 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-23T05:36:21.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:24.240 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-23T05:36:24.241 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-08-23T05:36:24.272 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:36:27.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:30.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:30.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:30.260 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-23T05:36:30.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:33.296 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-23T05:36:33.297 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-08-23T05:36:33.328 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:36:36.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:39.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:39.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:39.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:39.348 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-23T05:36:42.352 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-23T05:36:42.353 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-08-23T05:36:42.384 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:36:45.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:48.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:48.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:48.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:48.432 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-23T05:36:51.408 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-08-23T05:36:51.409 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-08-23T05:36:51.444 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:36:54.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:57.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:57.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:57.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:36:57.492 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-23T05:37:00.496 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:37:03.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:37:06.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:37:06.580 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-23T05:37:09.552 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:37:12.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:37:15.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:37:15.664 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-23T05:37:21.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:37:24.720 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-08-23T05:37:30.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:37:57.440 WARNING:teuthology.provision.fog.smithi188:timed out 2023-08-23T05:37:57.441 WARNING:teuthology.provision.fog.smithi135:timed out 2023-08-23T05:38:03.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:38:03.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:38:03.781 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T05:38:03.782 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T05:38:03.790 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T05:38:03.791 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T05:38:04.061 INFO:teuthology.provision.fog.smithi188:Node is ready 2023-08-23T05:38:04.062 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2023-08-23T05:38:04.079 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188 2023-08-23T05:38:04.080 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188 /etc/hosts 2023-08-23T05:38:04.082 INFO:teuthology.provision.fog.smithi135:Node is ready 2023-08-23T05:38:04.082 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2023-08-23T05:38:04.101 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135 2023-08-23T05:38:04.102 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135 /etc/hosts 2023-08-23T05:38:04.139 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2023-08-23T05:38:04.139 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-08-23T05:38:04.161 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2023-08-23T05:38:04.162 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-08-23T05:38:04.269 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188/smithi188/g' /etc/hosts 2023-08-23T05:38:04.285 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135/smithi135/g' /etc/hosts 2023-08-23T05:38:04.299 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2023-08-23T05:38:04.318 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts 2023-08-23T05:38:04.367 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188/smithi188/g' /etc/hostname 2023-08-23T05:38:04.388 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135/smithi135/g' /etc/hostname 2023-08-23T05:38:04.434 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-08-23T05:38:04.456 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-08-23T05:38:04.500 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-08-23T05:38:04.523 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-08-23T05:38:04.558 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2023-08-23T05:38:04.558 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.6 (Ootpa)" 2023-08-23T05:38:04.558 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2023-08-23T05:38:04.559 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2023-08-23T05:38:04.559 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.6" 2023-08-23T05:38:04.559 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-08-23T05:38:04.559 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-23T05:38:04.560 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-08-23T05:38:04.560 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-23T05:38:04.560 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2023-08-23T05:38:04.561 INFO:teuthology.orchestra.run.smithi188.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-23T05:38:04.561 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T05:38:04.562 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-08-23T05:38:04.562 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-23T05:38:04.562 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-23T05:38:04.563 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-23T05:38:04.563 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-23T05:38:04.564 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2023-08-23T05:38:04.566 DEBUG:teuthology.parallel:result is None 2023-08-23T05:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2023-08-23T05:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)" 2023-08-23T05:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2023-08-23T05:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2023-08-23T05:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6" 2023-08-23T05:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-08-23T05:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-23T05:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-08-23T05:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-23T05:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2023-08-23T05:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-23T05:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T05:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-08-23T05:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-23T05:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-23T05:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-23T05:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-23T05:38:04.587 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2023-08-23T05:38:04.588 DEBUG:teuthology.parallel:result is None 2023-08-23T05:38:15.568 WARNING:teuthology.provision.fog.smithi140:timed out 2023-08-23T05:38:21.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:38:24.624 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:38:30.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:38:30.727 WARNING:teuthology.provision.fog.smithi111:timed out 2023-08-23T05:38:33.680 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:38:36.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:38:37.068 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T05:38:37.068 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T05:38:37.409 INFO:teuthology.provision.fog.smithi111:Node is ready 2023-08-23T05:38:37.410 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2023-08-23T05:38:37.429 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2023-08-23T05:38:37.430 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2023-08-23T05:38:37.489 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2023-08-23T05:38:37.489 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-08-23T05:38:37.607 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2023-08-23T05:38:37.638 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2023-08-23T05:38:37.706 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2023-08-23T05:38:37.774 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-08-23T05:38:37.841 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-08-23T05:38:37.898 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux" 2023-08-23T05:38:37.898 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)" 2023-08-23T05:38:37.899 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel" 2023-08-23T05:38:37.899 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora" 2023-08-23T05:38:37.899 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6" 2023-08-23T05:38:37.899 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2023-08-23T05:38:37.899 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-23T05:38:37.899 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-08-23T05:38:37.900 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-23T05:38:37.900 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/" 2023-08-23T05:38:37.900 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-23T05:38:37.900 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T05:38:37.900 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-08-23T05:38:37.900 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-23T05:38:37.900 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-23T05:38:37.900 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-23T05:38:37.901 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-23T05:38:37.901 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2023-08-23T05:38:37.902 DEBUG:teuthology.parallel:result is None 2023-08-23T05:38:39.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:38:42.741 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:38:48.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:38:51.824 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:38:57.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:39:00.880 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:39:06.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:39:09.968 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:39:15.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:39:19.024 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:39:25.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:39:28.080 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:39:34.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:39:37.140 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:39:43.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:39:46.224 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:39:52.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:39:55.284 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:40:01.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:40:04.372 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:40:10.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:40:13.456 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:40:19.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:40:22.516 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:40:28.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:40:31.600 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:40:37.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:40:40.688 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:40:46.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:40:49.776 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:40:55.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:40:58.832 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:41:04.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:41:07.888 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:41:13.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:41:16.944 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:41:22.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:41:26.032 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:41:32.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:41:35.088 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:41:41.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:41:44.144 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:41:50.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:41:53.200 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:41:59.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:42:02.256 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:42:08.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:42:11.312 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:42:17.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:42:20.372 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:42:26.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:42:29.456 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:42:35.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:42:38.512 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:42:44.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:42:47.568 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:42:53.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:42:56.628 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:43:02.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:43:05.716 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:43:11.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:43:14.800 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:43:20.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:43:23.892 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:43:29.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:43:32.976 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:43:38.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:43:42.036 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:43:48.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:43:51.120 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:43:57.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:44:00.176 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:44:06.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:44:09.232 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:44:15.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:44:18.288 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:44:24.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:44:27.344 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:44:33.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:44:36.400 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:44:42.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:44:45.460 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:44:51.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:44:54.544 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:45:00.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:45:03.600 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:45:09.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:45:12.660 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:45:18.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:45:21.748 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:45:27.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:45:30.836 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:45:36.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:45:39.920 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:45:45.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:45:48.980 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:45:54.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:45:58.064 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:46:04.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:46:07.120 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:46:13.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:46:16.176 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:46:22.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:46:25.236 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:46:31.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:46:34.320 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:46:40.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:46:43.380 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:46:49.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:46:52.468 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:46:58.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:47:01.552 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:47:07.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:47:10.608 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:47:16.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:47:19.696 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:47:25.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:47:28.752 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:47:34.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:47:37.808 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:47:43.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:47:46.864 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:47:52.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:47:55.924 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:48:01.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:48:05.012 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:48:11.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:48:14.096 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:48:20.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:48:23.152 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:48:29.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:48:32.212 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:48:38.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:48:41.296 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:48:47.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:48:50.356 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:48:56.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:48:59.440 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:49:05.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:49:08.500 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:49:14.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:49:17.584 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:49:23.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:49:26.640 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:49:32.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:49:35.696 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:49:41.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:49:44.752 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:49:50.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:49:53.808 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:49:59.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:50:02.868 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:50:08.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:50:11.952 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:50:17.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:50:21.008 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:50:27.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:50:30.064 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:50:36.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:50:39.120 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:50:45.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:50:48.176 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:50:54.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:50:57.232 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:51:03.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:51:06.288 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:51:12.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:51:15.344 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:51:21.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:51:24.432 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:51:30.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:51:33.492 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:51:39.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:51:42.580 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:51:48.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:51:51.664 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:51:57.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T05:52:00.720 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-08-23T05:52:00.722 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-08-23T05:52:00.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T05:52:02.405 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=23bd208803974a03846cd7bdd97f67b9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-08-23T05:52:02.420 INFO:teuthology.nuke:Checking targets against current locks 2023-08-23T05:52:02.483 DEBUG:teuthology.nuke:shortname: smithi111 2023-08-23T05:52:02.483 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T05:52:02.498 DEBUG:teuthology.nuke:shortname: smithi135 2023-08-23T05:52:02.498 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T05:52:02.505 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-08-23_05:22:33-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7377566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 05:32:58.346421', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIaDYgF7lexNjJgvXCswMm0cDR5iJJsL5N3Tc54hM2DGt7/JPcMFD6k4Tj/qY3Tb59i+m4FYZ5YhhCZHOiYGkk8='} 2023-08-23T05:52:02.525 DEBUG:teuthology.nuke:shortname: smithi140 2023-08-23T05:52:02.526 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T05:52:02.527 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-08-23_05:22:33-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7377566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 05:32:58.349014', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-23T05:52:02.545 DEBUG:teuthology.nuke:shortname: smithi188 2023-08-23T05:52:02.545 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T05:52:02.549 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-08-23_05:22:33-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7377566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 05:32:58.344388', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKqg67P2a44FC31lTDueuW1EnET8RFxl53A36s3JOWE8lBPU4R79TRbz3pLCn9hHYF2wmqzHGLzLbtuf0uzxUZU='} 2023-08-23T05:52:02.560 INFO:teuthology.orchestra.console.smithi111:Power off 2023-08-23T05:52:02.561 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T05:52:02.575 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-08-23_05:22:33-rados:thrash-erasure-code-crush-4-nodes-main-distro-default-smithi/7377566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 05:32:58.347955', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-23T05:52:02.583 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-08-23T05:52:02.584 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:02.606 INFO:teuthology.orchestra.console.smithi135:Power off 2023-08-23T05:52:02.607 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T05:52:02.619 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-08-23T05:52:02.630 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-08-23T05:52:02.631 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:02.649 INFO:teuthology.orchestra.console.smithi188:Power off 2023-08-23T05:52:02.650 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T05:52:02.668 INFO:teuthology.orchestra.console.smithi140:Power off 2023-08-23T05:52:02.669 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T05:52:02.678 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-08-23T05:52:02.679 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:02.690 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-08-23T05:52:02.693 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-08-23T05:52:02.693 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:02.703 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-08-23T05:52:02.721 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-23T05:52:06.624 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:06.692 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:06.704 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:06.723 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:06.734 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-08-23T05:52:06.803 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-08-23T05:52:06.815 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-08-23T05:52:06.835 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-23T05:52:10.737 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:10.804 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:10.816 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:10.836 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:10.848 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-08-23T05:52:10.914 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-08-23T05:52:10.926 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-08-23T05:52:10.947 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-08-23T05:52:11.015 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-08-23T05:52:11.174 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com 2023-08-23T05:52:14.852 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:14.927 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:14.948 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T05:52:14.967 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-08-23T05:52:15.038 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-08-23T05:52:15.061 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-08-23T05:52:15.068 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-08-23T05:52:15.139 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-08-23T05:52:15.163 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-08-23T05:52:15.224 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com 2023-08-23T05:52:15.288 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com 2023-08-23T05:52:15.323 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-08-23T05:52:15.772 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds