2023-08-25T01:53:27.996 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-25T01:53:27.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T01:53:28.164 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1d2b7b8310>, signals=[15]) 2023-08-25T01:53:28.165 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-08-25T01:53:28.165 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-08-25T01:53:28.166 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-08-25T01:53:28.183 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-08-25T01:53:28.183 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-08-25T01:53:28.184 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-08-25T01:53:28.188 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"} 2023-08-25T01:53:28.208 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-08-25T01:53:28.208 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-08-25T01:53:28.208 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-08-25T01:53:28.210 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /host {"name": "smithi072"} 2023-08-25T01:53:28.234 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-08-25T01:53:28.248 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-25T01:53:28.288 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-25T01:53:28.290 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-25T01:53:28.291 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 5} 2023-08-25T01:53:28.296 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-25T01:53:28.338 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-25T01:53:28.338 DEBUG:teuthology.provision.fog.smithi072:FOG request: PUT /host/177 {"imageID": 5} 2023-08-25T01:53:28.341 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of rhel 8.6 2023-08-25T01:53:28.341 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:53:28.343 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-25T01:53:28.344 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 5} 2023-08-25T01:53:28.396 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"} 2023-08-25T01:53:28.399 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of rhel 8.6 2023-08-25T01:53:28.399 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:53:28.400 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of rhel 8.6 2023-08-25T01:53:28.400 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:53:28.431 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1} 2023-08-25T01:53:28.736 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-08-25T01:53:28.739 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /tasktype {"name": "deploy"} 2023-08-25T01:53:28.742 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:53:28.781 DEBUG:teuthology.provision.fog.smithi072:FOG request: POST /host/177/task {"taskTypeID": 1} 2023-08-25T01:53:28.783 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-08-25T01:53:28.814 INFO:teuthology.orchestra.console.smithi062:Power off 2023-08-25T01:53:28.815 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T01:53:28.899 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:53:28.900 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:53:28.977 INFO:teuthology.orchestra.console.smithi072:Power off 2023-08-25T01:53:28.978 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T01:53:28.998 INFO:teuthology.orchestra.console.smithi169:Power off 2023-08-25T01:53:28.999 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T01:53:29.163 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-08-25T01:53:29.164 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:29.174 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-08-25T01:53:29.175 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:29.185 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-08-25T01:53:29.186 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:29.197 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-08-25T01:53:29.205 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-08-25T01:53:29.208 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-08-25T01:53:33.202 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:33.213 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:33.221 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:33.316 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-08-25T01:53:33.323 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-08-25T01:53:33.332 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-08-25T01:53:37.320 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:37.329 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:37.342 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:37.430 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-25T01:53:37.444 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-08-25T01:53:37.453 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-08-25T01:53:37.531 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-08-25T01:53:37.545 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-08-25T01:53:37.554 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-08-25T01:53:37.633 INFO:teuthology.orchestra.console.smithi169:Power on 2023-08-25T01:53:37.633 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-25T01:53:37.647 INFO:teuthology.orchestra.console.smithi062:Power on 2023-08-25T01:53:37.647 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-25T01:53:37.656 INFO:teuthology.orchestra.console.smithi072:Power on 2023-08-25T01:53:37.656 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-25T01:53:37.665 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2023-08-25T01:53:37.666 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:37.677 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On 2023-08-25T01:53:37.678 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:37.687 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2023-08-25T01:53:37.688 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:37.696 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-25T01:53:37.699 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-08-25T01:53:37.708 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-08-25T01:53:41.700 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:41.709 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:41.717 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:41.810 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-25T01:53:41.819 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-08-25T01:53:41.827 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-08-25T01:53:45.812 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:45.822 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:45.831 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T01:53:45.925 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-08-25T01:53:45.933 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-08-25T01:53:45.945 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-08-25T01:53:46.026 INFO:teuthology.orchestra.console.smithi169:Power on completed 2023-08-25T01:53:46.034 INFO:teuthology.orchestra.console.smithi062:Power on completed 2023-08-25T01:53:46.046 INFO:teuthology.orchestra.console.smithi072:Power on completed 2023-08-25T01:53:46.128 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-08-25T01:53:46.129 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:53:46.135 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-08-25T01:53:46.135 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:53:46.146 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-08-25T01:53:46.146 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:54:01.536 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:54:01.552 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:54:01.671 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:54:16.869 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:54:16.881 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:54:17.073 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:54:32.151 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:54:32.171 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:54:32.427 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:54:47.468 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:54:47.469 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:54:47.715 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:55:02.744 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:55:02.752 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:55:02.968 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:55:18.060 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:55:18.062 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:55:18.241 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:55:33.423 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:55:33.424 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:55:33.552 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:55:49.043 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:55:49.056 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:55:49.066 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:56:05.635 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:56:05.637 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:56:05.639 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:56:23.040 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:56:23.085 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:56:23.086 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:56:40.064 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:56:40.080 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:56:40.422 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:56:57.001 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:56:57.010 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:56:57.416 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:57:19.898 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:57:19.965 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-08-25T01:57:20.088 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:57:27.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:57:30.608 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-25T01:57:36.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:57:39.696 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-25T01:57:42.788 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:57:43.206 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-08-25T01:57:45.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:57:48.752 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-25T01:57:49.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:57:52.976 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-08-25T01:57:54.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:57:57.808 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-25T01:57:58.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:58:02.032 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-08-25T01:58:03.075 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-25T01:58:03.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:58:03.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:58:06.448 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-25T01:58:06.868 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-25T01:58:08.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:58:11.088 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-08-25T01:58:12.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:58:12.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:58:15.504 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-25T01:58:15.920 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-08-25T01:58:17.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:58:20.144 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-08-25T01:58:21.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:58:21.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:58:24.560 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-25T01:58:26.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:58:30.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:58:33.616 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-25T01:58:39.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:58:42.672 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-25T01:58:48.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:58:51.728 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-08-25T01:58:53.643 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-25T01:58:53.644 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-25T01:58:54.016 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-08-25T01:58:54.017 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2023-08-25T01:58:54.033 INFO:teuthology.orchestra.run.smithi062.stdout:smithi022 2023-08-25T01:58:54.034 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi022 /etc/hosts 2023-08-25T01:58:54.090 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-08-25T01:58:54.090 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-08-25T01:58:54.275 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi022/smithi062/g' /etc/hosts 2023-08-25T01:58:54.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.22/172.21.15.62/g' /etc/hosts 2023-08-25T01:58:54.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi022/smithi062/g' /etc/hostname 2023-08-25T01:58:54.422 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-08-25T01:58:54.490 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-08-25T01:58:54.547 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T01:58:54.547 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T01:58:54.547 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel" 2023-08-25T01:58:54.547 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora" 2023-08-25T01:58:54.547 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6" 2023-08-25T01:58:54.548 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-08-25T01:58:54.548 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T01:58:54.548 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-08-25T01:58:54.548 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T01:58:54.548 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T01:58:54.548 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T01:58:54.549 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T01:58:54.549 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-08-25T01:58:54.549 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T01:58:54.549 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T01:58:54.550 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T01:58:54.550 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T01:58:54.551 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-08-25T01:58:54.552 DEBUG:teuthology.parallel:result is None 2023-08-25T01:58:57.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:59:26.172 WARNING:teuthology.provision.fog.smithi072:timed out 2023-08-25T01:59:32.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T01:59:32.509 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-25T01:59:32.510 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-25T01:59:32.866 INFO:teuthology.provision.fog.smithi072:Node is ready 2023-08-25T01:59:32.867 DEBUG:teuthology.orchestra.run.smithi072:> hostname 2023-08-25T01:59:32.884 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2023-08-25T01:59:32.884 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts 2023-08-25T01:59:32.942 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2023-08-25T01:59:32.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-08-25T01:59:33.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts 2023-08-25T01:59:33.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts 2023-08-25T01:59:33.173 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname 2023-08-25T01:59:33.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-08-25T01:59:33.307 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-08-25T01:59:33.363 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T01:59:33.363 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T01:59:33.363 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2023-08-25T01:59:33.363 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2023-08-25T01:59:33.364 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6" 2023-08-25T01:59:33.364 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-08-25T01:59:33.364 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T01:59:33.364 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-08-25T01:59:33.364 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T01:59:33.364 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T01:59:33.364 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T01:59:33.365 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T01:59:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T01:59:33.365 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T01:59:33.365 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T01:59:33.365 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T01:59:33.365 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T01:59:33.366 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2023-08-25T01:59:33.366 DEBUG:teuthology.parallel:result is None 2023-08-25T01:59:57.743 WARNING:teuthology.provision.fog.smithi169:timed out 2023-08-25T02:00:03.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T02:00:04.079 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-25T02:00:04.079 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-25T02:00:04.566 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-08-25T02:00:04.567 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-08-25T02:00:04.585 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169 2023-08-25T02:00:04.586 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169 /etc/hosts 2023-08-25T02:00:04.644 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-08-25T02:00:04.644 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-08-25T02:00:04.768 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169/smithi169/g' /etc/hosts 2023-08-25T02:00:04.797 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-08-25T02:00:04.866 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169/smithi169/g' /etc/hostname 2023-08-25T02:00:04.934 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-08-25T02:00:05.000 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-08-25T02:00:05.056 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T02:00:05.057 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T02:00:05.057 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-08-25T02:00:05.057 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-08-25T02:00:05.057 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-08-25T02:00:05.057 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-08-25T02:00:05.057 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T02:00:05.057 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-08-25T02:00:05.058 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T02:00:05.058 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T02:00:05.058 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T02:00:05.058 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T02:00:05.058 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-08-25T02:00:05.058 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T02:00:05.058 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T02:00:05.058 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T02:00:05.059 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T02:00:05.059 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-08-25T02:00:05.060 DEBUG:teuthology.parallel:result is None 2023-08-25T02:00:05.233 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-08-25T02:00:05.233 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-25T02:00:05.253 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2023-08-25T02:00:05.254 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-25T02:00:05.270 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-08-25T02:00:05.270 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-25T02:00:05.288 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-08-25T02:00:05.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-08-25T02:00:05.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T02:00:05.356 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-08-25T02:00:05.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-08-25T02:00:05.494 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-08-25T02:00:05.552 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-08-25T02:00:05.553 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-08-25T02:00:05.610 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T02:00:05.610 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T02:00:05.611 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel" 2023-08-25T02:00:05.611 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora" 2023-08-25T02:00:05.611 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6" 2023-08-25T02:00:05.612 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-08-25T02:00:05.612 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T02:00:05.612 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-08-25T02:00:05.612 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T02:00:05.613 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T02:00:05.613 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T02:00:05.613 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T02:00:05.614 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-08-25T02:00:05.614 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T02:00:05.614 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T02:00:05.614 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T02:00:05.615 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T02:00:05.615 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-08-25T02:00:05.637 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2023-08-25T02:00:05.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-08-25T02:00:05.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T02:00:05.706 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-08-25T02:00:05.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-08-25T02:00:05.796 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-08-25T02:00:05.852 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-08-25T02:00:05.853 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-08-25T02:00:05.909 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T02:00:05.909 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T02:00:05.909 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2023-08-25T02:00:05.910 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2023-08-25T02:00:05.910 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6" 2023-08-25T02:00:05.910 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-08-25T02:00:05.910 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T02:00:05.910 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-08-25T02:00:05.910 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T02:00:05.910 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T02:00:05.910 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T02:00:05.911 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T02:00:05.911 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T02:00:05.911 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T02:00:05.911 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T02:00:05.911 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T02:00:05.911 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T02:00:05.912 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-08-25T02:00:05.971 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-08-25T02:00:05.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-08-25T02:00:05.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T02:00:06.037 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-08-25T02:00:06.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-08-25T02:00:06.106 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-08-25T02:00:06.165 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-08-25T02:00:06.165 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-08-25T02:00:06.224 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-08-25T02:00:06.224 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-08-25T02:00:06.225 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-08-25T02:00:06.225 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-08-25T02:00:06.225 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-08-25T02:00:06.225 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-08-25T02:00:06.226 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-25T02:00:06.226 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-08-25T02:00:06.226 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-25T02:00:06.226 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-08-25T02:00:06.226 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-25T02:00:06.226 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T02:00:06.227 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-08-25T02:00:06.227 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T02:00:06.227 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-25T02:00:06.227 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-25T02:00:06.227 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-25T02:00:06.228 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-08-25T02:00:06.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:00:06.364 INFO:teuthology.dispatcher.supervisor:Running job 7378895 2023-08-25T02:00:06.364 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7378895 --name rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/pjd}} -- /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7378895/orig.config.yaml 2023-08-25T02:00:06.369 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7378895 2023-08-25T02:00:06.369 INFO:teuthology.dispatcher.supervisor:Job PID: 24096 2023-08-25T02:00:06.370 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-25T02:02:06.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:04:06.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:06:06.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:08:06.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:10:07.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:12:07.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:14:07.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:16:07.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:18:07.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:20:08.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:22:08.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:24:08.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:26:08.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:28:09.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:30:09.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:32:09.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:34:09.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T02:34:09.630 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-25T02:34:09.830 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-25T02:34:09.830 INFO:teuthology.nuke:Checking targets against current locks 2023-08-25T02:34:09.878 DEBUG:teuthology.nuke:shortname: smithi062 2023-08-25T02:34:09.879 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T02:34:09.899 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7378895', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 01:53:27.185787', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-25T02:34:09.902 DEBUG:teuthology.nuke:shortname: smithi072 2023-08-25T02:34:09.902 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T02:34:09.918 DEBUG:teuthology.nuke:shortname: smithi169 2023-08-25T02:34:09.918 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T02:34:09.925 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7378895', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 01:53:27.181354', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-25T02:34:09.937 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7378895', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 01:53:27.184663', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-25T02:34:09.950 INFO:teuthology.orchestra.console.smithi062:Power off 2023-08-25T02:34:09.951 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T02:34:09.973 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-08-25T02:34:09.974 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T02:34:09.991 INFO:teuthology.orchestra.console.smithi169:Power off 2023-08-25T02:34:09.992 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T02:34:10.008 INFO:teuthology.orchestra.console.smithi072:Power off 2023-08-25T02:34:10.009 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T02:34:10.017 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-08-25T02:34:10.020 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-08-25T02:34:10.020 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T02:34:10.031 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-08-25T02:34:10.032 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T02:34:10.042 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-25T02:34:10.053 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-08-25T02:34:10.119 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-08-25T02:34:10.143 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-08-25T02:34:10.154 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-08-25T02:34:10.270 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2023-08-25T02:34:10.287 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com 2023-08-25T02:34:10.303 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com