2023-08-30T14:33:51.619 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-30T14:33:51.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T14:33:51.774 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4b0790b1f0>, signals=[15]) 2023-08-30T14:33:51.776 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-08-30T14:33:51.776 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T14:33:51.776 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-08-30T14:33:51.796 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2023-08-30T14:33:51.796 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T14:33:51.797 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-08-30T14:33:51.798 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-08-30T14:33:51.821 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2023-08-30T14:33:51.821 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T14:33:51.821 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-08-30T14:33:51.823 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"} 2023-08-30T14:33:51.846 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /host {"name": "smithi193"} 2023-08-30T14:33:51.862 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T14:33:51.886 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T14:33:51.905 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T14:33:51.908 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T14:33:51.909 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 10} 2023-08-30T14:33:51.938 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T14:33:51.939 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 10} 2023-08-30T14:33:51.951 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T14:33:51.952 DEBUG:teuthology.provision.fog.smithi193:FOG request: PUT /host/298 {"imageID": 10} 2023-08-30T14:33:51.964 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 9.stream 2023-08-30T14:33:51.965 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:33:51.979 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 9.stream 2023-08-30T14:33:51.980 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:33:51.995 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of centos 9.stream 2023-08-30T14:33:51.995 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:33:52.178 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T14:33:52.184 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T14:33:52.189 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T14:33:52.234 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1} 2023-08-30T14:33:52.238 DEBUG:teuthology.provision.fog.smithi193:FOG request: POST /host/298/task {"taskTypeID": 1} 2023-08-30T14:33:52.243 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-08-30T14:33:52.291 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:33:52.296 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:33:52.301 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:33:52.533 INFO:teuthology.orchestra.console.smithi105:Power off 2023-08-30T14:33:52.534 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T14:33:52.546 INFO:teuthology.orchestra.console.smithi003:Power off 2023-08-30T14:33:52.546 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T14:33:52.554 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-08-30T14:33:52.554 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:33:52.567 INFO:teuthology.orchestra.console.smithi193:Power off 2023-08-30T14:33:52.567 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T14:33:52.575 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-08-30T14:33:52.575 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:33:52.581 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-08-30T14:33:52.588 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2023-08-30T14:33:52.588 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:33:52.595 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-08-30T14:33:52.607 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-08-30T14:33:56.586 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:33:56.596 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:33:56.608 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:33:56.695 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-08-30T14:33:56.704 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-08-30T14:33:56.717 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-08-30T14:34:00.701 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:00.708 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:00.719 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:00.810 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-08-30T14:34:00.816 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-08-30T14:34:00.827 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-08-30T14:34:04.814 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:04.821 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:04.827 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:04.925 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-08-30T14:34:04.929 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-08-30T14:34:04.936 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-30T14:34:05.027 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-08-30T14:34:05.030 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-08-30T14:34:05.037 INFO:teuthology.orchestra.console.smithi193:Power off completed 2023-08-30T14:34:05.128 INFO:teuthology.orchestra.console.smithi105:Power on 2023-08-30T14:34:05.129 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T14:34:05.138 INFO:teuthology.orchestra.console.smithi003:Power on 2023-08-30T14:34:05.138 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T14:34:05.145 INFO:teuthology.orchestra.console.smithi193:Power on 2023-08-30T14:34:05.145 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T14:34:05.153 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2023-08-30T14:34:05.154 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:05.161 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2023-08-30T14:34:05.162 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:05.169 DEBUG:teuthology.orchestra.console.smithi193:power on output: Chassis Power Control: Up/On 2023-08-30T14:34:05.170 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:05.177 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-08-30T14:34:05.182 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-08-30T14:34:05.189 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-30T14:34:09.182 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:09.188 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:09.194 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:09.291 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-08-30T14:34:09.296 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-08-30T14:34:09.301 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-08-30T14:34:09.397 INFO:teuthology.orchestra.console.smithi003:Power on completed 2023-08-30T14:34:09.402 INFO:teuthology.orchestra.console.smithi193:Power on completed 2023-08-30T14:34:09.498 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-08-30T14:34:09.499 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:34:09.502 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2023-08-30T14:34:09.502 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:34:13.293 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:13.402 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-08-30T14:34:13.503 INFO:teuthology.orchestra.console.smithi105:Power on completed 2023-08-30T14:34:13.603 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2023-08-30T14:34:13.604 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:34:24.732 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:34:24.735 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:34:28.907 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:34:39.995 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:34:39.997 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:34:44.198 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:34:55.225 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:34:55.227 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:34:59.452 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:35:10.461 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:35:10.489 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:35:14.698 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:35:25.754 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:35:25.756 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:35:29.982 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:35:41.034 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:35:41.035 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:35:45.261 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:35:56.374 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:35:56.375 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:36:00.614 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:36:11.803 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:36:11.806 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:36:16.043 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:36:27.301 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:36:27.303 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:36:31.622 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:36:42.686 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:36:42.687 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:36:47.293 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:36:58.092 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:36:58.093 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:37:02.624 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:37:13.775 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:37:13.808 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:37:17.931 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:37:29.476 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:37:29.478 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:37:33.264 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:37:45.094 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:37:45.112 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:37:48.582 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:38:00.621 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:38:00.622 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:38:03.888 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:38:15.937 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:38:15.939 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:38:19.159 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:38:31.276 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:38:31.277 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:38:34.426 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:38:46.620 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:38:46.621 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:38:49.622 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:39:01.887 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:39:01.889 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:39:04.834 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:39:17.210 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:39:17.213 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:39:20.115 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:39:32.550 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:39:32.552 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:39:35.330 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:39:47.835 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:39:47.836 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T14:39:48.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:39:50.598 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:39:51.130 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-30T14:39:57.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:40:00.186 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-30T14:40:03.066 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:40:05.843 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:40:06.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:40:09.242 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-30T14:40:15.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:40:18.242 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:40:18.330 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-30T14:40:21.038 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:40:24.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:40:27.386 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-30T14:40:33.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:40:33.429 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:40:36.226 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:40:48.599 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-08-30T14:40:48.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:40:51.387 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:40:51.834 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-30T14:40:57.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:41:00.922 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-30T14:41:06.550 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:41:06.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:41:09.982 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-30T14:41:15.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:41:19.070 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-30T14:41:21.686 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:41:25.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:41:28.154 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-08-30T14:41:33.398 WARNING:teuthology.provision.fog.smithi003:timed out 2023-08-30T14:41:34.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:41:36.826 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-30T14:41:36.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:41:39.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:41:39.604 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T14:41:39.605 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T14:41:39.916 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-08-30T14:41:39.916 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-08-30T14:41:39.931 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-08-30T14:41:39.931 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-08-30T14:41:39.986 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-08-30T14:41:39.987 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-08-30T14:41:40.026 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-30T14:41:40.099 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-08-30T14:41:40.130 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-08-30T14:41:40.202 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-08-30T14:41:40.273 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-08-30T14:41:40.342 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-08-30T14:41:40.397 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-08-30T14:41:40.398 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2023-08-30T14:41:40.398 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-08-30T14:41:40.399 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-08-30T14:41:40.399 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2023-08-30T14:41:40.399 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2023-08-30T14:41:40.399 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T14:41:40.399 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-08-30T14:41:40.400 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2023-08-30T14:41:40.400 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T14:41:40.400 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-08-30T14:41:40.400 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T14:41:40.400 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T14:41:40.401 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T14:41:40.401 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-08-30T14:41:40.403 DEBUG:teuthology.parallel:result is None 2023-08-30T14:41:46.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:41:49.114 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-30T14:41:55.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:41:58.174 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-30T14:42:04.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:42:07.262 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-30T14:42:13.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:42:16.346 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-30T14:42:22.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:42:25.402 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-30T14:42:31.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:42:34.161 WARNING:teuthology.provision.fog.smithi193:timed out 2023-08-30T14:42:40.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:42:40.491 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T14:42:40.491 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T14:42:40.850 INFO:teuthology.provision.fog.smithi193:Node is ready 2023-08-30T14:42:40.851 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2023-08-30T14:42:40.866 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com 2023-08-30T14:42:40.867 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts 2023-08-30T14:42:40.922 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-08-30T14:42:40.923 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-08-30T14:42:41.035 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts 2023-08-30T14:42:41.063 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2023-08-30T14:42:41.132 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname 2023-08-30T14:42:41.200 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-08-30T14:42:41.266 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-08-30T14:42:41.320 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-08-30T14:42:41.321 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9" 2023-08-30T14:42:41.321 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-08-30T14:42:41.321 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-08-30T14:42:41.321 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9" 2023-08-30T14:42:41.321 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9" 2023-08-30T14:42:41.322 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T14:42:41.322 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-08-30T14:42:41.322 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon" 2023-08-30T14:42:41.322 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T14:42:41.322 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-08-30T14:42:41.323 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T14:42:41.323 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T14:42:41.323 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T14:42:41.324 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2023-08-30T14:42:41.324 DEBUG:teuthology.parallel:result is None 2023-08-30T14:42:49.886 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-30T14:42:55.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:42:58.974 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-30T14:43:04.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:43:05.849 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T14:43:05.849 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T14:43:31.227 INFO:teuthology.provision.fog.smithi105:Node is ready 2023-08-30T14:43:31.227 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2023-08-30T14:43:31.286 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2023-08-30T14:43:31.286 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2023-08-30T14:43:31.344 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2023-08-30T14:43:31.344 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-08-30T14:43:31.479 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2023-08-30T14:43:31.510 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2023-08-30T14:43:31.582 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2023-08-30T14:43:31.651 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-08-30T14:43:31.720 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-08-30T14:43:31.775 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-08-30T14:43:31.775 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2023-08-30T14:43:31.775 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-08-30T14:43:31.775 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-08-30T14:43:31.776 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2023-08-30T14:43:31.776 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2023-08-30T14:43:31.776 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T14:43:31.776 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-08-30T14:43:31.776 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2023-08-30T14:43:31.777 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T14:43:31.777 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-08-30T14:43:31.777 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T14:43:31.777 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T14:43:31.777 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T14:43:31.778 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2023-08-30T14:43:31.779 DEBUG:teuthology.parallel:result is None 2023-08-30T14:43:31.981 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-08-30T14:43:31.981 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T14:43:32.001 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2023-08-30T14:43:32.002 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T14:43:32.026 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2023-08-30T14:43:32.026 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T14:43:32.053 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-08-30T14:43:32.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-08-30T14:43:32.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:43:32.156 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-08-30T14:43:32.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-08-30T14:43:32.341 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-08-30T14:43:32.396 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-08-30T14:43:32.396 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-08-30T14:43:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-08-30T14:43:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2023-08-30T14:43:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-08-30T14:43:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-08-30T14:43:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2023-08-30T14:43:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2023-08-30T14:43:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T14:43:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-08-30T14:43:32.453 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2023-08-30T14:43:32.453 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T14:43:32.453 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-08-30T14:43:32.453 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T14:43:32.453 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T14:43:32.454 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T14:43:32.454 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-08-30T14:43:32.476 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2023-08-30T14:43:32.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-08-30T14:43:32.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:43:32.562 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-08-30T14:43:32.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-08-30T14:43:32.631 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2023-08-30T14:43:32.686 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2023-08-30T14:43:32.687 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-08-30T14:43:32.742 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-08-30T14:43:32.743 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2023-08-30T14:43:32.743 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-08-30T14:43:32.743 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-08-30T14:43:32.743 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2023-08-30T14:43:32.743 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2023-08-30T14:43:32.744 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T14:43:32.744 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-08-30T14:43:32.744 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2023-08-30T14:43:32.744 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T14:43:32.744 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-08-30T14:43:32.744 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T14:43:32.745 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T14:43:32.745 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T14:43:32.745 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-08-30T14:43:32.768 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2023-08-30T14:43:32.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-30T14:43:32.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:43:32.853 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-08-30T14:43:33.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-08-30T14:43:33.026 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2023-08-30T14:43:33.080 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2023-08-30T14:43:33.080 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-08-30T14:43:33.135 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-08-30T14:43:33.135 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9" 2023-08-30T14:43:33.135 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-08-30T14:43:33.136 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-08-30T14:43:33.136 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9" 2023-08-30T14:43:33.136 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9" 2023-08-30T14:43:33.136 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T14:43:33.136 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-08-30T14:43:33.137 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon" 2023-08-30T14:43:33.137 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T14:43:33.137 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-08-30T14:43:33.137 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T14:43:33.137 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T14:43:33.138 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T14:43:33.138 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-08-30T14:43:33.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T14:43:33.249 INFO:teuthology.dispatcher.supervisor:Running job 7384330 2023-08-30T14:43:33.250 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-30_14:31:48-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384330 --name yuriw-2023-08-30_14:31:48-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi --description rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/mon_recovery} -- /home/teuthworker/archive/yuriw-2023-08-30_14:31:48-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384330/orig.config.yaml 2023-08-30T14:43:33.253 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-30_14:31:48-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384330 2023-08-30T14:43:33.254 INFO:teuthology.dispatcher.supervisor:Job PID: 1423001 2023-08-30T14:43:33.254 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T14:45:33.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T14:45:33.424 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T14:45:33.552 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T14:45:33.552 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T14:45:33.603 DEBUG:teuthology.nuke:shortname: smithi003 2023-08-30T14:45:33.603 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T14:45:33.629 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-30_14:31:48-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384330', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 14:33:50.837041', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCv4WKZfq64HrYZA2L1j5+nER2H7dUAD9pPCQSyBJr2KZL5Hvynf9hy1jawuP9HrBzwKx1wXQsuqOERvKCGsObY='} 2023-08-30T14:45:33.633 DEBUG:teuthology.nuke:shortname: smithi105 2023-08-30T14:45:33.634 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T14:45:33.657 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-30_14:31:48-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384330', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 14:33:50.838909', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBNXL8t0FOAWqNzE23n631wUQh/8p7Q3nEo47tfUBu+KaFTSPsR4zRbeRx0UjienFyIL4h8Wq8rtJgXEaUpe4vI='} 2023-08-30T14:45:33.662 DEBUG:teuthology.nuke:shortname: smithi193 2023-08-30T14:45:33.662 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T14:45:33.689 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-30_14:31:48-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384330', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 14:33:50.840410', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPAaGNbC2XKmaYOs/a9WYdcp0Tar9SjcT18ZVwHVzkFH+GopaTN54bv4TFhk05PwaJdfMpeffnwIb6/EYkxdjUg='} 2023-08-30T14:45:33.699 INFO:teuthology.orchestra.console.smithi003:Power off 2023-08-30T14:45:33.700 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T14:45:33.720 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-08-30T14:45:33.721 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:45:33.739 INFO:teuthology.orchestra.console.smithi105:Power off 2023-08-30T14:45:33.739 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T14:45:33.748 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-08-30T14:45:33.758 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-08-30T14:45:33.758 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:45:33.774 INFO:teuthology.orchestra.console.smithi193:Power off 2023-08-30T14:45:33.775 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T14:45:33.782 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-08-30T14:45:33.795 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2023-08-30T14:45:33.796 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:45:33.816 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-08-30T14:45:33.849 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-08-30T14:45:33.884 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-08-30T14:45:33.918 INFO:teuthology.orchestra.console.smithi193:Power off completed 2023-08-30T14:45:33.998 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-08-30T14:45:34.033 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com 2023-08-30T14:45:34.064 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com