2023-10-23T17:45:57.807 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-23T17:45:57.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T17:45:57.970 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f14f7523dc0>, signals=[15]) 2023-10-23T17:45:57.972 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-10-23T17:45:57.972 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-10-23T17:45:57.972 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-10-23T17:45:57.995 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2023-10-23T17:45:57.995 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2023-10-23T17:45:57.996 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-10-23T17:45:57.997 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-10-23T17:45:58.020 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-10-23T17:45:58.021 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-10-23T17:45:58.021 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-10-23T17:45:58.023 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /host {"name": "smithi163"} 2023-10-23T17:45:58.045 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-10-23T17:45:58.065 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-23T17:45:58.090 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-23T17:45:58.103 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-23T17:45:58.103 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 2} 2023-10-23T17:45:58.110 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-23T17:45:58.130 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-23T17:45:58.130 DEBUG:teuthology.provision.fog.smithi163:FOG request: PUT /host/268 {"imageID": 2} 2023-10-23T17:45:58.151 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-23T17:45:58.152 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 2} 2023-10-23T17:45:58.155 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of ubuntu 20.04 2023-10-23T17:45:58.155 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:45:58.174 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of ubuntu 20.04 2023-10-23T17:45:58.174 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:45:58.199 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of ubuntu 20.04 2023-10-23T17:45:58.199 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:45:58.264 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /tasktype {"name": "deploy"} 2023-10-23T17:45:58.269 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-10-23T17:45:58.302 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-10-23T17:45:58.308 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-10-23T17:45:58.314 DEBUG:teuthology.provision.fog.smithi163:FOG request: POST /host/268/task {"taskTypeID": 1} 2023-10-23T17:45:58.344 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-10-23T17:45:58.357 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:45:58.360 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:45:58.389 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:45:58.495 INFO:teuthology.orchestra.console.smithi098:Power off 2023-10-23T17:45:58.495 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T17:45:58.509 INFO:teuthology.orchestra.console.smithi163:Power off 2023-10-23T17:45:58.510 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T17:45:58.524 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-10-23T17:45:58.524 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:45:58.533 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-10-23T17:45:58.533 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:45:58.547 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-10-23T17:45:58.555 INFO:teuthology.orchestra.console.smithi169:Power off 2023-10-23T17:45:58.555 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T17:45:58.563 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-23T17:45:58.577 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-10-23T17:45:58.577 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:45:58.596 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-23T17:46:02.552 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:02.564 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:02.598 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:02.660 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-10-23T17:46:02.673 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-23T17:46:02.705 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-23T17:46:06.665 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:06.674 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:06.706 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:06.773 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-10-23T17:46:06.782 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-23T17:46:06.814 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-23T17:46:06.875 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-10-23T17:46:06.882 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-10-23T17:46:06.915 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-10-23T17:46:06.976 INFO:teuthology.orchestra.console.smithi098:Power on 2023-10-23T17:46:06.976 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-23T17:46:06.984 INFO:teuthology.orchestra.console.smithi163:Power on 2023-10-23T17:46:06.985 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-23T17:46:06.994 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2023-10-23T17:46:06.995 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:07.006 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On 2023-10-23T17:46:07.007 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:07.015 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-10-23T17:46:07.016 INFO:teuthology.orchestra.console.smithi169:Power on 2023-10-23T17:46:07.016 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-23T17:46:07.027 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-23T17:46:07.036 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2023-10-23T17:46:07.036 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:07.056 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-23T17:46:11.019 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:11.028 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:11.057 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:11.128 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-10-23T17:46:11.136 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-23T17:46:11.164 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-23T17:46:11.264 INFO:teuthology.orchestra.console.smithi169:Power on completed 2023-10-23T17:46:11.365 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-10-23T17:46:11.366 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:46:15.132 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:15.139 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:15.247 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-23T17:46:15.335 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-10-23T17:46:15.347 INFO:teuthology.orchestra.console.smithi163:Power on completed 2023-10-23T17:46:15.436 INFO:teuthology.orchestra.console.smithi098:Power on completed 2023-10-23T17:46:15.449 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2023-10-23T17:46:15.449 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:46:15.537 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-10-23T17:46:15.538 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:46:26.528 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:46:30.598 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:46:30.681 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:46:41.693 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:46:45.745 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:46:45.818 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:46:56.857 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:47:00.890 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:47:00.950 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:47:12.018 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:47:16.099 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:47:16.115 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:47:27.187 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:47:31.299 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:47:31.301 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:47:42.377 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:47:46.487 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:47:46.489 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:47:57.578 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:48:01.680 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:48:01.682 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:48:12.846 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:48:16.890 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:48:16.891 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:48:28.091 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:48:32.099 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:48:32.101 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:48:43.358 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:48:47.296 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:48:47.297 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:48:58.617 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:49:02.539 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:49:02.541 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:49:13.844 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:49:17.739 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:49:17.743 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:49:29.065 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:49:32.954 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:49:32.958 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:49:44.278 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:49:48.148 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:49:48.150 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:49:59.478 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:50:03.347 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:50:03.348 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:50:14.658 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:50:18.522 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:50:18.524 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:50:29.830 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:50:33.703 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:50:33.705 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:50:45.037 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:50:48.873 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:50:48.875 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:51:00.206 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:51:04.044 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:51:04.046 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:51:15.400 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:51:19.223 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:51:19.225 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:51:30.542 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:51:34.373 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:51:34.374 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:51:45.659 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:51:49.523 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:51:49.525 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:52:00.800 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:52:04.678 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:52:04.680 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:52:15.938 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:52:19.801 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:52:19.803 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:52:31.048 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:52:34.918 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:52:34.920 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:52:46.174 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:52:50.046 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:52:50.049 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:53:01.290 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:53:05.156 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:53:05.157 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:53:16.410 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:53:20.271 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:53:20.273 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:53:31.519 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-23T17:53:31.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:53:35.364 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:53:35.368 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:53:49.946 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-23T17:53:50.456 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:53:50.459 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:53:55.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:53:59.002 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-23T17:54:05.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:05.534 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:54:05.538 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-23T17:54:05.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:08.058 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-23T17:54:14.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:17.114 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-23T17:54:20.610 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-10-23T17:54:20.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:23.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:23.994 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-23T17:54:26.170 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-23T17:54:30.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:32.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:33.050 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-23T17:54:39.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:39.098 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-23T17:54:42.138 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-23T17:54:45.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:48.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:48.154 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-23T17:54:51.195 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-23T17:54:54.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:57.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:57.210 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-23T17:55:00.250 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-23T17:55:03.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:55:06.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:55:06.266 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-23T17:55:09.306 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-23T17:55:12.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:55:15.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:55:15.322 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-10-23T17:55:18.366 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-23T17:55:21.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:55:24.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:55:32.182 WARNING:teuthology.provision.fog.smithi169:timed out 2023-10-23T17:55:38.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:55:38.389 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-23T17:55:38.390 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-23T17:55:38.903 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-10-23T17:55:38.904 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-10-23T17:55:38.910 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-10-23T17:55:38.910 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-10-23T17:55:38.958 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-10-23T17:55:38.959 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-10-23T17:55:39.050 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-10-23T17:55:39.066 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-10-23T17:55:39.081 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-10-23T17:55:39.140 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-10-23T17:55:39.150 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-10-23T17:55:39.156 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2023-10-23T17:55:39.156 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:55:39.156 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2023-10-23T17:55:39.157 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2023-10-23T17:55:39.157 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:55:39.157 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="20.04" 2023-10-23T17:55:39.157 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:55:39.158 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:55:39.158 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:55:39.158 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:55:39.158 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=focal 2023-10-23T17:55:39.158 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:55:39.160 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-10-23T17:55:39.161 DEBUG:teuthology.parallel:result is None 2023-10-23T17:55:53.204 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-23T17:55:53.205 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-23T17:55:56.596 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-23T17:55:56.596 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-23T17:56:14.033 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-10-23T17:56:14.033 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-10-23T17:56:14.040 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-10-23T17:56:14.040 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-10-23T17:56:14.090 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-10-23T17:56:14.091 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-10-23T17:56:14.173 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-10-23T17:56:14.190 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-10-23T17:56:14.246 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-10-23T17:56:14.258 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-10-23T17:56:14.268 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-10-23T17:56:14.275 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2023-10-23T17:56:14.275 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:56:14.275 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2023-10-23T17:56:14.276 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2023-10-23T17:56:14.276 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:56:14.276 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="20.04" 2023-10-23T17:56:14.276 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:56:14.277 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:56:14.277 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:56:14.277 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:56:14.277 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=focal 2023-10-23T17:56:14.277 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:56:14.278 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-10-23T17:56:14.278 DEBUG:teuthology.parallel:result is None 2023-10-23T17:56:17.566 INFO:teuthology.provision.fog.smithi163:Node is ready 2023-10-23T17:56:17.566 DEBUG:teuthology.orchestra.run.smithi163:> hostname 2023-10-23T17:56:17.573 INFO:teuthology.orchestra.run.smithi163.stdout:smithi129 2023-10-23T17:56:17.573 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi129 /etc/hosts 2023-10-23T17:56:17.580 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.129 smithi129 smithi129 2023-10-23T17:56:17.580 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-10-23T17:56:17.698 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi129/smithi163/g' /etc/hosts 2023-10-23T17:56:17.717 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.129/172.21.15.163/g' /etc/hosts 2023-10-23T17:56:17.731 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi129/smithi163/g' /etc/hostname 2023-10-23T17:56:17.790 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-10-23T17:56:17.799 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-10-23T17:56:17.806 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2023-10-23T17:56:17.806 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:56:17.806 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2023-10-23T17:56:17.806 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2023-10-23T17:56:17.807 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:56:17.807 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="20.04" 2023-10-23T17:56:17.807 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:56:17.807 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:56:17.807 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:56:17.808 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:56:17.808 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=focal 2023-10-23T17:56:17.808 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:56:17.808 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2023-10-23T17:56:17.809 DEBUG:teuthology.parallel:result is None 2023-10-23T17:56:18.121 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-10-23T17:56:18.122 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2023-10-23T17:56:18.122 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-23T17:56:18.147 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-10-23T17:56:18.149 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-10-23T17:56:18.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-10-23T17:56:18.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:56:18.198 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-10-23T17:56:18.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-10-23T17:56:18.320 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-10-23T17:56:18.325 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-10-23T17:56:18.326 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-10-23T17:56:18.332 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2023-10-23T17:56:18.332 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:56:18.332 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2023-10-23T17:56:18.333 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2023-10-23T17:56:18.333 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:56:18.333 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="20.04" 2023-10-23T17:56:18.333 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:56:18.333 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:56:18.334 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:56:18.334 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:56:18.334 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=focal 2023-10-23T17:56:18.334 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:56:18.335 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-10-23T17:56:18.355 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2023-10-23T17:56:18.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-10-23T17:56:18.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:56:18.398 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-10-23T17:56:18.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-10-23T17:56:18.527 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2023-10-23T17:56:18.533 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2023-10-23T17:56:18.534 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-10-23T17:56:18.540 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2023-10-23T17:56:18.540 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:56:18.541 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2023-10-23T17:56:18.541 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2023-10-23T17:56:18.541 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:56:18.541 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="20.04" 2023-10-23T17:56:18.541 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:56:18.542 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:56:18.542 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:56:18.542 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:56:18.542 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=focal 2023-10-23T17:56:18.542 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:56:18.543 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-10-23T17:56:18.564 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-10-23T17:56:18.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-10-23T17:56:18.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:56:18.610 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-10-23T17:56:18.819 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-10-23T17:56:18.820 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-10-23T17:56:18.826 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-10-23T17:56:18.827 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-10-23T17:56:18.874 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2023-10-23T17:56:18.874 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:56:18.874 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2023-10-23T17:56:18.874 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2023-10-23T17:56:18.875 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:56:18.875 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="20.04" 2023-10-23T17:56:18.875 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:56:18.875 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:56:18.875 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:56:18.876 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:56:18.876 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=focal 2023-10-23T17:56:18.876 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:56:18.876 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-10-23T17:56:18.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T17:56:18.982 INFO:teuthology.dispatcher.supervisor:Running job 7434912 2023-10-23T17:56:18.983 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434912 --name lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434912/orig.config.yaml 2023-10-23T17:56:18.985 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434912 2023-10-23T17:56:18.986 INFO:teuthology.dispatcher.supervisor:Job PID: 3511737 2023-10-23T17:56:18.986 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-23T17:58:19.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:00:19.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:02:19.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:04:19.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:06:19.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:08:19.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:10:20.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:12:20.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:14:20.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:16:20.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:18:20.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:20:20.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:22:20.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:24:21.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:26:21.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:28:21.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:30:21.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:32:21.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:34:21.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:36:22.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:38:22.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:40:22.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:42:22.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:44:22.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:46:22.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:48:23.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:50:23.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:52:23.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:54:23.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:56:23.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:58:24.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:00:24.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:02:24.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:04:24.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:06:24.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:08:24.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:10:24.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:12:25.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:14:25.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:16:25.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:18:25.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:20:25.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:22:25.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:24:26.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:26:26.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:28:26.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:30:26.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:32:26.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:34:26.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:36:26.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:38:26.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:40:27.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:42:27.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:44:27.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:46:27.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:48:27.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:50:27.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:52:28.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:54:28.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:56:28.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:58:28.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:00:28.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:02:28.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:04:29.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:06:29.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:08:29.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:10:29.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:12:29.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:14:30.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:16:30.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:18:30.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:20:30.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:22:30.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:24:30.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:26:31.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:26:31.209 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-23T20:26:31.471 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-23T20:26:31.471 INFO:teuthology.nuke:Checking targets against current locks 2023-10-23T20:26:31.517 DEBUG:teuthology.nuke:shortname: smithi098 2023-10-23T20:26:31.517 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-23T20:26:31.548 DEBUG:teuthology.nuke:shortname: smithi163 2023-10-23T20:26:31.549 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-23T20:26:31.550 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-23 17:45:56.963419', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-23T20:26:31.575 DEBUG:teuthology.nuke:shortname: smithi169 2023-10-23T20:26:31.575 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-23T20:26:31.580 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-23 17:45:56.961417', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-23T20:26:31.609 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-23 17:45:56.997249', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-23T20:26:31.620 INFO:teuthology.orchestra.console.smithi098:Power off 2023-10-23T20:26:31.621 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T20:26:31.641 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-10-23T20:26:31.642 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T20:26:31.654 INFO:teuthology.orchestra.console.smithi163:Power off 2023-10-23T20:26:31.654 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T20:26:31.665 INFO:teuthology.orchestra.console.smithi169:Power off 2023-10-23T20:26:31.666 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T20:26:31.672 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-10-23T20:26:31.674 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-10-23T20:26:31.674 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T20:26:31.685 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-10-23T20:26:31.686 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T20:26:31.694 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-23T20:26:31.707 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-23T20:26:31.773 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-10-23T20:26:31.795 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-10-23T20:26:31.808 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-10-23T20:26:31.923 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com 2023-10-23T20:26:31.932 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2023-10-23T20:26:31.958 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com