2023-07-19T20:08:33.833 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-19T20:08:33.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:08:33.835 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:08:34.122 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff3b3aaeee0>, signals=[15]) 2023-07-19T20:08:34.124 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging 2023-07-19T20:08:34.124 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T20:08:34.124 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-07-19T20:08:34.148 INFO:teuthology.lock.ops:Start node 'smithi087.front.sepia.ceph.com' reimaging 2023-07-19T20:08:34.148 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T20:08:34.148 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-07-19T20:08:34.150 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /host {"name": "smithi060"} 2023-07-19T20:08:34.172 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2023-07-19T20:08:34.173 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T20:08:34.173 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-07-19T20:08:34.174 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /host {"name": "smithi087"} 2023-07-19T20:08:34.197 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-07-19T20:08:34.197 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T20:08:34.198 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-07-19T20:08:34.199 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"} 2023-07-19T20:08:34.222 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-07-19T20:08:34.222 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T20:08:34.223 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-07-19T20:08:34.224 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /host {"name": "smithi157"} 2023-07-19T20:08:34.229 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-19T20:08:34.244 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-19T20:08:34.247 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"} 2023-07-19T20:08:34.270 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-19T20:08:34.274 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-19T20:08:34.274 DEBUG:teuthology.provision.fog.smithi060:FOG request: PUT /host/165 {"imageID": 6} 2023-07-19T20:08:34.288 DEBUG:teuthology.provision.fog.smithi087:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-19T20:08:34.289 DEBUG:teuthology.provision.fog.smithi087:FOG request: PUT /host/192 {"imageID": 6} 2023-07-19T20:08:34.303 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-19T20:08:34.307 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-19T20:08:34.312 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-19T20:08:34.312 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 6} 2023-07-19T20:08:34.324 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of ubuntu 22.04 2023-07-19T20:08:34.324 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:08:34.338 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-19T20:08:34.338 DEBUG:teuthology.provision.fog.smithi157:FOG request: PUT /host/262 {"imageID": 6} 2023-07-19T20:08:34.340 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of ubuntu 22.04 2023-07-19T20:08:34.341 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:08:34.356 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-19T20:08:34.357 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 6} 2023-07-19T20:08:34.364 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of ubuntu 22.04 2023-07-19T20:08:34.365 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:08:34.367 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T20:08:34.389 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of ubuntu 22.04 2023-07-19T20:08:34.389 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:08:34.396 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T20:08:34.402 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of ubuntu 22.04 2023-07-19T20:08:34.402 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:08:34.407 DEBUG:teuthology.provision.fog.smithi060:FOG request: POST /host/165/task {"taskTypeID": 1} 2023-07-19T20:08:34.424 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T20:08:34.435 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T20:08:34.443 DEBUG:teuthology.provision.fog.smithi087:FOG request: POST /host/192/task {"taskTypeID": 1} 2023-07-19T20:08:34.459 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T20:08:34.462 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:08:34.470 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1} 2023-07-19T20:08:34.476 DEBUG:teuthology.provision.fog.smithi157:FOG request: POST /host/262/task {"taskTypeID": 1} 2023-07-19T20:08:34.491 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:08:34.496 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1} 2023-07-19T20:08:34.516 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:08:34.531 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:08:34.555 INFO:teuthology.orchestra.console:Power off smithi060 2023-07-19T20:08:34.556 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:08:34.570 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:08:34.578 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:34.604 INFO:teuthology.orchestra.console:Power off smithi087 2023-07-19T20:08:34.605 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:08:34.622 INFO:teuthology.orchestra.console:Power off smithi111 2023-07-19T20:08:34.622 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:08:34.647 INFO:teuthology.orchestra.console:Power off smithi157 2023-07-19T20:08:34.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:08:34.659 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:34.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:34.679 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:34.699 INFO:teuthology.orchestra.console:Power off smithi159 2023-07-19T20:08:34.699 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:08:34.722 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:34.789 INFO:teuthology.orchestra.console:Power off for smithi087 completed 2023-07-19T20:08:34.890 INFO:teuthology.orchestra.console:Power on smithi087 2023-07-19T20:08:34.890 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T20:08:34.911 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:38.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:38.694 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:38.709 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:38.748 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:38.936 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:39.146 INFO:teuthology.orchestra.console:Power on for smithi087 completed 2023-07-19T20:08:39.247 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish 2023-07-19T20:08:39.247 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:08:42.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:42.805 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:42.820 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:42.859 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:42.971 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2023-07-19T20:08:43.073 INFO:teuthology.orchestra.console:Power on smithi060 2023-07-19T20:08:43.073 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T20:08:43.097 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:46.923 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:46.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:46.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:47.120 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:47.135 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2023-07-19T20:08:47.143 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2023-07-19T20:08:47.182 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-07-19T20:08:47.235 INFO:teuthology.orchestra.console:Power on smithi111 2023-07-19T20:08:47.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T20:08:47.246 INFO:teuthology.orchestra.console:Power on smithi157 2023-07-19T20:08:47.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T20:08:47.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:47.275 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:47.285 INFO:teuthology.orchestra.console:Power on smithi159 2023-07-19T20:08:47.286 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T20:08:47.306 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:51.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:51.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:51.306 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:51.330 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:51.448 INFO:teuthology.orchestra.console:Power on for smithi060 completed 2023-07-19T20:08:51.519 INFO:teuthology.orchestra.console:Power on for smithi157 completed 2023-07-19T20:08:51.543 INFO:teuthology.orchestra.console:Power on for smithi159 completed 2023-07-19T20:08:51.550 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2023-07-19T20:08:51.550 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:08:51.620 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-07-19T20:08:51.621 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:08:51.644 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-07-19T20:08:51.644 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:08:54.316 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:08:55.410 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:08:55.622 INFO:teuthology.orchestra.console:Power on for smithi111 completed 2023-07-19T20:08:55.723 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2023-07-19T20:08:55.723 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:09:06.616 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:09:06.679 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:09:06.700 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:09:09.368 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:09:10.779 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:09:21.688 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:09:21.732 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:09:21.758 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:09:24.420 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:09:25.844 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:09:36.756 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:09:36.792 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:09:36.811 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:09:39.480 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:09:40.908 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:09:51.828 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:09:51.846 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:09:51.868 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:09:54.540 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:09:55.966 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:10:06.896 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:10:06.900 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:10:06.921 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:10:09.596 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:10:11.016 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:10:21.964 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:10:21.966 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:10:21.974 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:10:24.659 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:10:26.074 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:10:37.052 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:10:37.054 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:10:37.054 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:10:39.730 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:10:41.153 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:10:52.144 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:10:52.147 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:10:52.149 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:10:54.823 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:10:56.230 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:11:07.244 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:11:07.245 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:11:07.246 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:11:09.896 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:11:11.296 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:11:22.342 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:11:22.344 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:11:22.345 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:11:24.982 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:11:26.368 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:11:37.432 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:11:37.433 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:11:37.436 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:11:40.068 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:11:41.454 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:11:52.528 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:11:52.529 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-19T20:11:52.531 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:11:52.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:11:55.152 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-07-19T20:11:55.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:11:55.664 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-07-19T20:11:56.527 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:11:58.292 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-07-19T20:12:01.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:04.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:04.720 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-07-19T20:12:07.376 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-07-19T20:12:07.610 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:12:07.621 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:12:10.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:11.600 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:12:13.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:13.780 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-07-19T20:12:16.432 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-07-19T20:12:19.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:22.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:22.701 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-19T20:12:22.703 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:12:22.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:22.864 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-07-19T20:12:23.099 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: Authentication failed. 2023-07-19T20:12:23.100 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T20:12:23.101 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T20:12:23.102 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T20:12:25.488 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-07-19T20:12:26.699 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-19T20:12:26.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:28.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:29.872 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-07-19T20:12:31.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:31.921 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-07-19T20:12:34.544 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-07-19T20:12:35.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:37.810 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-19T20:12:37.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:37.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:38.928 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-07-19T20:12:40.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:40.976 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-07-19T20:12:40.977 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-07-19T20:12:43.600 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-07-19T20:12:44.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:46.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:46.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:47.984 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-07-19T20:12:49.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:50.032 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-07-19T20:12:53.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:56.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:12:57.040 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-07-19T20:12:59.088 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-07-19T20:13:03.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:05.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:06.096 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-07-19T20:13:08.144 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-07-19T20:13:12.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:14.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:15.152 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-07-19T20:13:17.200 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-07-19T20:13:21.140 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-07-19T20:13:21.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:23.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:24.208 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-07-19T20:13:26.261 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-07-19T20:13:27.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:27.143 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-07-19T20:13:30.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:32.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:33.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:33.145 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-07-19T20:13:33.268 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-07-19T20:13:35.312 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-07-19T20:13:39.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:39.147 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-07-19T20:13:39.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:41.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:44.368 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-07-19T20:13:45.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:45.415 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T20:13:45.415 DEBUG:teuthology.orchestra.run.smithi087:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T20:13:45.890 INFO:teuthology.provision.fog.smithi087:Node is ready 2023-07-19T20:13:45.891 DEBUG:teuthology.orchestra.run.smithi087:> hostname 2023-07-19T20:13:45.935 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com 2023-07-19T20:13:45.935 DEBUG:teuthology.orchestra.run.smithi087:> grep smithi087.front.sepia.ceph.com /etc/hosts 2023-07-19T20:13:45.983 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087 2023-07-19T20:13:45.984 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2023-07-19T20:13:46.144 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hosts 2023-07-19T20:13:46.159 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/172.21.15.87/172.21.15.87/g' /etc/hosts 2023-07-19T20:13:46.211 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hostname 2023-07-19T20:13:46.267 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2023-07-19T20:13:46.322 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-07-19T20:13:46.367 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-19T20:13:46.368 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2023-07-19T20:13:46.368 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="22.04" 2023-07-19T20:13:46.368 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-19T20:13:46.368 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=jammy 2023-07-19T20:13:46.368 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2023-07-19T20:13:46.369 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2023-07-19T20:13:46.369 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-19T20:13:46.369 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-19T20:13:46.369 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-19T20:13:46.369 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-19T20:13:46.369 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=jammy 2023-07-19T20:13:46.370 INFO:teuthology.provision.fog.smithi087:Deploy complete! 2023-07-19T20:13:46.371 DEBUG:teuthology.parallel:result is None 2023-07-19T20:13:46.980 WARNING:teuthology.provision.fog.smithi060:timed out 2023-07-19T20:13:50.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:52.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:13:54.004 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-07-19T20:14:00.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:14:00.192 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T20:14:00.192 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T20:14:00.619 INFO:teuthology.provision.fog.smithi060:Node is ready 2023-07-19T20:14:00.620 DEBUG:teuthology.orchestra.run.smithi060:> hostname 2023-07-19T20:14:00.667 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com 2023-07-19T20:14:00.667 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts 2023-07-19T20:14:00.715 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060 2023-07-19T20:14:00.716 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-07-19T20:14:00.841 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts 2023-07-19T20:14:00.856 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts 2023-07-19T20:14:00.912 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname 2023-07-19T20:14:00.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-07-19T20:14:01.030 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-07-19T20:14:01.083 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-19T20:14:01.083 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Ubuntu" 2023-07-19T20:14:01.083 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="22.04" 2023-07-19T20:14:01.084 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-19T20:14:01.084 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_CODENAME=jammy 2023-07-19T20:14:01.084 INFO:teuthology.orchestra.run.smithi060.stdout:ID=ubuntu 2023-07-19T20:14:01.084 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE=debian 2023-07-19T20:14:01.084 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-19T20:14:01.084 INFO:teuthology.orchestra.run.smithi060.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-19T20:14:01.085 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-19T20:14:01.085 INFO:teuthology.orchestra.run.smithi060.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-19T20:14:01.085 INFO:teuthology.orchestra.run.smithi060.stdout:UBUNTU_CODENAME=jammy 2023-07-19T20:14:01.085 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2023-07-19T20:14:01.086 DEBUG:teuthology.parallel:result is None 2023-07-19T20:14:10.800 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-07-19T20:14:16.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:14:16.803 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-07-19T20:14:22.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:14:22.805 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-07-19T20:14:26.928 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-19T20:14:26.929 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi159 2023-07-19T20:14:28.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:14:28.810 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-07-19T20:14:34.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:14:34.818 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-07-19T20:14:35.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-19T20:14:35.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:14:36.226 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-07-19T20:14:36.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-19T20:14:36.661 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T20:14:36.661 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T20:14:36.709 INFO:teuthology.provision.fog.smithi159:Node is ready 2023-07-19T20:14:36.709 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2023-07-19T20:14:36.757 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2023-07-19T20:14:36.757 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2023-07-19T20:14:36.809 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2023-07-19T20:14:36.810 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-07-19T20:14:36.949 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2023-07-19T20:14:36.963 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2023-07-19T20:14:37.017 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2023-07-19T20:14:37.072 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-07-19T20:14:37.128 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-07-19T20:14:37.173 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-19T20:14:37.173 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Ubuntu" 2023-07-19T20:14:37.174 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="22.04" 2023-07-19T20:14:37.174 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-19T20:14:37.174 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_CODENAME=jammy 2023-07-19T20:14:37.174 INFO:teuthology.orchestra.run.smithi159.stdout:ID=ubuntu 2023-07-19T20:14:37.174 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE=debian 2023-07-19T20:14:37.174 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-19T20:14:37.174 INFO:teuthology.orchestra.run.smithi159.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-19T20:14:37.175 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-19T20:14:37.175 INFO:teuthology.orchestra.run.smithi159.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-19T20:14:37.175 INFO:teuthology.orchestra.run.smithi159.stdout:UBUNTU_CODENAME=jammy 2023-07-19T20:14:37.175 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2023-07-19T20:14:37.175 DEBUG:teuthology.parallel:result is None 2023-07-19T20:14:40.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:14:41.017 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T20:14:41.017 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T20:14:41.506 INFO:teuthology.provision.fog.smithi111:Node is ready 2023-07-19T20:14:41.507 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2023-07-19T20:14:41.551 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2023-07-19T20:14:41.551 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2023-07-19T20:14:41.599 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2023-07-19T20:14:41.600 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-07-19T20:14:41.722 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2023-07-19T20:14:41.735 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2023-07-19T20:14:41.793 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2023-07-19T20:14:41.847 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-07-19T20:14:41.906 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-07-19T20:14:41.955 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-19T20:14:41.955 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2023-07-19T20:14:41.955 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2023-07-19T20:14:41.956 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-19T20:14:41.956 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2023-07-19T20:14:41.956 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2023-07-19T20:14:41.956 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2023-07-19T20:14:41.956 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-19T20:14:41.957 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-19T20:14:41.957 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-19T20:14:41.957 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-19T20:14:41.957 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2023-07-19T20:14:41.957 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2023-07-19T20:14:41.958 DEBUG:teuthology.parallel:result is None 2023-07-19T20:14:50.372 WARNING:teuthology.provision.fog.smithi157:timed out 2023-07-19T20:14:56.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:14:56.433 ERROR:paramiko.transport:Unknown exception: The socket has already been closed by another greenlet 2023-07-19T20:14:56.433 ERROR:paramiko.transport:Traceback (most recent call last): 2023-07-19T20:14:56.434 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run 2023-07-19T20:14:56.434 ERROR:paramiko.transport: ptype, m = self.packetizer.read_message() 2023-07-19T20:14:56.434 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message 2023-07-19T20:14:56.434 ERROR:paramiko.transport: header = self.read_all(self.__block_size_in, check_rekey=True) 2023-07-19T20:14:56.435 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all 2023-07-19T20:14:56.435 ERROR:paramiko.transport: x = self.__socket.recv(n) 2023-07-19T20:14:56.435 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 663, in recv 2023-07-19T20:14:56.435 ERROR:paramiko.transport: self._wait(self._read_event) 2023-07-19T20:14:56.435 ERROR:paramiko.transport: File "src/gevent/_hub_primitives.py", line 317, in gevent._gevent_c_hub_primitives.wait_on_socket 2023-07-19T20:14:56.436 ERROR:paramiko.transport: File "src/gevent/_hub_primitives.py", line 321, in gevent._gevent_c_hub_primitives.wait_on_socket 2023-07-19T20:14:56.436 ERROR:paramiko.transport:gevent.exceptions.ConcurrentObjectUseError: The socket has already been closed by another greenlet 2023-07-19T20:14:56.436 ERROR:paramiko.transport: 2023-07-19T20:14:56.576 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T20:14:56.577 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T20:14:57.008 INFO:teuthology.provision.fog.smithi157:Node is ready 2023-07-19T20:14:57.008 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2023-07-19T20:14:57.055 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2023-07-19T20:14:57.055 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2023-07-19T20:14:57.104 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2023-07-19T20:14:57.104 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-07-19T20:14:57.256 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2023-07-19T20:14:57.269 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2023-07-19T20:14:57.326 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2023-07-19T20:14:57.377 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-07-19T20:14:57.429 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-07-19T20:14:57.476 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-19T20:14:57.476 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2023-07-19T20:14:57.476 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="22.04" 2023-07-19T20:14:57.476 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-19T20:14:57.476 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=jammy 2023-07-19T20:14:57.477 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2023-07-19T20:14:57.477 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2023-07-19T20:14:57.477 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-19T20:14:57.477 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-19T20:14:57.477 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-19T20:14:57.477 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-19T20:14:57.477 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=jammy 2023-07-19T20:14:57.478 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2023-07-19T20:14:57.478 DEBUG:teuthology.parallel:result is None 2023-07-19T20:14:57.805 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2023-07-19T20:14:57.805 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T20:14:57.830 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com 2023-07-19T20:14:57.830 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T20:14:57.854 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2023-07-19T20:14:57.855 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T20:14:57.879 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2023-07-19T20:14:57.879 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T20:14:57.904 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2023-07-19T20:14:57.905 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T20:14:57.932 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2023-07-19T20:14:57.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-07-19T20:14:57.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:14:58.007 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-07-19T20:14:58.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-07-19T20:14:58.216 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-07-19T20:14:58.262 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-07-19T20:14:58.262 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-07-19T20:14:58.310 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-19T20:14:58.311 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Ubuntu" 2023-07-19T20:14:58.311 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="22.04" 2023-07-19T20:14:58.311 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-19T20:14:58.311 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_CODENAME=jammy 2023-07-19T20:14:58.311 INFO:teuthology.orchestra.run.smithi060.stdout:ID=ubuntu 2023-07-19T20:14:58.311 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE=debian 2023-07-19T20:14:58.311 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-19T20:14:58.312 INFO:teuthology.orchestra.run.smithi060.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-19T20:14:58.312 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-19T20:14:58.312 INFO:teuthology.orchestra.run.smithi060.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-19T20:14:58.312 INFO:teuthology.orchestra.run.smithi060.stdout:UBUNTU_CODENAME=jammy 2023-07-19T20:14:58.312 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-07-19T20:14:58.338 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server 2023-07-19T20:14:58.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-07-19T20:14:58.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:14:58.414 DEBUG:teuthology.orchestra.run.smithi087:> true 2023-07-19T20:14:58.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-07-19T20:14:58.632 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2023-07-19T20:14:58.677 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2023-07-19T20:14:58.678 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-07-19T20:14:58.725 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-19T20:14:58.726 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2023-07-19T20:14:58.726 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="22.04" 2023-07-19T20:14:58.726 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-19T20:14:58.726 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=jammy 2023-07-19T20:14:58.726 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2023-07-19T20:14:58.727 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2023-07-19T20:14:58.727 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-19T20:14:58.727 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-19T20:14:58.727 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-19T20:14:58.728 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-19T20:14:58.728 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=jammy 2023-07-19T20:14:58.728 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-07-19T20:14:58.754 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2023-07-19T20:14:58.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-07-19T20:14:58.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:14:58.829 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-07-19T20:14:58.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-07-19T20:14:58.936 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2023-07-19T20:14:58.986 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2023-07-19T20:14:58.986 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-07-19T20:14:59.034 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-19T20:14:59.035 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2023-07-19T20:14:59.035 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2023-07-19T20:14:59.035 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-19T20:14:59.035 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2023-07-19T20:14:59.035 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2023-07-19T20:14:59.035 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2023-07-19T20:14:59.035 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-19T20:14:59.036 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-19T20:14:59.036 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-19T20:14:59.036 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-19T20:14:59.036 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2023-07-19T20:14:59.036 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-07-19T20:14:59.062 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2023-07-19T20:14:59.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-07-19T20:14:59.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:14:59.138 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-07-19T20:14:59.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-07-19T20:14:59.232 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-07-19T20:14:59.279 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-07-19T20:14:59.279 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-07-19T20:14:59.327 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-19T20:14:59.327 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2023-07-19T20:14:59.327 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="22.04" 2023-07-19T20:14:59.327 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-19T20:14:59.327 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=jammy 2023-07-19T20:14:59.328 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2023-07-19T20:14:59.328 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2023-07-19T20:14:59.328 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-19T20:14:59.328 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-19T20:14:59.328 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-19T20:14:59.328 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-19T20:14:59.328 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=jammy 2023-07-19T20:14:59.329 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-07-19T20:14:59.354 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2023-07-19T20:14:59.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-19T20:14:59.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:14:59.434 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-07-19T20:14:59.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-19T20:14:59.529 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-07-19T20:14:59.577 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-07-19T20:14:59.578 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-07-19T20:14:59.625 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-19T20:14:59.625 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Ubuntu" 2023-07-19T20:14:59.625 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="22.04" 2023-07-19T20:14:59.625 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-19T20:14:59.625 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_CODENAME=jammy 2023-07-19T20:14:59.626 INFO:teuthology.orchestra.run.smithi159.stdout:ID=ubuntu 2023-07-19T20:14:59.626 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE=debian 2023-07-19T20:14:59.626 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-19T20:14:59.626 INFO:teuthology.orchestra.run.smithi159.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-19T20:14:59.626 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-19T20:14:59.627 INFO:teuthology.orchestra.run.smithi159.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-19T20:14:59.627 INFO:teuthology.orchestra.run.smithi159.stdout:UBUNTU_CODENAME=jammy 2023-07-19T20:14:59.627 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-07-19T20:14:59.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:14:59.655 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:14:59.746 INFO:teuthology.dispatcher.supervisor:Running job 7344205 2023-07-19T20:14:59.747 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344205 --name yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi --description fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} -- /home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344205/orig.config.yaml 2023-07-19T20:14:59.752 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344205 2023-07-19T20:14:59.753 INFO:teuthology.dispatcher.supervisor:Job PID: 26070 2023-07-19T20:14:59.753 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-19T20:16:59.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:16:59.853 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:19:00.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:19:00.033 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:21:00.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:21:00.214 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:23:00.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:23:00.391 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:25:00.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:25:00.581 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:27:00.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:27:00.753 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:29:00.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:29:00.918 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:31:01.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:31:01.089 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:33:01.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:33:01.266 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:35:01.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:35:01.442 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:37:01.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:37:01.606 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:37:01.684 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-19T20:37:01.913 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-19T20:37:01.913 INFO:teuthology.nuke:Checking targets against current locks 2023-07-19T20:37:01.980 DEBUG:teuthology.nuke:shortname: smithi060 2023-07-19T20:37:01.980 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T20:37:02.006 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344205', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 20:08:32.868662', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDetvZH12j4IpvJFq8RjA+WeIkTMEjQol1Uy6St8ycd7tVFuT/uo8SnPp8n2V/P/VMTRLRQMjrjGSAku1eO9uA0='} 2023-07-19T20:37:02.007 DEBUG:teuthology.nuke:shortname: smithi087 2023-07-19T20:37:02.007 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T20:37:02.041 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344205', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 20:08:32.872640', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFpiOaqlDMYRl0N+w11Nf0jy/s5URBH9PnCFOdOVCCnq2ZMdFsJADZ2XCKuGLZV3tlX6mOVvgTD+fqOyl10IVxk='} 2023-07-19T20:37:02.042 DEBUG:teuthology.nuke:shortname: smithi111 2023-07-19T20:37:02.043 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T20:37:02.067 DEBUG:teuthology.nuke:shortname: smithi157 2023-07-19T20:37:02.067 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T20:37:02.072 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344205', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 20:08:32.866710', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvXEDAlHBOEGi98ycRRKjHKINn1iCKTwBZ3DTbwr+j8EFlE/D8T6pk0w6u2ycnA53GFC1xqyANRFpp1l/q0XNo='} 2023-07-19T20:37:02.081 INFO:teuthology.orchestra.console:Power off smithi060 2023-07-19T20:37:02.082 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:37:02.106 DEBUG:teuthology.nuke:shortname: smithi159 2023-07-19T20:37:02.107 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T20:37:02.112 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:37:02.126 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344205', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 20:08:32.871336', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYKgw2yO5KbWDBmMSmk+A9cel95F0rF/Sn5mWGONvmu'} 2023-07-19T20:37:02.144 INFO:teuthology.orchestra.console:Power off smithi087 2023-07-19T20:37:02.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:37:02.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_19:57:09-fs-wip-yuri4-testing-2023-07-06-0738-reef-distro-default-smithi/7344205', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 20:08:32.869910', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNPLpLQgYDpbga1ZL1HW+bL0J1RrV/NOwHC11AEcWE1xY9gLu7uOakTJ8LDaTYJoHSFD63+HAk6dhGu7uHjeM5U='} 2023-07-19T20:37:02.169 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:37:02.202 INFO:teuthology.orchestra.console:Power off smithi111 2023-07-19T20:37:02.203 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:37:02.227 INFO:teuthology.orchestra.console:Power off smithi157 2023-07-19T20:37:02.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:37:02.241 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:37:02.259 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:37:02.269 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2023-07-19T20:37:02.287 INFO:teuthology.orchestra.console:Power off smithi159 2023-07-19T20:37:02.289 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:37:02.315 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:37:02.342 INFO:teuthology.orchestra.console:Power off for smithi087 completed 2023-07-19T20:37:02.405 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2023-07-19T20:37:02.407 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2023-07-19T20:37:02.431 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com 2023-07-19T20:37:02.441 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-07-19T20:37:02.499 INFO:teuthology.lock.ops:unlocked: smithi087.front.sepia.ceph.com 2023-07-19T20:37:02.585 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com 2023-07-19T20:37:02.593 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2023-07-19T20:37:02.602 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com