2023-07-13T23:48:59.477 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-13T23:48:59.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:48:59.479 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:49:24.645 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7af238dee0>, signals=[15]) 2023-07-13T23:49:24.647 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2023-07-13T23:49:24.647 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T23:49:24.648 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-07-13T23:49:36.094 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-07-13T23:49:36.094 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T23:49:36.094 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-13T23:49:36.096 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"} 2023-07-13T23:49:46.126 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-07-13T23:49:55.278 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-13T23:50:05.317 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-13T23:50:10.274 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-13T23:50:10.274 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 2} 2023-07-13T23:50:10.332 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-13T23:50:10.332 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 2} 2023-07-13T23:50:10.338 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of ubuntu 20.04 2023-07-13T23:50:10.338 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-13T23:50:10.400 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of ubuntu 20.04 2023-07-13T23:50:10.400 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-13T23:50:10.414 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T23:50:10.459 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1} 2023-07-13T23:50:10.471 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T23:50:10.510 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-13T23:50:10.512 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-07-13T23:50:10.562 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-13T23:50:20.631 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-13T23:50:20.633 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:50:20.647 INFO:teuthology.orchestra.console:Power off smithi079 2023-07-13T23:50:20.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:50:20.657 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:50:20.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:50:20.779 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-13T23:50:20.791 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2023-07-13T23:50:20.881 INFO:teuthology.orchestra.console:Power on smithi149 2023-07-13T23:50:20.881 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T23:50:20.893 INFO:teuthology.orchestra.console:Power on smithi079 2023-07-13T23:50:20.893 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T23:50:20.908 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:50:20.918 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:50:24.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:50:24.940 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:50:30.043 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:50:30.051 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:50:35.153 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:50:35.163 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:50:35.366 INFO:teuthology.orchestra.console:Power on for smithi149 completed 2023-07-13T23:50:35.467 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-07-13T23:50:35.468 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-13T23:50:40.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:50:43.536 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-13T23:50:44.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:50:49.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:50:49.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:50:57.620 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-13T23:50:59.547 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:51:03.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:51:08.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:51:11.700 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-13T23:51:13.742 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:51:13.954 INFO:teuthology.orchestra.console:Power on for smithi079 completed 2023-07-13T23:51:14.055 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2023-07-13T23:51:14.056 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-13T23:51:19.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:51:27.120 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-13T23:51:33.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:51:39.148 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-13T23:51:56.528 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-13T23:51:59.233 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-13T23:52:04.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:52:09.361 ERROR:teuthology.orchestra.connection:Error authenticating with smithi149.front.sepia.ceph.com: Authentication failed. 2023-07-13T23:52:09.363 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T23:52:09.364 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T23:52:09.365 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:10.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:11.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:12.382 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:13.388 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:14.393 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:15.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:16.404 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:17.411 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:18.417 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:19.425 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:20.431 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:21.437 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:22.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:23.449 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:24.324 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-13T23:52:29.329 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:30.334 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:31.339 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:32.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:33.352 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:34.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:35.362 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:36.368 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:37.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:38.383 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:39.390 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:40.395 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:41.401 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:42.407 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:43.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:44.402 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-13T23:52:49.409 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:50.415 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:51.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:52.426 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:53.432 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:54.439 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:55.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:56.450 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:57.456 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:58.461 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:52:59.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:00.474 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:01.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:02.484 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:03.490 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:04.461 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-13T23:53:09.468 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:10.473 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:11.478 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:12.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:13.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:14.495 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:15.500 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:16.506 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:17.512 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:18.517 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:19.523 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:20.530 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:21.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:22.543 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:23.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:24.538 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-13T23:53:29.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:30.551 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:31.557 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:32.562 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:33.567 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:34.573 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:35.581 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:36.587 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:37.593 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:38.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:39.605 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:40.611 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:41.618 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:42.624 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:43.630 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:44.608 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-13T23:53:49.614 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:50.619 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:51.625 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:52.630 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:53.636 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:54.642 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:55.647 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:56.653 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:53:57.659 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T23:54:04.678 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-13T23:54:09.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:54:17.812 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-13T23:54:23.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:54:26.896 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-13T23:54:32.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:54:40.976 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-13T23:54:46.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:54:50.036 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-13T23:54:56.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:54:59.088 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-13T23:55:05.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:55:46.160 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-13T23:55:46.162 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi149 2023-07-13T23:55:55.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-13T23:55:55.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:56:00.389 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-07-13T23:56:00.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-13T23:56:00.883 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T23:56:00.883 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T23:56:00.888 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-07-13T23:56:00.888 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-07-13T23:56:00.894 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-07-13T23:56:00.894 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-07-13T23:56:00.944 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-07-13T23:56:00.945 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-13T23:56:01.029 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-07-13T23:56:01.045 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-07-13T23:56:01.103 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-07-13T23:56:01.116 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-13T23:56:01.127 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-13T23:56:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-07-13T23:56:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-13T23:56:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-07-13T23:56:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-07-13T23:56:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-13T23:56:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-07-13T23:56:01.176 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-13T23:56:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-13T23:56:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-13T23:56:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-13T23:56:01.177 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-07-13T23:56:01.178 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-07-13T23:56:01.179 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-07-13T23:56:01.181 DEBUG:teuthology.parallel:result is None 2023-07-13T23:56:05.092 WARNING:teuthology.provision.fog.smithi079:timed out 2023-07-13T23:56:11.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:56:16.326 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T23:56:16.326 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T23:56:16.835 INFO:teuthology.provision.fog.smithi079:Node is ready 2023-07-13T23:56:16.836 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2023-07-13T23:56:16.842 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2023-07-13T23:56:16.842 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2023-07-13T23:56:16.849 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2023-07-13T23:56:16.850 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-07-13T23:56:16.963 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2023-07-13T23:56:16.978 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2023-07-13T23:56:16.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2023-07-13T23:56:17.002 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-07-13T23:56:17.058 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-07-13T23:56:17.063 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Ubuntu" 2023-07-13T23:56:17.063 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-13T23:56:17.063 INFO:teuthology.orchestra.run.smithi079.stdout:ID=ubuntu 2023-07-13T23:56:17.063 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE=debian 2023-07-13T23:56:17.064 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-13T23:56:17.064 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="20.04" 2023-07-13T23:56:17.064 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-13T23:56:17.064 INFO:teuthology.orchestra.run.smithi079.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-13T23:56:17.064 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-13T23:56:17.064 INFO:teuthology.orchestra.run.smithi079.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-13T23:56:17.064 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_CODENAME=focal 2023-07-13T23:56:17.065 INFO:teuthology.orchestra.run.smithi079.stdout:UBUNTU_CODENAME=focal 2023-07-13T23:56:17.065 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2023-07-13T23:56:17.065 DEBUG:teuthology.parallel:result is None 2023-07-13T23:56:41.662 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2023-07-13T23:56:41.663 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T23:56:43.759 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-07-13T23:56:43.759 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T23:56:43.786 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2023-07-13T23:56:43.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-07-13T23:56:43.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:56:43.842 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-07-13T23:56:44.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-07-13T23:56:44.046 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-07-13T23:56:44.052 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-07-13T23:56:44.053 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-07-13T23:56:44.060 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Ubuntu" 2023-07-13T23:56:44.060 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-13T23:56:44.060 INFO:teuthology.orchestra.run.smithi079.stdout:ID=ubuntu 2023-07-13T23:56:44.061 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE=debian 2023-07-13T23:56:44.061 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-13T23:56:44.061 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="20.04" 2023-07-13T23:56:44.061 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-13T23:56:44.061 INFO:teuthology.orchestra.run.smithi079.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-13T23:56:44.061 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-13T23:56:44.061 INFO:teuthology.orchestra.run.smithi079.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-13T23:56:44.062 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_CODENAME=focal 2023-07-13T23:56:44.062 INFO:teuthology.orchestra.run.smithi079.stdout:UBUNTU_CODENAME=focal 2023-07-13T23:56:44.062 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-07-13T23:56:44.083 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-07-13T23:56:44.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-13T23:56:44.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:56:44.141 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-07-13T23:56:44.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-13T23:56:44.342 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-07-13T23:56:44.348 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-07-13T23:56:44.348 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-13T23:56:44.354 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-07-13T23:56:44.355 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-13T23:56:44.355 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-07-13T23:56:44.355 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-07-13T23:56:44.355 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-13T23:56:44.356 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-07-13T23:56:44.356 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-13T23:56:44.356 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-13T23:56:44.356 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-13T23:56:44.357 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-13T23:56:44.357 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-07-13T23:56:44.357 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-07-13T23:56:44.357 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-13T23:56:49.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:56:49.383 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:56:54.483 INFO:teuthology.dispatcher.supervisor:Running job 7336698 2023-07-13T23:56:54.483 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336698 --name gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi --description orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} -- /home/teuthworker/archive/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336698/orig.config.yaml 2023-07-13T23:56:54.486 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336698 2023-07-13T23:56:54.487 INFO:teuthology.dispatcher.supervisor:Job PID: 29074 2023-07-13T23:56:54.487 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-13T23:58:54.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:58:54.586 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T00:00:59.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T00:00:59.766 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T00:02:59.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T00:02:59.947 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T00:05:05.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T00:05:05.129 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T00:07:10.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T00:07:10.315 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T00:09:15.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T00:09:15.491 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T00:09:20.573 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-14T00:09:26.016 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-14T00:09:26.017 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T00:09:26.066 DEBUG:teuthology.nuke:shortname: smithi079 2023-07-14T00:09:26.067 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T00:09:26.088 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336698', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 23:48:57.749919', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-07-14T00:09:26.091 DEBUG:teuthology.nuke:shortname: smithi149 2023-07-14T00:09:26.092 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T00:09:26.116 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336698', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 23:48:57.751119', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-07-14T00:09:26.146 INFO:teuthology.orchestra.console:Power off smithi079 2023-07-14T00:09:26.147 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T00:09:26.170 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:09:26.185 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-14T00:09:26.186 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T00:09:26.209 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:09:26.296 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2023-07-14T00:09:26.330 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-14T00:09:26.452 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2023-07-14T00:09:26.478 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com