2023-07-19T22:39:28.107 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-19T22:39:28.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T22:39:28.109 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T22:39:28.316 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc84b9c18b0>, signals=[15]) 2023-07-19T22:39:28.317 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2023-07-19T22:39:28.318 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T22:39:28.318 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-07-19T22:39:28.344 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-07-19T22:39:28.345 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T22:39:28.345 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-07-19T22:39:28.346 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /host {"name": "smithi119"} 2023-07-19T22:39:28.369 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2023-07-19T22:39:28.369 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T22:39:28.369 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-07-19T22:39:28.371 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-07-19T22:39:28.395 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /host {"name": "smithi188"} 2023-07-19T22:39:28.431 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-19T22:39:28.438 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-19T22:39:28.463 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-19T22:39:28.476 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-19T22:39:28.477 DEBUG:teuthology.provision.fog.smithi119:FOG request: PUT /host/224 {"imageID": 2} 2023-07-19T22:39:28.489 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-19T22:39:28.489 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 2} 2023-07-19T22:39:28.511 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-19T22:39:28.512 DEBUG:teuthology.provision.fog.smithi188:FOG request: PUT /host/293 {"imageID": 2} 2023-07-19T22:39:28.524 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of ubuntu 20.04 2023-07-19T22:39:28.524 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-19T22:39:28.529 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of ubuntu 20.04 2023-07-19T22:39:28.530 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-19T22:39:28.573 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of ubuntu 20.04 2023-07-19T22:39:28.574 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-19T22:39:28.597 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T22:39:28.604 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T22:39:28.635 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T22:39:28.641 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-07-19T22:39:28.647 DEBUG:teuthology.provision.fog.smithi119:FOG request: POST /host/224/task {"taskTypeID": 1} 2023-07-19T22:39:28.673 DEBUG:teuthology.provision.fog.smithi188:FOG request: POST /host/293/task {"taskTypeID": 1} 2023-07-19T22:39:28.726 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-19T22:39:28.728 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-19T22:39:28.735 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-19T22:39:28.862 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-19T22:39:28.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T22:39:28.879 INFO:teuthology.orchestra.console:Power off smithi188 2023-07-19T22:39:28.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T22:39:28.895 INFO:teuthology.orchestra.console:Power off smithi119 2023-07-19T22:39:28.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T22:39:28.905 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:28.914 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:28.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:32.938 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:32.946 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:32.955 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:38.051 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:38.060 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:38.069 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:43.165 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:43.174 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:43.182 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:48.279 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:48.287 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:48.295 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:48.497 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-19T22:39:48.598 INFO:teuthology.orchestra.console:Power on smithi140 2023-07-19T22:39:48.599 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T22:39:48.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:52.644 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:53.390 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:53.405 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:57.756 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:58.504 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:39:58.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:02.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:03.617 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:03.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:07.978 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:08.727 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:08.740 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:13.092 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:13.839 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:13.850 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:18.204 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:18.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:18.960 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:23.316 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:24.064 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:24.073 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:28.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:29.176 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:29.185 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:29.395 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2023-07-19T22:40:29.496 INFO:teuthology.orchestra.console:Power on smithi119 2023-07-19T22:40:29.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T22:40:29.516 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:33.540 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:33.549 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:34.288 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:38.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:38.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:39.405 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:40.516 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-07-19T22:40:40.516 ERROR:teuthology.orchestra.console:Failed to power off smithi188 2023-07-19T22:40:40.517 INFO:teuthology.orchestra.console:Power on smithi188 2023-07-19T22:40:40.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T22:40:43.763 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:43.772 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:44.978 INFO:teuthology.orchestra.console:Power on for smithi119 completed 2023-07-19T22:40:45.079 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2023-07-19T22:40:45.080 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-19T22:40:49.747 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:49.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:40:50.543 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:52.881 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-19T22:40:54.857 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:55.067 INFO:teuthology.orchestra.console:Power on for smithi140 completed 2023-07-19T22:40:55.168 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-07-19T22:40:55.168 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-19T22:40:55.555 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:40:58.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:41:03.889 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:41:06.960 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-19T22:41:09.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:41:10.260 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-19T22:41:20.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:41:20.271 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:41:23.344 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-19T22:41:25.384 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:41:25.594 INFO:teuthology.orchestra.console:Power on for smithi188 completed 2023-07-19T22:41:25.696 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2023-07-19T22:41:25.696 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-19T22:41:30.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:41:35.705 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-19T22:41:39.967 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-19T22:41:45.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:41:54.978 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-19T22:41:59.985 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-19T22:42:04.532 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-19T22:42:10.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:42:15.541 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-19T22:42:15.542 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-19T22:42:30.351 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: Authentication failed. 2023-07-19T22:42:30.352 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T22:42:30.353 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T22:42:30.354 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:31.360 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:32.365 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:33.371 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:34.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:35.382 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:36.388 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:37.394 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:38.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:39.404 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:40.410 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:41.415 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:42.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:43.425 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:44.431 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:45.370 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-19T22:42:50.377 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-19T22:42:55.385 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:55.487 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:56.491 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:57.495 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:58.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:42:59.503 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:00.508 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:01.513 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:02.520 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:03.526 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:04.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:05.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:06.541 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:07.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:08.552 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:09.558 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:10.457 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-19T22:43:15.459 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-19T22:43:16.397 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:16.498 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:17.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:18.506 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:19.511 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:20.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:21.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:22.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:23.530 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:24.534 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:25.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:26.544 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:27.549 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:28.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:29.558 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:30.563 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:31.487 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-19T22:43:36.494 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-19T22:43:41.501 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:41.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:43:46.591 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:47.596 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:48.601 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:49.606 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:49.648 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-19T22:43:50.612 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:51.618 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:52.623 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:53.629 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:54.634 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:55.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:43:55.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:44:00.653 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:01.592 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-19T22:44:06.595 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-19T22:44:06.596 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:07.601 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:08.606 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:09.611 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:10.615 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:11.620 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:12.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:44:17.601 ERROR:teuthology.provision.fog: on smithi119 2023-07-19T22:44:20.656 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-19T22:44:21.679 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-19T22:44:26.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-19T22:44:26.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:44:31.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:44:36.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:44:36.764 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: Authentication failed. 2023-07-19T22:44:36.765 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-07-19T22:44:36.766 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:36.809 ERROR:teuthology.orchestra.connection:Error authenticating with smithi188.front.sepia.ceph.com: Authentication failed. 2023-07-19T22:44:36.809 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T22:44:36.810 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T22:44:36.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:37.816 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:38.823 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:39.760 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-19T22:44:39.830 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:40.836 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:41.842 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:42.848 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:43.854 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:44.860 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:45.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:44:50.766 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:51.771 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:52.777 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:53.782 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:53.840 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-19T22:44:54.789 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:55.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:56.801 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:57.807 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:58.812 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:59.818 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:59.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:45:00.823 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:01.829 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:02.835 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:03.841 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:04.847 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:05.853 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:06.859 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:07.866 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:08.872 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:09.878 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:10.886 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:11.892 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:12.898 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:13.904 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:14.911 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:15.917 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:16.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:17.928 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:18.934 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:19.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:20.945 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:21.951 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:22.958 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:23.964 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:24.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:25.974 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:26.979 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:27.984 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:28.989 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:29.994 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:31.000 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:32.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:33.011 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:34.017 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:35.023 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:36.029 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:37.035 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:59.843 WARNING:teuthology.provision.fog.smithi140:timed out 2023-07-19T22:46:05.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:46:06.056 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T22:46:06.056 DEBUG:teuthology.orchestra.run.smithi140:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T22:46:06.529 INFO:teuthology.provision.fog.smithi140:Node is ready 2023-07-19T22:46:06.529 DEBUG:teuthology.orchestra.run.smithi140:> hostname 2023-07-19T22:46:06.535 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com 2023-07-19T22:46:06.536 DEBUG:teuthology.orchestra.run.smithi140:> grep smithi140.front.sepia.ceph.com /etc/hosts 2023-07-19T22:46:06.543 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140 2023-07-19T22:46:06.543 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140 2023-07-19T22:46:06.678 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hosts 2023-07-19T22:46:06.695 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/172.21.15.140/172.21.15.140/g' /etc/hosts 2023-07-19T22:46:06.755 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hostname 2023-07-19T22:46:06.767 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140 2023-07-19T22:46:06.781 DEBUG:teuthology.orchestra.run.smithi140:> cat /etc/os-release 2023-07-19T22:46:06.829 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Ubuntu" 2023-07-19T22:46:06.829 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-19T22:46:06.829 INFO:teuthology.orchestra.run.smithi140.stdout:ID=ubuntu 2023-07-19T22:46:06.830 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE=debian 2023-07-19T22:46:06.830 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-19T22:46:06.830 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="20.04" 2023-07-19T22:46:06.830 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-19T22:46:06.830 INFO:teuthology.orchestra.run.smithi140.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-19T22:46:06.830 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-19T22:46:06.831 INFO:teuthology.orchestra.run.smithi140.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-19T22:46:06.831 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_CODENAME=focal 2023-07-19T22:46:06.831 INFO:teuthology.orchestra.run.smithi140.stdout:UBUNTU_CODENAME=focal 2023-07-19T22:46:06.832 INFO:teuthology.provision.fog.smithi140:Deploy complete! 2023-07-19T22:46:06.833 DEBUG:teuthology.parallel:result is None 2023-07-19T22:47:26.068 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-19T22:47:26.069 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi188 2023-07-19T22:47:35.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-07-19T22:47:35.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:47:40.289 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-07-19T22:47:40.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-07-19T22:47:40.779 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T22:47:40.779 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T22:47:40.825 INFO:teuthology.provision.fog.smithi188:Node is ready 2023-07-19T22:47:40.826 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2023-07-19T22:47:40.832 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2023-07-19T22:47:40.833 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2023-07-19T22:47:40.839 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2023-07-19T22:47:40.840 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-07-19T22:47:40.988 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2023-07-19T22:47:41.003 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2023-07-19T22:47:41.015 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2023-07-19T22:47:41.075 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-07-19T22:47:41.087 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-07-19T22:47:41.092 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Ubuntu" 2023-07-19T22:47:41.093 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-19T22:47:41.094 INFO:teuthology.orchestra.run.smithi188.stdout:ID=ubuntu 2023-07-19T22:47:41.094 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE=debian 2023-07-19T22:47:41.095 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-19T22:47:41.095 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="20.04" 2023-07-19T22:47:41.095 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-19T22:47:41.095 INFO:teuthology.orchestra.run.smithi188.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-19T22:47:41.096 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-19T22:47:41.096 INFO:teuthology.orchestra.run.smithi188.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-19T22:47:41.096 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_CODENAME=focal 2023-07-19T22:47:41.096 INFO:teuthology.orchestra.run.smithi188.stdout:UBUNTU_CODENAME=focal 2023-07-19T22:47:41.097 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2023-07-19T22:47:41.098 DEBUG:teuthology.parallel:result is None 2023-07-19T23:44:45.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-19T23:44:45.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T23:44:45.884 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-07-19T23:44:45.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-19T23:44:45.959 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T23:44:45.959 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T23:44:46.019 INFO:teuthology.provision.fog.smithi119:Node is ready 2023-07-19T23:44:46.020 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2023-07-19T23:44:46.079 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119 2023-07-19T23:44:46.080 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119 /etc/hosts 2023-07-19T23:44:46.140 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2023-07-19T23:44:46.140 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119 smithi119 2023-07-19T23:44:46.141 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-07-19T23:44:46.212 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119/smithi119/g' /etc/hosts 2023-07-19T23:44:46.282 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts 2023-07-19T23:44:46.352 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119/smithi119/g' /etc/hostname 2023-07-19T23:44:46.420 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-07-19T23:44:46.487 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-07-19T23:44:46.545 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2023-07-19T23:44:46.546 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8" 2023-07-19T23:44:46.546 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2023-07-19T23:44:46.546 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2023-07-19T23:44:46.546 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8" 2023-07-19T23:44:46.546 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2023-07-19T23:44:46.546 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-19T23:44:46.546 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-07-19T23:44:46.547 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-19T23:44:46.547 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2023-07-19T23:44:46.547 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T23:44:46.547 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T23:44:46.547 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-19T23:44:46.549 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi119's OS to be ubuntu 20.04 but found centos 8 2023-07-19T23:44:46.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T23:44:46.550 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T23:44:46.636 INFO:teuthology.nuke:Checking targets against current locks 2023-07-19T23:44:46.683 DEBUG:teuthology.nuke:shortname: smithi119 2023-07-19T23:44:46.684 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T23:44:46.705 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_14:40:49-rbd-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7343948', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 23:06:05.660449', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDTHmD6hJVH4tZjZGW/ZFrcEsEYCT7Zg07jG2RCqeJB3+O4IP+Ecyon1WQqAvI77hQ4AelanXvA5jP8Dte0esNA='} 2023-07-19T23:44:46.716 DEBUG:teuthology.nuke:shortname: smithi140 2023-07-19T23:44:46.717 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T23:44:46.744 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_14:40:49-rbd-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7343919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 22:39:07.164732', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+I0+6KbJL5eZr8MdU6kJyyM8g6UUCM3Pw/oB3qVekbMkpA52leGnn3Ruxwep4m6IzMyxy+/tQGg5mEOFLYm4gpXOz4jRsBI1wQk4MVvls3D9cICPOwi0gIVtCrAhGKLIvS25bR35EFt01TK4m9R/AKZu99OYy8hPVIhZ0w+Sd1ridtF/qjLCW3rczqPi3Hz0fikTRKJuLZAdN20cv1YQE/B0ZY8uF3UPToZT6/Ln+aluonj810pVMn9wTc9QEqm1JypcTbRpdzcP8UMfvs3CLZxouTgFlYc7VPQmvspwYLJ3y02JqsqwZfhBKllIwDYsPYwlzTAQyJeRFs0VGJwUQHhoujyDlWupV5GxfJee1zIAbzEP60o2hCYXoN7ltadeNJSLH/OMPFhCutKt7c2ADq/EPqmZZpNBlsOZF/rkoWaEvdbdsT9+4wG3HhCl2EGyVoAq//BG4uIxQh7UmgmzhDyt1nFspHo5HLgV0Px9DTOuDOFqaE6inM2ouJWvBhks='} 2023-07-19T23:44:46.748 DEBUG:teuthology.nuke:shortname: smithi188 2023-07-19T23:44:46.749 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T23:44:46.757 INFO:teuthology.orchestra.console:Power off smithi119 2023-07-19T23:44:46.758 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T23:44:46.783 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T23:44:46.794 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_14:40:49-rbd-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7343919', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 22:39:07.161787', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBRx39g1yJN1tn4hVZtmLy86C9izz6qmaotIgPk3i0c6zTVY4dGiapqAe8MALXOhjBHkxdt9mUtKYQj2XiSSKc+cHQLaQik+zs3AK8gLgTli1uiODcmbvPYOODAsTK13ESsiuj9cqvgZeptRqH+aYRLSZM4G5w6WfTAELPtxZCex/mN8NK4ZtPVV9GDn8HMT8gMTE3FjuXsRescXRlLs9OtK664LHnAdfq9ics2w2YQiRf6XSgMrV0DNplfviOTqzd0cXGXWaontoKYwZ9bhSYiP6AdRUmCux+VnphoNs8fhuDISMhE+halEY/XyAoA19cUzF4D+03hFcxUxVvmhSmmxyz413OtEh5mORntBxaMElR1qHeIxoPCS9Dds49ZfwzlwKPuixy6FHTNiHoZl75neeR6EAKY221C9DVuyceo7b7Qyg19D8E4Kd91zKysaYpoGLQWbKyUzPZsisGgI/p9JiAP7X/steFI+BbCktJXGiR3uZJJyAjK0yZmHgGJaE='} 2023-07-19T23:44:46.802 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-19T23:44:46.803 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T23:44:46.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T23:44:46.868 INFO:teuthology.orchestra.console:Power off smithi188 2023-07-19T23:44:46.869 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T23:44:46.895 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T23:44:50.814 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T23:44:50.849 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T23:44:50.926 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T23:44:54.925 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T23:44:54.961 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T23:44:55.041 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T23:44:55.137 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2023-07-19T23:44:55.300 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com 2023-07-19T23:44:59.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T23:44:59.151 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T23:44:59.288 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-19T23:44:59.361 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2023-07-19T23:44:59.450 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-07-19T23:44:59.516 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com 2023-07-19T23:44:59.899 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi119's OS to be ubuntu 20.04 but found centos 8