2023-07-14T04:40:29.056 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-14T04:40:29.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T04:40:29.058 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T04:40:29.200 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb29e7178b0>, signals=[15]) 2023-07-14T04:40:29.202 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging 2023-07-14T04:40:29.202 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T04:40:29.202 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-07-14T04:40:29.225 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-07-14T04:40:29.225 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T04:40:29.225 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-07-14T04:40:29.226 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /host {"name": "smithi023"} 2023-07-14T04:40:29.250 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /host {"name": "smithi072"} 2023-07-14T04:40:29.292 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-14T04:40:29.312 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-14T04:40:29.335 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_centos_8.stream (ID 3) 2023-07-14T04:40:29.335 DEBUG:teuthology.provision.fog.smithi023:FOG request: PUT /host/129 {"imageID": 3} 2023-07-14T04:40:29.351 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_centos_8.stream (ID 3) 2023-07-14T04:40:29.351 DEBUG:teuthology.provision.fog.smithi072:FOG request: PUT /host/177 {"imageID": 3} 2023-07-14T04:40:34.359 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 8.stream 2023-07-14T04:40:34.359 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-14T04:40:39.414 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of centos 8.stream 2023-07-14T04:40:39.414 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T04:40:39.484 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T04:40:44.491 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T04:40:54.503 DEBUG:teuthology.provision.fog.smithi023:FOG request: POST /host/129/task {"taskTypeID": 1} 2023-07-14T04:41:04.548 DEBUG:teuthology.provision.fog.smithi072:FOG request: POST /host/177/task {"taskTypeID": 1} 2023-07-14T04:41:09.551 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-14T04:41:14.622 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T04:41:20.619 INFO:teuthology.orchestra.console:Power off smithi072 2023-07-14T04:41:20.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:41:20.635 INFO:teuthology.orchestra.console:Power off smithi023 2023-07-14T04:41:20.636 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:41:20.644 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:41:20.656 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:41:20.766 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2023-07-14T04:41:20.776 INFO:teuthology.orchestra.console:Power off for smithi023 completed 2023-07-14T04:41:20.867 INFO:teuthology.orchestra.console:Power on smithi072 2023-07-14T04:41:20.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T04:41:20.877 INFO:teuthology.orchestra.console:Power on smithi023 2023-07-14T04:41:20.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T04:41:20.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:41:20.895 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:41:24.911 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:41:24.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:41:30.023 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:41:30.030 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:41:35.133 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:41:35.143 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:41:35.353 INFO:teuthology.orchestra.console:Power on for smithi023 completed 2023-07-14T04:41:35.454 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2023-07-14T04:41:35.454 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-14T04:41:40.563 INFO:teuthology.orchestra.console:Power on for smithi072 completed 2023-07-14T04:41:40.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:41:45.579 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-07-14T04:41:45.579 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T04:41:50.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:41:58.768 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-14T04:42:04.016 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-07-14T04:42:04.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:42:07.824 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-14T04:42:10.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:42:15.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:42:20.029 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-07-14T04:42:23.088 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-14T04:42:26.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:42:31.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:42:36.046 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-07-14T04:42:42.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:42:50.128 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-07-14T04:42:54.448 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-14T04:42:56.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:43:00.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:43:00.816 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-07-14T04:43:01.276 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-14T04:43:06.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:43:07.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:43:12.394 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-07-14T04:43:12.395 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T04:43:12.396 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T04:43:12.397 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:13.400 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:14.403 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:15.406 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:16.410 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:17.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:18.416 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:19.421 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:20.425 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:21.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:22.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:23.438 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:24.442 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:25.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:26.451 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:27.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:28.459 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:29.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:30.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:31.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:32.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:33.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:34.485 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:35.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:36.494 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:37.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:38.334 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: Authentication failed. 2023-07-14T04:43:38.335 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T04:43:38.335 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T04:43:38.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:38.504 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:39.342 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:39.511 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:40.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:40.517 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:41.354 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:41.523 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:42.361 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:42.530 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:43.367 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:43.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:44.373 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:44.541 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:45.378 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:45.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:46.384 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:46.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:47.390 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:47.559 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:48.396 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:48.565 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:49.403 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:49.572 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:50.409 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:50.577 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:51.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:51.583 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:52.421 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:52.590 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:53.427 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:53.596 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:54.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:54.603 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:55.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:55.610 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:56.447 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:56.616 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:57.454 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:57.623 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:58.461 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:58.629 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:59.468 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:43:59.637 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:00.475 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:00.644 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:01.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:01.650 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:02.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:02.657 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:03.495 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:03.664 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:04.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:04.671 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:05.510 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:05.677 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:06.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:06.684 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:07.522 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:07.690 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:08.529 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:08.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:09.535 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:09.730 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:10.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:10.737 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:11.549 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:11.743 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:12.556 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:12.750 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:13.563 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:13.757 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:14.571 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:14.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:15.577 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:15.771 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:16.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:16.778 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:17.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:17.786 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:18.600 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:18.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:19.608 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:19.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:20.615 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:20.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:21.623 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:21.817 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:22.630 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:22.824 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:23.636 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:23.830 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:24.643 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:24.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:25.650 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:25.844 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:26.657 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:26.851 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:27.665 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:27.859 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:28.673 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:28.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:29.681 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:29.875 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:30.689 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:30.883 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:31.696 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:31.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:32.704 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:32.898 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:33.711 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:33.905 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:34.718 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:34.912 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:35.726 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:35.920 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:36.734 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:36.928 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:37.742 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:37.936 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:38.751 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:38.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:39.758 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:39.952 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:40.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:40.959 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:41.772 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:41.966 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:42.780 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:42.975 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:43.788 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:43.982 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:44.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:44.989 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:45.803 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:45.997 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:46.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:47.004 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:47.818 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:48.012 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:48.826 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:49.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:49.834 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:50.028 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:50.842 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:51.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:51.850 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:52.044 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:52.858 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:53.053 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:53.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:54.061 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:54.875 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:55.069 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:55.883 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:56.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:56.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:57.085 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:57.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:58.093 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:58.907 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:59.101 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:44:59.918 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:00.109 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:00.926 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:01.117 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:01.934 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:02.125 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:02.942 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:03.134 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:03.950 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:04.141 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:04.958 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:05.149 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:05.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:06.156 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:06.972 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:07.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:07.980 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:08.171 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:08.988 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:09.179 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:09.997 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:10.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:11.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:11.196 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:12.013 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:12.204 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:12.289 ERROR:teuthology.provision.fog: on smithi072 2023-07-14T04:45:13.019 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:14.024 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:15.029 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:16.034 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:17.038 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:18.043 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:19.048 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:20.053 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:21.058 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:21.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-14T04:45:21.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:45:26.298 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:26.407 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication failed. 2023-07-14T04:45:26.408 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-07-14T04:45:26.409 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:27.304 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:28.312 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:29.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:30.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:31.334 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:32.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:33.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:34.355 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:35.363 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:36.369 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:37.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:45:38.230 ERROR:teuthology.provision.fog: on smithi023 2023-07-14T04:45:47.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-07-14T04:45:47.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:45:47.302 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: Authentication failed. 2023-07-14T04:45:47.303 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-07-14T04:45:47.303 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:47:56.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-07-14T04:47:56.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:48:01.317 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: Authentication failed. 2023-07-14T04:48:01.318 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-07-14T04:48:01.319 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:50:13.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-07-14T04:50:13.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:50:18.371 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: Authentication failed. 2023-07-14T04:50:18.371 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-07-14T04:50:18.372 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:52:21.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-07-14T04:52:21.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:52:21.380 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: Authentication failed. 2023-07-14T04:52:21.381 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-07-14T04:52:21.382 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T04:54:21.277 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-14T04:54:21.279 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi023 2023-07-14T04:54:21.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T04:54:21.281 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T04:54:26.377 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T04:54:38.399 DEBUG:teuthology.nuke:shortname: smithi023 2023-07-14T04:54:38.400 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T04:54:48.437 DEBUG:teuthology.nuke:shortname: smithi072 2023-07-14T04:54:48.438 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T04:54:52.750 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi023.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:28:44-rbd-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337058', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:40:28.300666', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-14T04:54:57.822 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:28:44-rbd-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337058', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:40:28.302318', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG7vFM/ECjP4Q1RMDG7AHInAc01LJHInuT5egTSteOAV31WLH5ySR63Wqx2zWNwyXLG4frVqjiNsWpVy7Ezi4LM='} 2023-07-14T04:55:02.864 INFO:teuthology.orchestra.console:Power off smithi023 2023-07-14T04:55:02.865 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:55:07.889 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:55:07.905 INFO:teuthology.orchestra.console:Power off smithi072 2023-07-14T04:55:07.905 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:55:12.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:55:12.933 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:55:17.010 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:55:17.942 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:55:22.120 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:55:23.054 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:55:23.264 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2023-07-14T04:55:30.529 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:55:30.573 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com 2023-07-14T04:55:35.639 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:55:40.750 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:55:45.860 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:55:50.971 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:55:56.084 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:56:01.195 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:56:06.307 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:56:06.520 INFO:teuthology.orchestra.console:Power off for smithi023 completed 2023-07-14T04:56:11.101 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com 2023-07-14T04:56:11.329 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi023