2023-07-21T08:35:38.544 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T08:35:38.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T08:35:38.546 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T08:35:53.533 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb61a9e18b0>, signals=[15]) 2023-07-21T08:35:53.535 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2023-07-21T08:35:53.535 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T08:35:53.536 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-07-21T08:36:03.570 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-07-21T08:36:03.570 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T08:36:03.571 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-07-21T08:36:03.572 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /host {"name": "smithi055"} 2023-07-21T08:36:13.611 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-07-21T08:36:23.665 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-21T08:36:26.543 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-21T08:36:31.598 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-21T08:36:31.599 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 2} 2023-07-21T08:36:41.610 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-21T08:36:41.610 DEBUG:teuthology.provision.fog.smithi055:FOG request: PUT /host/160 {"imageID": 2} 2023-07-21T08:36:46.670 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of ubuntu 20.04 2023-07-21T08:36:46.670 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-21T08:36:48.846 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of ubuntu 20.04 2023-07-21T08:36:48.847 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-21T08:36:48.946 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T08:36:48.973 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T08:36:53.982 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-07-21T08:36:59.027 DEBUG:teuthology.provision.fog.smithi055:FOG request: POST /host/160/task {"taskTypeID": 1} 2023-07-21T08:37:04.034 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-21T08:37:09.189 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-21T08:37:19.236 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-21T08:37:19.237 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T08:37:24.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:24.303 INFO:teuthology.orchestra.console:Power off smithi055 2023-07-21T08:37:24.304 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T08:37:24.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:28.300 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:28.353 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:33.413 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:33.462 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:38.524 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:38.573 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:43.636 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:43.684 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:48.747 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:48.794 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:53.858 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:53.905 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:54.069 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-21T08:37:54.170 INFO:teuthology.orchestra.console:Power on smithi140 2023-07-21T08:37:54.171 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T08:37:59.017 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:37:59.227 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2023-07-21T08:37:59.329 INFO:teuthology.orchestra.console:Power on smithi055 2023-07-21T08:37:59.329 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T08:37:59.356 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:38:03.384 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:38:07.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:38:07.706 INFO:teuthology.orchestra.console:Power on for smithi055 completed 2023-07-21T08:38:07.807 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2023-07-21T08:38:07.808 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-21T08:38:12.813 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:38:12.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:38:15.952 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-21T08:38:17.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:38:21.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:38:26.960 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:38:30.032 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-21T08:38:32.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:38:36.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:38:41.041 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:38:44.112 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-21T08:38:46.152 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:38:50.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:38:51.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:38:51.472 INFO:teuthology.orchestra.console:Power on for smithi140 completed 2023-07-21T08:38:51.573 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-07-21T08:38:51.573 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-21T08:38:56.581 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-21T08:38:56.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:38:59.728 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-21T08:39:02.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:39:05.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:39:13.812 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-21T08:39:19.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:39:24.825 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-21T08:39:27.888 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-21T08:39:30.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:39:35.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:39:40.904 ERROR:teuthology.orchestra.connection:Error authenticating with smithi055.front.sepia.ceph.com: Authentication failed. 2023-07-21T08:39:40.906 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T08:39:40.906 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T08:39:40.907 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:41.911 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:42.915 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:43.920 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:44.925 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:45.931 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:46.936 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:47.941 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:48.946 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:49.950 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:50.955 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:51.959 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:52.964 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:53.968 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:54.973 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:55.977 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:56.982 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:57.986 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:58.991 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:39:59.344 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-21T08:39:59.996 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:01.002 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:02.006 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:03.011 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:04.015 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:05.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:05.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:40:10.352 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:10.421 ERROR:teuthology.orchestra.connection:Error authenticating with smithi140.front.sepia.ceph.com: Authentication failed. 2023-07-21T08:40:10.422 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T08:40:10.422 DEBUG:teuthology.orchestra.run.smithi140:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T08:40:10.423 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:11.359 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:11.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:12.367 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:12.438 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:13.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:13.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:14.384 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:14.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:15.391 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:15.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:16.400 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:16.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:17.409 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:17.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:18.417 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:18.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:19.425 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:19.496 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:20.432 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:20.503 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:21.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:21.512 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:22.449 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:22.520 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:23.457 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:23.529 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:24.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:24.537 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:25.474 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:25.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:26.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:26.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:27.492 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:27.564 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:28.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:28.573 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:29.512 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:29.583 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:30.520 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:30.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:31.530 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:31.601 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:32.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:32.609 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:33.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:33.618 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:34.556 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:34.626 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:35.565 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:35.635 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:36.574 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:36.644 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:37.582 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:37.652 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:38.590 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:38.661 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:39.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:39.669 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:40.606 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:40.677 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:41.615 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:41.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:42.624 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:42.693 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:43.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:43.701 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:44.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:44.710 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:45.649 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:45.718 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:46.658 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:46.727 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:47.666 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:47.735 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:48.675 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:48.745 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:49.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:49.755 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:50.695 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:50.764 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:51.705 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:51.774 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:52.715 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:52.783 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:53.725 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:53.793 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:54.735 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:54.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:55.744 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:55.811 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:56.754 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:56.820 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:57.763 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:57.830 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:58.772 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:58.839 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:59.782 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:40:59.849 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:00.792 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:00.859 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:01.805 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:01.869 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:02.816 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:02.877 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:03.825 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:03.887 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:04.835 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:04.896 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:05.844 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:05.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:06.852 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:06.915 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:07.861 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:07.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:08.870 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:08.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:09.880 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:09.943 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:10.889 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:10.952 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:11.898 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:11.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:12.907 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:12.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:13.915 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:13.977 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:14.922 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:14.986 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:15.931 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:15.994 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:16.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:17.003 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:17.948 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:18.011 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:18.957 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:19.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:19.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:20.030 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:20.974 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:21.038 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:21.983 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:22.047 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:22.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:23.057 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:24.002 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:24.066 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:25.012 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:25.075 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:26.021 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:26.084 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:27.030 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:27.093 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:28.039 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:28.103 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:29.047 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:29.111 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:30.056 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:30.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:31.065 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:31.129 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:32.074 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:32.138 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:33.083 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:33.147 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:34.093 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:34.156 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:35.104 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:35.166 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:35.838 ERROR:teuthology.provision.fog: on smithi055 2023-07-21T08:41:36.179 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:37.184 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:38.195 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:39.200 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:40.208 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:41.212 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:42.218 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:43.223 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:44.228 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:44.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-21T08:41:44.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:41:44.956 ERROR:teuthology.orchestra.connection:Error authenticating with smithi055.front.sepia.ceph.com: Authentication failed. 2023-07-21T08:41:44.956 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-07-21T08:41:44.957 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:45.234 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:46.243 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:47.252 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:48.259 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:49.268 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:50.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:51.286 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:52.294 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:53.301 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:54.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:55.316 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:56.324 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:57.332 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:58.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:41:59.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:42:00.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:42:01.365 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:42:02.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:42:03.382 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:42:04.390 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:42:05.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:42:06.406 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:42:07.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:42:08.421 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:42:09.428 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:42:10.356 ERROR:teuthology.provision.fog: on smithi140 2023-07-21T08:42:19.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-07-21T08:42:19.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:42:19.469 ERROR:teuthology.orchestra.connection:Error authenticating with smithi140.front.sepia.ceph.com: Authentication failed. 2023-07-21T08:42:19.469 DEBUG:teuthology.orchestra.run.smithi140:> true 2023-07-21T08:42:19.470 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:44:28.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-07-21T08:44:28.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:44:28.477 ERROR:teuthology.orchestra.connection:Error authenticating with smithi140.front.sepia.ceph.com: Authentication failed. 2023-07-21T08:44:28.478 DEBUG:teuthology.orchestra.run.smithi140:> true 2023-07-21T08:44:28.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:46:40.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-07-21T08:46:40.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:46:40.487 ERROR:teuthology.orchestra.connection:Error authenticating with smithi140.front.sepia.ceph.com: Authentication failed. 2023-07-21T08:46:40.488 DEBUG:teuthology.orchestra.run.smithi140:> true 2023-07-21T08:46:40.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:48:43.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-07-21T08:48:43.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T08:48:48.500 ERROR:teuthology.orchestra.connection:Error authenticating with smithi140.front.sepia.ceph.com: Authentication failed. 2023-07-21T08:48:48.501 DEBUG:teuthology.orchestra.run.smithi140:> true 2023-07-21T08:48:48.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T08:50:48.395 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-21T08:50:48.397 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi140 2023-07-21T08:50:48.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T08:50:48.398 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T08:50:52.447 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T08:50:52.490 DEBUG:teuthology.nuke:shortname: smithi055 2023-07-21T08:50:52.490 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T08:50:57.528 DEBUG:teuthology.nuke:shortname: smithi140 2023-07-21T08:50:57.529 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T08:51:02.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346517', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 08:35:37.693694', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJpr1JeXvijUGrmGNkLA2tCLjf0aTXkjgars7UeeOTG1yCdZWeY5GMOSa22sTYOl1n2uIsrjlPz11LUzl52pDj2s1Fi8Py4WVHu/EMRv8+9qYrGfeZverRmpmHkrmE1RjpaTZQvaaZP67WIhlxpppyCdR1yx1aTtBihiYLt6wr+O2y0vYveaBHomqLk5OvVwq7BTB+NizbQpF5NTSW16k4osCNuMp105+fnNO4Tmg/AK2HoquZatOqt62M5m0JjhGDaZZepeKLy6dB/oru0XKAcD+oIRCfjnF6ZUJ1sVeUsdsa3wLpazW82ulK4oUcSAqpOi+WaJszxitKuLvlxxjNwspjRM997gI2x1J1B95Oklt5orzUb2M7tKZJaRQc6/SIo5Fa3m2L3OKFhULQziOzE1Vpq4r/kcDvISQjV7wrTfpYAotAdHbF2kxxX+yM7C/L1Ne9Cm7Kyio6lBm4q0zkfISPx6Gl5jxSbnQBBycixOD2KHaJVQemGf1p1Mgf3w0='} 2023-07-21T08:51:12.577 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346517', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 08:35:37.691967', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIgZ8Bd53fuCgCKJVFKEoISHXv8e16rj+5mHUw0oxKD/1FLTZxAy2jXni6HW8XTWz09dkyioP79i8vigElT1owY='} 2023-07-21T08:51:12.620 INFO:teuthology.orchestra.console:Power off smithi055 2023-07-21T08:51:12.621 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T08:51:12.639 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-21T08:51:12.639 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T08:51:12.650 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:51:12.661 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:51:16.673 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:51:16.685 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:51:20.786 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:51:20.798 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:51:21.008 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-21T08:51:26.117 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T08:51:31.182 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-07-21T08:51:31.258 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2023-07-21T08:51:41.424 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2023-07-21T08:51:48.361 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi140