2023-07-26T00:20:22.697 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-26T00:20:22.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T00:20:22.699 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T00:20:37.835 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3d261bf310>, signals=[15]) 2023-07-26T00:20:37.837 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2023-07-26T00:20:37.837 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T00:20:37.837 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-07-26T00:20:37.858 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2023-07-26T00:20:37.858 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T00:20:37.858 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-07-26T00:20:37.866 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /host {"name": "smithi012"} 2023-07-26T00:20:37.896 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /host {"name": "smithi083"} 2023-07-26T00:20:37.947 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-26T00:20:37.986 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-26T00:20:37.986 DEBUG:teuthology.provision.fog.smithi012:FOG request: PUT /host/118 {"imageID": 2} 2023-07-26T00:20:37.991 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-26T00:20:38.030 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-26T00:20:38.030 DEBUG:teuthology.provision.fog.smithi083:FOG request: PUT /host/188 {"imageID": 2} 2023-07-26T00:20:38.038 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of ubuntu 20.04 2023-07-26T00:20:38.038 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-26T00:20:38.084 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of ubuntu 20.04 2023-07-26T00:20:38.085 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T00:20:38.090 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T00:20:38.120 DEBUG:teuthology.provision.fog.smithi012:FOG request: POST /host/118/task {"taskTypeID": 1} 2023-07-26T00:20:38.164 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T00:20:38.169 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-26T00:20:38.213 DEBUG:teuthology.provision.fog.smithi083:FOG request: POST /host/188/task {"taskTypeID": 1} 2023-07-26T00:20:38.264 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T00:20:38.276 INFO:teuthology.orchestra.console:Power off smithi012 2023-07-26T00:20:38.277 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T00:20:38.305 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T00:20:38.307 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:20:38.331 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T00:20:38.377 INFO:teuthology.orchestra.console:Power off smithi083 2023-07-26T00:20:38.378 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T00:20:38.399 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T00:20:38.400 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:20:38.424 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T00:20:42.336 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:20:42.425 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:20:43.449 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T00:20:43.537 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T00:20:47.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:20:47.538 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:20:47.562 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T00:20:47.649 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T00:20:47.664 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2023-07-26T00:20:47.750 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-07-26T00:20:47.765 INFO:teuthology.orchestra.console:Power on smithi012 2023-07-26T00:20:47.766 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T00:20:47.851 INFO:teuthology.orchestra.console:Power on smithi083 2023-07-26T00:20:47.851 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T00:20:52.806 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T00:20:52.807 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:20:52.877 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T00:20:52.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:20:53.819 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T00:20:53.889 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T00:20:57.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:20:57.890 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:20:58.936 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T00:20:58.999 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T00:21:02.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:21:03.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:21:03.113 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T00:21:03.213 INFO:teuthology.orchestra.console:Power on for smithi083 completed 2023-07-26T00:21:03.314 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2023-07-26T00:21:03.315 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T00:21:08.321 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T00:21:12.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:21:13.006 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T00:21:13.107 INFO:teuthology.orchestra.console:Power on for smithi012 completed 2023-07-26T00:21:13.208 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2023-07-26T00:21:13.209 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-26T00:21:23.392 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T00:21:32.064 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-26T00:21:43.476 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T00:21:52.137 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-26T00:21:58.560 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T00:22:12.220 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-26T00:22:22.322 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-26T00:22:27.329 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-26T00:22:27.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T00:22:27.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T00:22:27.504 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-07-26T00:22:27.506 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T00:22:27.506 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T00:22:27.507 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:28.514 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:29.522 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:30.448 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-26T00:22:30.528 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:31.534 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:32.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:33.544 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:34.550 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:35.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:36.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T00:22:36.529 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: Authentication failed. 2023-07-26T00:22:36.530 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T00:22:36.530 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T00:22:36.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:36.562 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:37.538 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:37.569 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:38.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:38.577 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:39.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:39.586 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:40.563 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:40.594 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:41.572 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:41.604 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:42.581 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:42.613 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:43.591 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:43.626 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:44.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:44.634 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:45.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:45.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:46.647 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:46.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:47.654 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:47.655 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:48.661 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:48.661 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:49.668 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:49.668 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:50.675 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:50.675 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:51.681 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:51.682 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:52.689 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:52.690 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:53.697 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:53.698 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:54.705 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:54.705 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:55.712 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:55.713 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:56.720 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:56.720 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:57.728 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:57.728 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:58.736 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:58.737 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:59.744 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:22:59.745 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:00.752 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:00.752 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:01.760 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:01.760 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:02.768 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:02.768 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:03.775 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:03.776 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:04.783 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:04.784 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:05.791 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:05.792 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:06.800 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:06.801 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:07.808 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:07.809 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:08.818 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:08.818 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:09.827 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:09.828 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:10.836 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:10.836 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:11.844 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:11.844 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:12.852 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:12.853 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:13.861 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:13.862 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:14.870 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:14.871 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:15.879 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:15.879 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:16.886 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:16.887 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:17.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:17.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:18.903 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:18.904 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:19.911 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:19.911 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:20.919 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:20.919 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:21.927 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:21.928 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:22.935 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:22.936 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:23.943 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:23.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:24.951 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:24.951 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:25.958 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:25.958 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:26.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:26.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:27.973 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:27.973 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:28.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:28.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:29.988 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:29.989 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:30.996 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:30.997 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:32.004 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:32.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:33.012 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:33.013 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:34.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:34.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:35.028 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:35.029 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:36.037 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:36.037 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:37.044 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:37.045 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:38.052 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:38.052 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:39.059 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:39.059 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:40.066 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:40.067 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:41.074 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:41.074 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:42.082 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:42.083 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:43.090 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:43.090 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:44.097 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:44.098 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:45.104 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:45.105 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:46.112 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:46.112 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:47.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:47.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:48.126 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:48.128 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:49.135 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:49.136 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:50.143 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:50.144 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:51.150 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:51.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:52.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:52.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:53.167 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:53.168 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:54.174 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:54.175 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:55.182 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:55.183 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:56.190 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:56.191 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:57.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:57.199 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:58.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:58.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:59.216 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:23:59.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:00.225 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:00.225 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:01.233 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:01.233 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:02.241 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:02.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:03.249 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:03.250 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:04.258 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:04.258 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:05.265 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:05.266 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:06.273 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:06.274 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:07.281 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:07.282 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:08.290 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:08.291 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:09.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:09.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:10.307 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:10.308 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:11.316 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:11.316 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:12.324 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:12.325 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:13.333 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:13.334 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:14.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:14.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:15.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:15.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:16.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:16.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:17.365 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:17.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:18.373 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:18.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:19.381 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:19.382 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:20.390 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:20.391 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:21.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:21.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:22.406 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:22.406 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:23.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:23.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:24.421 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:24.422 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:25.430 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:25.430 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:26.437 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:26.438 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:27.394 ERROR:teuthology.provision.fog: on smithi012 2023-07-26T00:24:27.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:28.451 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:29.457 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:30.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:31.469 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:32.475 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:33.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:34.486 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:35.492 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:36.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-07-26T00:24:36.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T00:24:41.403 ERROR:teuthology.provision.fog: on smithi083 2023-07-26T00:24:41.517 ERROR:teuthology.orchestra.connection:Error authenticating with smithi012.front.sepia.ceph.com: Authentication failed. 2023-07-26T00:24:41.518 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-07-26T00:24:41.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:24:50.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-07-26T00:24:50.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T00:24:50.524 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: Authentication failed. 2023-07-26T00:24:50.524 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-07-26T00:24:50.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:26:59.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-07-26T00:26:59.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T00:27:04.534 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: Authentication failed. 2023-07-26T00:27:04.534 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-07-26T00:27:04.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:29:16.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-07-26T00:29:16.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T00:29:21.545 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: Authentication failed. 2023-07-26T00:29:21.546 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-07-26T00:29:21.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:31:24.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-07-26T00:31:24.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T00:31:24.553 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: Authentication failed. 2023-07-26T00:31:24.554 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-07-26T00:31:24.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T00:33:24.435 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-26T00:33:24.437 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi083 2023-07-26T00:33:24.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T00:33:24.438 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T00:33:29.528 INFO:teuthology.nuke:Checking targets against current locks 2023-07-26T00:33:33.139 DEBUG:teuthology.nuke:shortname: smithi012 2023-07-26T00:33:33.140 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T00:33:33.180 DEBUG:teuthology.nuke:shortname: smithi083 2023-07-26T00:33:33.181 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T00:33:33.183 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-25_14:29:32-rados-reef-release-distro-default-smithi/7351353', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 00:20:20.484604', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-07-26T00:33:33.210 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-25_14:29:32-rados-reef-release-distro-default-smithi/7351353', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 00:20:20.482335', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-26T00:33:33.236 INFO:teuthology.orchestra.console:Power off smithi012 2023-07-26T00:33:33.237 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T00:33:33.261 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T00:33:33.261 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:33:33.282 INFO:teuthology.orchestra.console:Power off smithi083 2023-07-26T00:33:33.284 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T00:33:33.302 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T00:33:33.314 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T00:33:33.314 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:33:33.336 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T00:33:37.304 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:33:37.338 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:33:38.414 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T00:33:38.451 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T00:33:42.415 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:33:42.452 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:33:43.526 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T00:33:43.563 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T00:33:47.528 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:33:47.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T00:33:47.640 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T00:33:47.742 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2023-07-26T00:33:52.851 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T00:33:56.371 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-07-26T00:33:56.414 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2023-07-26T00:33:56.532 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2023-07-26T00:34:01.766 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi083