2023-06-28T13:23:42.021 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a 2023-06-28T13:23:42.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T13:23:42.023 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T13:23:42.182 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f16703a58b0>, signals=[15]) 2023-06-28T13:23:42.183 INFO:teuthology.lock.ops:Start node 'smithi101.front.sepia.ceph.com' reimaging 2023-06-28T13:23:42.184 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T13:23:42.184 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-06-28T13:23:42.208 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2023-06-28T13:23:42.208 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T13:23:42.209 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-06-28T13:23:42.210 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /host {"name": "smithi101"} 2023-06-28T13:23:43.225 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"} 2023-06-28T13:23:43.342 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-28T13:23:43.345 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-28T13:23:43.386 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_centos_8.stream (ID 3) 2023-06-28T13:23:43.387 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 3} 2023-06-28T13:23:43.396 DEBUG:teuthology.provision.fog.smithi101:Requesting image smithi_centos_8.stream (ID 3) 2023-06-28T13:23:43.396 DEBUG:teuthology.provision.fog.smithi101:FOG request: PUT /host/206 {"imageID": 3} 2023-06-28T13:23:43.429 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of centos 8.stream 2023-06-28T13:23:43.429 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-28T13:23:43.435 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of centos 8.stream 2023-06-28T13:23:43.436 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-28T13:23:43.516 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T13:23:48.523 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T13:23:48.572 DEBUG:teuthology.provision.fog.smithi101:FOG request: POST /host/206/task {"taskTypeID": 1} 2023-06-28T13:23:53.604 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1} 2023-06-28T13:23:53.671 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-28T13:23:58.679 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-28T13:24:05.958 INFO:teuthology.orchestra.console:Power off smithi101 2023-06-28T13:24:05.959 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T13:24:05.973 INFO:teuthology.orchestra.console:Power off smithi104 2023-06-28T13:24:05.973 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T13:24:05.982 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:24:05.993 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:24:06.102 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-06-28T13:24:06.113 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2023-06-28T13:24:06.204 INFO:teuthology.orchestra.console:Power on smithi101 2023-06-28T13:24:06.204 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T13:24:06.214 INFO:teuthology.orchestra.console:Power on smithi104 2023-06-28T13:24:06.214 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T13:24:06.227 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:24:06.237 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:24:10.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:24:10.260 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:24:15.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:24:15.372 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:24:15.585 INFO:teuthology.orchestra.console:Power on for smithi104 completed 2023-06-28T13:24:15.686 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2023-06-28T13:24:15.687 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-28T13:24:25.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:24:30.805 INFO:teuthology.orchestra.console:Power on for smithi101 completed 2023-06-28T13:24:30.906 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2023-06-28T13:24:30.906 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-28T13:24:35.913 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-28T13:24:36.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:24:41.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:24:44.976 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-28T13:24:50.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:24:54.064 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-28T13:24:54.512 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-28T13:25:00.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:25:05.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:25:10.081 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-28T13:25:13.140 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-28T13:25:16.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:25:21.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:25:39.568 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-28T13:25:44.432 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-28T13:25:45.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:25:47.650 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-28T13:25:50.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:25:55.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T13:26:00.515 ERROR:teuthology.orchestra.connection:Error authenticating with smithi101.front.sepia.ceph.com: Authentication failed. 2023-06-28T13:26:00.517 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T13:26:00.518 DEBUG:teuthology.orchestra.run.smithi101:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T13:26:00.519 ERROR:teuthology.orchestra.connection:Error authenticating with smithi104.front.sepia.ceph.com: Authentication failed. 2023-06-28T13:26:00.519 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T13:26:00.520 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T13:26:00.520 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:00.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:01.526 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:01.527 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:02.532 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:02.533 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:03.538 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:03.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:04.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:04.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:05.551 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:05.552 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:06.557 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:06.558 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:07.564 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:07.565 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:08.571 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:08.571 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:09.577 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:09.578 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:10.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:10.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:11.590 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:11.590 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:12.596 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:12.596 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:13.603 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:13.603 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:14.609 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:14.609 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:15.616 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:15.617 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:16.622 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:16.622 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:17.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:17.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:18.638 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:18.639 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:19.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:19.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:20.654 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:20.655 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:21.667 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:21.668 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:22.674 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:22.674 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:23.681 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:23.682 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:24.687 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:24.687 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:25.700 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:25.701 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:26.706 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:26.706 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:27.714 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:27.715 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:28.721 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:28.721 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:29.733 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:29.734 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:30.739 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:30.740 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:31.745 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:31.746 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:32.751 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:32.751 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:33.761 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:33.761 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:34.767 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:34.767 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:35.772 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:35.773 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:36.778 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:36.778 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:37.783 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:37.784 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:38.789 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:38.790 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:39.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:39.796 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:40.800 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:40.801 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:41.806 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:41.807 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:42.812 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:42.813 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:43.817 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:43.818 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:44.823 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:44.824 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:45.829 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:45.830 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:46.835 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:46.836 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:47.841 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:47.842 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:48.847 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:48.848 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:49.854 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:49.854 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:50.864 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:50.864 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:51.870 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:51.870 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:52.875 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:52.876 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:53.882 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:53.882 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:54.887 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:54.888 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:55.893 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:55.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:56.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:56.900 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:57.905 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:57.905 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:58.911 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:58.912 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:59.917 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:26:59.918 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:00.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:00.924 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:01.929 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:01.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:02.935 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:02.936 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:03.940 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:03.941 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:04.945 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:04.946 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:05.950 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:05.950 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:06.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:06.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:07.962 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:07.962 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:08.968 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:08.968 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:09.974 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:09.975 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:10.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:10.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:11.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:11.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:12.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:12.993 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:13.998 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:13.998 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:15.003 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:15.004 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:16.009 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:16.009 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:17.014 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:17.015 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:18.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:18.021 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:19.026 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:19.026 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:20.032 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:20.032 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:21.038 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:21.039 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:22.044 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:22.045 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:23.050 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:23.051 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:24.057 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:24.057 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:25.063 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:25.064 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:26.069 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:26.070 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:27.075 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:27.075 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:28.080 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:28.081 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:29.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:29.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:30.091 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:30.092 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:31.097 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:31.097 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:32.103 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:32.103 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:33.108 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:33.109 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:34.114 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:34.114 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:35.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:35.121 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:36.126 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:36.126 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:37.131 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:37.131 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:38.136 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:38.137 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:39.142 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:39.143 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:40.148 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:40.148 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:41.153 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:41.154 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:42.158 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:42.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:43.165 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:43.166 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:44.171 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:44.172 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:45.178 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:45.178 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:46.184 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:46.185 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:47.190 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:47.190 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:48.196 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:48.197 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:49.203 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:49.203 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:50.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:50.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:51.215 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:51.216 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:52.221 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:52.222 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:53.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:53.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:54.233 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:54.233 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:55.239 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:55.239 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:55.447 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError 2023-06-28T13:27:55.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T13:27:55.449 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T13:27:58.505 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:27:58.631 INFO:teuthology.nuke:Checking targets against current locks 2023-06-28T13:27:58.696 DEBUG:teuthology.nuke:shortname: smithi101 2023-06-28T13:27:58.697 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T13:27:58.719 DEBUG:teuthology.nuke:shortname: smithi104 2023-06-28T13:27:58.720 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T13:27:58.723 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi101.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2023-06-28_13:00:34-rgw:verify-wip-rgw-yield-work-distro-default-smithi/7320098', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 13:23:36.208750', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-28T13:27:58.742 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2023-06-28_13:00:34-rgw:verify-wip-rgw-yield-work-distro-default-smithi/7320098', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 13:23:36.207346', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM0nr0LS2ZRrAjSkEGNnRSAzJD3YzLEFhNsHFteIO7NWBQz2WoZxI7cic1SAvnZXSepkM25k3RQlt8PcAkjjxbw='} 2023-06-28T13:27:58.772 INFO:teuthology.orchestra.console:Power off smithi101 2023-06-28T13:27:58.772 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T13:27:58.793 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:27:58.811 INFO:teuthology.orchestra.console:Power off smithi104 2023-06-28T13:27:58.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T13:27:58.836 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:27:59.527 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T13:28:02.827 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:02.862 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:07.938 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:07.973 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:13.051 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:13.084 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:18.163 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:18.194 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:23.275 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:23.304 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:28.386 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:28.414 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:33.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:33.524 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:38.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:38.633 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T13:28:38.818 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-06-28T13:28:48.961 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2023-06-28T13:28:48.984 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com 2023-06-28T13:28:54.001 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com 2023-06-28T13:28:54.258 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError