2023-07-15T07:36:32.845 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-15T07:36:32.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T07:36:32.847 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T07:36:52.731 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fce481658b0>, signals=[15]) 2023-07-15T07:36:52.733 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2023-07-15T07:36:52.733 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T07:36:52.734 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-07-15T07:36:52.758 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-07-15T07:36:52.758 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T07:36:52.758 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-07-15T07:36:52.760 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /host {"name": "smithi090"} 2023-07-15T07:37:02.798 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-07-15T07:37:12.807 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-15T07:37:22.845 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-15T07:37:27.850 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_8.stream (ID 3) 2023-07-15T07:37:27.850 DEBUG:teuthology.provision.fog.smithi090:FOG request: PUT /host/195 {"imageID": 3} 2023-07-15T07:37:32.902 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_8.stream (ID 3) 2023-07-15T07:37:32.903 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 3} 2023-07-15T07:37:37.910 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 8.stream 2023-07-15T07:37:37.910 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-15T07:37:42.956 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 8.stream 2023-07-15T07:37:42.957 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-15T07:37:47.963 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T07:37:53.013 DEBUG:teuthology.provision.fog.smithi090:FOG request: POST /host/195/task {"taskTypeID": 1} 2023-07-15T07:37:53.174 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T07:37:53.300 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-15T07:37:58.304 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-07-15T07:38:03.375 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-15T07:38:18.336 INFO:teuthology.orchestra.console:Power off smithi090 2023-07-15T07:38:18.338 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:38:18.363 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:18.384 INFO:teuthology.orchestra.console:Power off smithi123 2023-07-15T07:38:18.385 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:38:18.499 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-07-15T07:38:18.600 INFO:teuthology.orchestra.console:Power on smithi090 2023-07-15T07:38:18.601 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T07:38:23.627 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:27.653 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:28.415 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:28.538 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-07-15T07:38:28.639 INFO:teuthology.orchestra.console:Power on smithi123 2023-07-15T07:38:28.639 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T07:38:28.663 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:32.685 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:32.765 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:37.799 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:37.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:42.912 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:42.988 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:48.024 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:48.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:53.137 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:53.213 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:58.250 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:58.326 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:38:58.463 INFO:teuthology.orchestra.console:Power on for smithi123 completed 2023-07-15T07:38:58.564 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-07-15T07:38:58.565 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-15T07:39:03.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:39:08.676 INFO:teuthology.orchestra.console:Power on for smithi090 completed 2023-07-15T07:39:08.777 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2023-07-15T07:39:08.778 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-15T07:39:11.922 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-15T07:39:12.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:39:15.120 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-15T07:39:17.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:39:21.012 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-15T07:39:21.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:39:24.176 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-15T07:39:27.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:39:30.101 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-15T07:39:30.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:39:33.232 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-15T07:39:36.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:39:39.188 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-15T07:39:39.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:39:45.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:39:50.197 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-15T07:39:56.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:40:04.272 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-15T07:40:08.688 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-15T07:40:10.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:40:13.328 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-15T07:40:14.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:40:19.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:40:24.774 ERROR:teuthology.orchestra.connection:Error authenticating with smithi123.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:40:24.776 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T07:40:24.776 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T07:40:24.777 ERROR:teuthology.orchestra.connection:Error authenticating with smithi090.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:40:24.777 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T07:40:24.778 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T07:40:24.778 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:24.779 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:25.787 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:25.787 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:26.794 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:26.794 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:27.801 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:27.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:28.809 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:28.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:29.818 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:29.818 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:30.825 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:30.826 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:31.833 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:31.834 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:32.840 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:32.841 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:33.846 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:33.847 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:34.853 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:34.853 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:35.860 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:35.861 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:36.868 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:36.868 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:37.875 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:37.875 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:38.882 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:38.882 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:39.889 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:39.889 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:40.896 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:40.896 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:41.903 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:41.903 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:42.910 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:42.911 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:43.918 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:43.918 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:44.924 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:44.924 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:45.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:45.931 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:46.936 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:46.937 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:47.942 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:47.943 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:48.948 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:48.949 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:49.955 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:49.955 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:50.961 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:50.962 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:51.968 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:51.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:52.975 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:52.975 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:53.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:53.982 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:54.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:54.988 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:55.993 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:55.994 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:57.000 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:57.008 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:58.007 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:58.016 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:59.016 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:59.025 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:00.023 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:00.032 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:01.031 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:01.039 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:02.040 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:02.049 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:03.047 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:03.056 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:04.055 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:04.064 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:05.062 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:05.071 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:06.070 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:06.079 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:07.078 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:07.087 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:08.085 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:08.094 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:09.092 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:09.101 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:10.101 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:10.110 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:11.108 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:11.117 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:12.116 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:12.125 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:13.124 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:13.133 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:14.131 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:14.140 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:15.139 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:15.148 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:16.147 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:16.156 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:17.155 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:17.164 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:18.162 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:18.171 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:19.170 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:19.179 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:20.178 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:20.193 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:21.186 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:21.200 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:22.195 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:22.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:23.202 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:23.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:24.211 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:24.225 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:25.221 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:25.234 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:26.228 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:26.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:27.238 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:27.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:28.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:28.258 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:29.255 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:29.266 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:30.263 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:30.273 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:31.270 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:31.281 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:32.278 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:32.288 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:33.285 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:33.295 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:34.292 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:34.304 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:35.300 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:35.312 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:36.308 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:36.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:37.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:37.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:38.323 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:38.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:39.331 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:39.344 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:40.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:40.352 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:41.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:41.361 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:42.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:42.371 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:43.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:43.379 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:44.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:44.387 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:45.383 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:45.394 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:46.391 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:46.403 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:47.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:47.412 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:48.408 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:48.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:49.416 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:49.431 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:50.425 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:50.439 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:51.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:51.448 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:52.441 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:52.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:53.449 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:53.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:54.456 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:54.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:55.464 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:55.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:56.473 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:56.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:57.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:57.497 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:58.490 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:58.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:59.500 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:41:59.556 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:00.508 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:00.564 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:01.517 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:01.574 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:02.526 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:02.583 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:03.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:03.590 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:04.545 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:04.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:05.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:05.607 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:06.562 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:06.616 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:07.570 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:07.624 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:08.577 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:08.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:09.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:09.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:10.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:10.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:11.601 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:11.656 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:12.609 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:12.667 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:13.618 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:13.676 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:14.626 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:14.684 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:15.633 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:15.692 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:16.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:16.701 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:17.650 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:17.709 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:18.657 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:18.716 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:19.665 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:19.702 ERROR:teuthology.provision.fog: on smithi123 2023-07-15T07:42:19.724 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:20.730 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:21.736 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:22.741 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:23.747 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:24.708 ERROR:teuthology.provision.fog: on smithi090 2023-07-15T07:42:28.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-15T07:42:28.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:42:28.821 ERROR:teuthology.orchestra.connection:Error authenticating with smithi123.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:42:28.822 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-07-15T07:42:28.823 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:42:33.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-15T07:42:33.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:42:38.826 ERROR:teuthology.orchestra.connection:Error authenticating with smithi090.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:42:38.826 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-07-15T07:42:38.827 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:44:37.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-15T07:44:37.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:44:42.835 ERROR:teuthology.orchestra.connection:Error authenticating with smithi123.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:44:42.835 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-07-15T07:44:42.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:44:51.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-15T07:44:51.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:44:51.791 ERROR:teuthology.orchestra.connection:Error authenticating with smithi090.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:44:51.792 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-07-15T07:44:51.793 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:46:54.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-15T07:46:54.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:46:59.851 ERROR:teuthology.orchestra.connection:Error authenticating with smithi123.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:46:59.852 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-07-15T07:46:59.853 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:47:03.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-15T07:47:03.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:47:03.842 ERROR:teuthology.orchestra.connection:Error authenticating with smithi090.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:47:03.842 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-07-15T07:47:03.843 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:49:02.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-15T07:49:02.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:49:07.819 ERROR:teuthology.orchestra.connection:Error authenticating with smithi123.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:49:07.819 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-07-15T07:49:07.820 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:49:10.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-15T07:49:10.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:49:10.857 ERROR:teuthology.orchestra.connection:Error authenticating with smithi090.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:49:10.858 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-07-15T07:49:10.859 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:51:07.749 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-15T07:51:07.753 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123 2023-07-15T07:51:07.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T07:51:07.756 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T07:51:08.071 INFO:teuthology.nuke:Checking targets against current locks 2023-07-15T07:51:08.128 DEBUG:teuthology.nuke:shortname: smithi090 2023-07-15T07:51:08.129 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T07:51:08.141 DEBUG:teuthology.nuke:shortname: smithi123 2023-07-15T07:51:08.143 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T07:51:08.152 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:39:06-rados-wip-yuri5-testing-2023-07-14-0757-distro-default-smithi/7338770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 07:36:31.987168', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOq07FPDreLU82/epMRVux8ruNWaFCrhU9hZCxMmOv2UsNTqOIEUQTqEi2mSy7OmY0HoIM2/5mMYJ1Gi3rpeQyw='} 2023-07-15T07:51:08.167 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:39:06-rados-wip-yuri5-testing-2023-07-14-0757-distro-default-smithi/7338770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 07:36:31.989132', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-15T07:51:08.204 INFO:teuthology.orchestra.console:Power off smithi090 2023-07-15T07:51:08.205 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:51:08.220 INFO:teuthology.orchestra.console:Power off smithi123 2023-07-15T07:51:08.221 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:51:08.231 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:08.243 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:10.754 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-15T07:51:12.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:12.266 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:16.371 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:16.380 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:21.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:21.494 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:26.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:26.605 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:26.808 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-07-15T07:51:33.637 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:33.666 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com 2023-07-15T07:51:38.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:43.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:48.976 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:54.088 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:51:54.300 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-07-15T07:51:54.454 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com 2023-07-15T07:51:54.683 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi123