2023-09-14T01:27:15.310 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-14T01:27:15.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-14T01:27:15.490 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd4a27eaa60>, signals=[15]) 2023-09-14T01:27:15.491 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-09-14T01:27:15.492 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-09-14T01:27:15.492 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-09-14T01:27:15.519 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2023-09-14T01:27:15.520 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2023-09-14T01:27:15.520 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-09-14T01:27:15.521 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"} 2023-09-14T01:27:15.544 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-09-14T01:27:15.546 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-09-14T01:27:15.546 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-09-14T01:27:15.547 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /host {"name": "smithi115"} 2023-09-14T01:27:15.570 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"} 2023-09-14T01:27:15.618 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-14T01:27:15.630 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-14T01:27:15.663 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-14T01:27:15.663 DEBUG:teuthology.provision.fog.smithi115:FOG request: PUT /host/220 {"imageID": 5} 2023-09-14T01:27:15.673 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-14T01:27:15.674 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 5} 2023-09-14T01:27:15.691 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-14T01:27:15.711 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of rhel 8.6 2023-09-14T01:27:15.712 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:27:15.724 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6 2023-09-14T01:27:15.725 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:27:15.730 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-14T01:27:15.730 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 5} 2023-09-14T01:27:15.761 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /tasktype {"name": "deploy"} 2023-09-14T01:27:15.764 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"} 2023-09-14T01:27:15.773 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.6 2023-09-14T01:27:15.773 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-14T01:27:15.794 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1} 2023-09-14T01:27:15.798 DEBUG:teuthology.provision.fog.smithi115:FOG request: POST /host/220/task {"taskTypeID": 1} 2023-09-14T01:27:15.827 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"} 2023-09-14T01:27:15.863 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:27:15.867 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1} 2023-09-14T01:27:15.868 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:27:15.924 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-14T01:27:15.957 INFO:teuthology.orchestra.console.smithi190:Power off 2023-09-14T01:27:15.958 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-14T01:27:15.970 INFO:teuthology.orchestra.console.smithi115:Power off 2023-09-14T01:27:15.971 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-14T01:27:15.981 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-09-14T01:27:15.982 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:15.994 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-09-14T01:27:15.995 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:16.004 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-09-14T01:27:16.021 INFO:teuthology.orchestra.console.smithi033:Power off 2023-09-14T01:27:16.021 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-14T01:27:16.032 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-09-14T01:27:16.046 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-09-14T01:27:16.047 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:16.073 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-09-14T01:27:20.010 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:20.033 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:20.075 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:20.119 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-09-14T01:27:20.146 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-09-14T01:27:20.184 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-09-14T01:27:24.123 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:24.148 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:24.186 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:24.233 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-09-14T01:27:24.256 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-09-14T01:27:24.297 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-09-14T01:27:24.334 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-09-14T01:27:24.435 INFO:teuthology.orchestra.console.smithi190:Power on 2023-09-14T01:27:24.436 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-14T01:27:24.459 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2023-09-14T01:27:24.461 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:24.487 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-09-14T01:27:28.258 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:28.298 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:28.367 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-09-14T01:27:28.408 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-09-14T01:27:28.468 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-09-14T01:27:28.489 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:28.509 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-09-14T01:27:28.570 INFO:teuthology.orchestra.console.smithi115:Power on 2023-09-14T01:27:28.570 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-14T01:27:28.591 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2023-09-14T01:27:28.592 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:28.600 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-09-14T01:27:28.610 INFO:teuthology.orchestra.console.smithi033:Power on 2023-09-14T01:27:28.610 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-14T01:27:28.618 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-09-14T01:27:28.632 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2023-09-14T01:27:28.633 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:28.655 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-09-14T01:27:32.602 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:32.620 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:32.656 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:27:32.711 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-09-14T01:27:32.728 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-09-14T01:27:32.765 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-09-14T01:27:32.813 INFO:teuthology.orchestra.console.smithi190:Power on completed 2023-09-14T01:27:32.829 INFO:teuthology.orchestra.console.smithi115:Power on completed 2023-09-14T01:27:32.866 INFO:teuthology.orchestra.console.smithi033:Power on completed 2023-09-14T01:27:32.914 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-09-14T01:27:32.914 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:27:32.930 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2023-09-14T01:27:32.931 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:27:32.967 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-09-14T01:27:32.967 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-14T01:27:47.998 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:27:48.000 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:27:48.021 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-14T01:28:03.092 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-14T01:28:03.093 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:28:03.097 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:28:18.170 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:28:18.172 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-14T01:28:18.180 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:28:33.246 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:28:33.248 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-14T01:28:33.249 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:28:48.336 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-14T01:28:48.337 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:28:48.338 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:29:03.418 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-14T01:29:03.420 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:29:03.421 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:29:03.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:29:06.586 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-09-14T01:29:12.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:29:15.642 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-09-14T01:29:18.486 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:29:18.503 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:29:21.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:29:24.698 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-09-14T01:29:30.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:29:33.589 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:29:33.595 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:29:33.786 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-09-14T01:29:39.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:29:42.842 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-09-14T01:29:48.666 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:29:48.670 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:29:48.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:29:51.898 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-09-14T01:29:57.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:30:03.745 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:30:03.749 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:30:16.350 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-09-14T01:30:18.829 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-09-14T01:30:18.831 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-09-14T01:30:18.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:30:18.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:30:22.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:30:24.824 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-09-14T01:30:30.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:30:30.951 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: Authentication failed. 2023-09-14T01:30:30.952 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-14T01:30:30.953 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-14T01:30:30.954 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:31.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:32.966 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:33.972 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:34.978 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:35.984 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:36.989 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:37.338 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-09-14T01:30:37.338 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-09-14T01:30:37.997 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:39.003 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:40.008 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:41.014 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:42.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:43.025 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:43.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:30:43.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:30:44.032 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:45.038 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:46.044 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:46.394 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-09-14T01:30:46.394 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-09-14T01:30:47.050 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:48.056 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:49.062 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:50.068 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:51.074 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:52.079 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:52.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:30:52.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:30:53.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:54.093 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:55.099 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:55.454 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-09-14T01:30:55.455 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-09-14T01:30:56.105 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:57.111 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:58.117 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:30:59.123 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:00.131 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:01.139 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:01.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:31:01.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:31:02.145 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:03.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:04.157 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:04.538 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-09-14T01:31:04.539 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-09-14T01:31:05.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:06.170 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:07.177 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:08.183 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:09.189 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:10.194 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:10.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:31:10.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:31:11.200 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:12.206 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:13.212 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:13.598 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-09-14T01:31:14.218 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:15.223 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:16.230 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:17.235 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:18.241 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:19.247 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:19.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:31:20.254 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:21.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:22.266 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:22.654 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-09-14T01:31:23.271 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:24.276 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:25.282 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:26.287 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:27.293 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:28.301 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:28.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:31:29.306 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:30.312 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:31.319 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:32.325 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:33.331 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:34.337 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:35.344 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:36.350 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:37.356 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:38.361 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:39.367 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:40.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:41.380 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:42.386 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:43.392 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:44.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:45.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:46.410 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:47.417 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:48.423 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:49.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:50.435 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:51.441 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:52.447 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:53.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:54.461 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:55.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:56.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:57.478 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:58.486 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:31:59.492 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:00.356 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-14T01:32:00.356 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-14T01:32:00.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:00.608 INFO:teuthology.provision.fog.smithi115:Node is ready 2023-09-14T01:32:00.608 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2023-09-14T01:32:00.625 INFO:teuthology.orchestra.run.smithi115.stdout:smithi022 2023-09-14T01:32:00.625 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi022 /etc/hosts 2023-09-14T01:32:00.682 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-09-14T01:32:00.682 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-09-14T01:32:00.814 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi022/smithi115/g' /etc/hosts 2023-09-14T01:32:00.841 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.22/172.21.15.115/g' /etc/hosts 2023-09-14T01:32:00.907 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi022/smithi115/g' /etc/hostname 2023-09-14T01:32:00.973 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-09-14T01:32:01.040 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-09-14T01:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux" 2023-09-14T01:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.6 (Ootpa)" 2023-09-14T01:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel" 2023-09-14T01:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora" 2023-09-14T01:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.6" 2023-09-14T01:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2023-09-14T01:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-14T01:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-09-14T01:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-14T01:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/" 2023-09-14T01:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-14T01:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-14T01:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-09-14T01:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-14T01:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-14T01:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-14T01:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-14T01:32:01.100 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2023-09-14T01:32:01.102 DEBUG:teuthology.parallel:result is None 2023-09-14T01:32:01.505 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:02.511 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:03.515 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:04.520 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:05.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:06.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:07.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:08.541 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:09.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:10.542 WARNING:teuthology.provision.fog.smithi190:timed out 2023-09-14T01:32:10.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:11.558 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:12.564 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:13.569 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:14.574 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:15.579 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:16.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:32:16.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:16.885 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-14T01:32:16.885 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-14T01:32:17.179 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-09-14T01:32:17.179 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-09-14T01:32:17.197 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190 2023-09-14T01:32:17.197 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190 /etc/hosts 2023-09-14T01:32:17.254 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-09-14T01:32:17.255 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-09-14T01:32:17.363 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190/smithi190/g' /etc/hosts 2023-09-14T01:32:17.390 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-09-14T01:32:17.457 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190/smithi190/g' /etc/hostname 2023-09-14T01:32:17.523 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-09-14T01:32:17.589 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-09-14T01:32:17.591 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:17.645 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-09-14T01:32:17.645 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-09-14T01:32:17.645 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-09-14T01:32:17.645 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-09-14T01:32:17.646 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-09-14T01:32:17.646 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-09-14T01:32:17.646 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-14T01:32:17.646 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-09-14T01:32:17.646 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-14T01:32:17.647 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-09-14T01:32:17.647 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-14T01:32:17.647 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-14T01:32:17.647 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-14T01:32:17.647 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-14T01:32:17.648 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-14T01:32:17.648 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-14T01:32:17.648 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-14T01:32:17.648 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-09-14T01:32:17.649 DEBUG:teuthology.parallel:result is None 2023-09-14T01:32:18.596 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:19.602 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:20.608 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:21.613 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:22.619 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:23.624 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:24.629 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:25.635 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:32:26.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-14T01:34:14.938 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-09-14T01:34:14.940 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi033 2023-09-14T01:34:23.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-09-14T01:34:23.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T01:34:24.158 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-09-14T01:34:24.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-09-14T01:34:24.681 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-14T01:34:24.681 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-14T01:34:24.686 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-09-14T01:34:24.687 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-09-14T01:34:24.693 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-09-14T01:34:24.694 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-09-14T01:34:24.741 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-09-14T01:34:24.741 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-09-14T01:34:24.833 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-09-14T01:34:24.847 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-09-14T01:34:24.860 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-09-14T01:34:24.917 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-09-14T01:34:24.928 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-09-14T01:34:24.935 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2023-09-14T01:34:24.935 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-09-14T01:34:24.935 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2023-09-14T01:34:24.936 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2023-09-14T01:34:24.936 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-09-14T01:34:24.936 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="20.04" 2023-09-14T01:34:24.936 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-14T01:34:24.936 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-14T01:34:24.937 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-14T01:34:24.937 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-14T01:34:24.937 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=focal 2023-09-14T01:34:24.937 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=focal 2023-09-14T01:34:24.941 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi033's OS to be rhel 8.6 but found ubuntu 20.04 2023-09-14T01:34:24.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-14T01:34:25.073 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=712aae943dcb4b83a10aa708f6ef140c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi033's OS to be rhel 8.6 but found ubuntu 20.04 2023-09-14T01:34:25.075 INFO:teuthology.nuke:Checking targets against current locks 2023-09-14T01:34:25.119 INFO:teuthology.nuke:Not nuking smithi033.front.sepia.ceph.com because description doesn't match: rfriedma-2023-09-13_18:55:11-rados-wip-rf-fshut-distro-default-smithi != /home/teuthworker/archive/teuthology-2023-09-14_01:25:02-upgrade-clients:client-upgrade-pacific-reef-reef-distro-default-smithi/7396683 2023-09-14T01:34:25.168 DEBUG:teuthology.nuke:shortname: smithi115 2023-09-14T01:34:25.169 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-14T01:34:25.181 DEBUG:teuthology.nuke:shortname: smithi190 2023-09-14T01:34:25.181 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-14T01:34:25.192 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-13_18:55:11-rados-wip-rf-fshut-distro-default-smithi/7396505', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-14 01:27:14.469499', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-09-14T01:34:25.202 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-13_18:55:11-rados-wip-rf-fshut-distro-default-smithi/7396505', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-14 01:27:14.466690', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-09-14T01:34:25.237 INFO:teuthology.orchestra.console.smithi115:Power off 2023-09-14T01:34:25.238 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-14T01:34:25.251 INFO:teuthology.orchestra.console.smithi190:Power off 2023-09-14T01:34:25.252 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-14T01:34:25.260 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-09-14T01:34:25.261 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:34:25.273 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-09-14T01:34:25.274 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:34:25.285 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-09-14T01:34:25.298 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-09-14T01:34:29.287 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:34:29.299 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:34:29.397 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-09-14T01:34:29.408 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-09-14T01:34:33.399 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:34:33.409 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T01:34:33.509 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-09-14T01:34:33.519 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-09-14T01:34:33.610 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-09-14T01:34:33.620 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-09-14T01:34:33.767 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2023-09-14T01:34:33.775 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com 2023-09-14T01:34:33.776 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= 2023-09-14T01:34:34.152 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi033's OS to be rhel 8.6 but found ubuntu 20.04