2023-09-08T14:23:17.927 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-08T14:23:17.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T14:23:18.083 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1b5fe4de50>, signals=[15]) 2023-09-08T14:23:18.085 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging 2023-09-08T14:23:18.085 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server 2023-09-08T14:23:18.085 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-09-08T14:23:18.101 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-09-08T14:23:18.102 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-09-08T14:23:18.102 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-09-08T14:23:18.104 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /host {"name": "smithi094"} 2023-09-08T14:23:18.126 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"} 2023-09-08T14:23:18.170 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-09-08T14:23:18.189 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-09-08T14:23:18.207 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-09-08T14:23:18.208 DEBUG:teuthology.provision.fog.smithi094:FOG request: PUT /host/199 {"imageID": 2} 2023-09-08T14:23:18.231 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-09-08T14:23:18.232 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 2} 2023-09-08T14:23:18.249 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of ubuntu 20.04 2023-09-08T14:23:18.249 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:23:18.280 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of ubuntu 20.04 2023-09-08T14:23:18.280 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-08T14:23:18.355 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /tasktype {"name": "deploy"} 2023-09-08T14:23:18.375 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"} 2023-09-08T14:23:18.392 DEBUG:teuthology.provision.fog.smithi094:FOG request: POST /host/199/task {"taskTypeID": 1} 2023-09-08T14:23:18.415 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1} 2023-09-08T14:23:18.458 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:23:18.462 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-08T14:23:18.591 INFO:teuthology.orchestra.console.smithi167:Power off 2023-09-08T14:23:18.592 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T14:23:18.604 INFO:teuthology.orchestra.console.smithi094:Power off 2023-09-08T14:23:18.605 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T14:23:18.612 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-09-08T14:23:18.612 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T14:23:18.624 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-09-08T14:23:18.624 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T14:23:18.633 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-09-08T14:23:18.645 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-09-08T14:23:22.638 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T14:23:22.646 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T14:23:22.747 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-09-08T14:23:22.755 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-09-08T14:23:26.750 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T14:23:26.756 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T14:23:26.858 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-09-08T14:23:26.866 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-09-08T14:23:30.864 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T14:23:30.870 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T14:23:30.972 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-09-08T14:23:30.977 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-09-08T14:23:31.074 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-09-08T14:23:31.079 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-09-08T14:23:31.175 INFO:teuthology.orchestra.console.smithi167:Power on 2023-09-08T14:23:31.176 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-08T14:23:31.182 INFO:teuthology.orchestra.console.smithi094:Power on 2023-09-08T14:23:31.182 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-08T14:23:31.196 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2023-09-08T14:23:31.196 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T14:23:31.203 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On 2023-09-08T14:23:31.203 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T14:23:31.216 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-09-08T14:23:31.222 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-09-08T14:23:35.222 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T14:23:35.228 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T14:23:35.331 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-09-08T14:23:35.338 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-09-08T14:23:35.432 INFO:teuthology.orchestra.console.smithi167:Power on completed 2023-09-08T14:23:35.533 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-09-08T14:23:35.534 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-08T14:23:35.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:23:39.341 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T14:23:39.450 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-09-08T14:23:39.551 INFO:teuthology.orchestra.console.smithi094:Power on completed 2023-09-08T14:23:39.652 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish 2023-09-08T14:23:39.652 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:23:54.266 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-08T14:23:54.837 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:24:00.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:24:03.322 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-08T14:24:09.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:24:10.020 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:24:12.410 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-08T14:24:18.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:24:21.498 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-08T14:24:25.234 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:24:27.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:24:30.554 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-08T14:24:36.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:24:39.642 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-08T14:24:40.454 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:24:45.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:24:55.663 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:25:04.154 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-08T14:25:10.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:25:10.856 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:25:13.242 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-08T14:25:19.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:25:19.371 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: Authentication failed. 2023-09-08T14:25:19.372 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-08T14:25:19.373 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-08T14:25:19.373 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:20.449 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:21.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:22.460 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:23.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:24.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:25.478 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:26.116 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:25:26.484 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:27.490 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:28.495 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:29.503 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:30.508 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:31.514 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:32.520 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:33.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:34.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:35.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:36.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:37.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:38.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:39.564 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:40.571 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:41.398 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:25:41.578 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:42.583 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:43.588 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:44.600 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:45.608 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:46.613 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:47.619 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:48.624 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:49.630 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:50.636 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:51.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:52.646 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:53.652 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:54.657 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:55.662 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:56.668 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:57.210 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:25:57.674 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:58.680 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:25:59.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:00.689 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:01.694 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:02.699 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:03.703 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:04.708 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:05.713 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:06.718 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:07.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:08.727 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:09.733 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:10.738 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:11.743 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:12.748 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:12.951 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:26:13.752 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:14.758 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:15.762 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:16.768 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:17.774 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:18.779 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:19.784 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:20.789 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:21.794 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:22.799 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:23.804 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:24.809 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:25.814 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:26.820 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:27.825 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:28.637 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:26:28.830 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:29.836 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:30.841 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:31.846 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:32.852 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:33.857 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:34.863 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:35.868 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:36.873 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:37.879 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:38.884 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:39.890 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:40.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:41.901 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:42.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:43.910 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:44.240 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:26:44.916 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:45.920 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:46.925 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:47.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:48.936 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:49.942 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:50.949 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:51.955 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:52.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:53.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:54.971 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:55.976 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:56.982 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:57.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:58.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:26:59.771 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:26:59.997 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:01.004 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:02.009 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:03.015 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:04.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:05.026 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:06.031 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:07.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:08.041 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:09.046 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:10.051 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:11.056 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:12.061 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:13.066 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:14.071 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:15.076 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:15.372 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:27:16.082 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:17.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:18.090 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:19.096 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:19.255 ERROR:teuthology.provision.fog: on smithi167 2023-09-08T14:27:28.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-09-08T14:27:28.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:27:28.338 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: Authentication failed. 2023-09-08T14:27:28.339 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-09-08T14:27:28.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-08T14:27:30.699 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:27:45.989 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:28:01.216 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:28:16.436 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:28:31.669 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:28:46.877 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:29:02.059 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:29:17.227 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:29:32.400 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:29:47.565 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:30:02.718 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-09-08T14:30:02.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:30:05.946 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-09-08T14:30:11.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:30:15.006 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-09-08T14:30:21.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:30:24.058 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-09-08T14:30:30.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:30:33.114 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-09-08T14:30:39.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:30:42.170 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-09-08T14:30:48.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:30:51.230 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-09-08T14:30:57.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:31:15.610 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-09-08T14:31:21.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:31:24.666 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-09-08T14:31:30.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T14:31:32.373 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-08T14:31:32.374 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-08T14:31:53.186 INFO:teuthology.provision.fog.smithi094:Node is ready 2023-09-08T14:31:53.186 DEBUG:teuthology.orchestra.run.smithi094:> hostname 2023-09-08T14:31:53.193 INFO:teuthology.orchestra.run.smithi094.stdout:smithi129 2023-09-08T14:31:53.193 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi129 /etc/hosts 2023-09-08T14:31:53.200 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.129 smithi129 smithi129 2023-09-08T14:31:53.200 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-09-08T14:31:53.274 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi129/smithi094/g' /etc/hosts 2023-09-08T14:31:53.292 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.129/172.21.15.94/g' /etc/hosts 2023-09-08T14:31:53.304 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi129/smithi094/g' /etc/hostname 2023-09-08T14:31:53.364 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-09-08T14:31:53.375 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-09-08T14:31:53.381 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Ubuntu" 2023-09-08T14:31:53.381 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-09-08T14:31:53.381 INFO:teuthology.orchestra.run.smithi094.stdout:ID=ubuntu 2023-09-08T14:31:53.382 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE=debian 2023-09-08T14:31:53.382 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-09-08T14:31:53.382 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="20.04" 2023-09-08T14:31:53.382 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-08T14:31:53.383 INFO:teuthology.orchestra.run.smithi094.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-08T14:31:53.383 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-08T14:31:53.383 INFO:teuthology.orchestra.run.smithi094.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-08T14:31:53.383 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_CODENAME=focal 2023-09-08T14:31:53.383 INFO:teuthology.orchestra.run.smithi094.stdout:UBUNTU_CODENAME=focal 2023-09-08T14:31:53.384 INFO:teuthology.provision.fog.smithi094:Deploy complete! 2023-09-08T14:31:53.385 DEBUG:teuthology.parallel:result is None 2023-09-08T15:27:37.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-09-08T15:27:37.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T15:27:37.531 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-09-08T15:27:37.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-09-08T15:27:37.613 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-08T15:27:37.613 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-08T15:27:37.667 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-09-08T15:27:37.667 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2023-09-08T15:27:37.732 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167 2023-09-08T15:27:37.732 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167 /etc/hosts 2023-09-08T15:27:37.788 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-09-08T15:27:37.788 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-09-08T15:27:37.856 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167/smithi167/g' /etc/hosts 2023-09-08T15:27:37.954 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2023-09-08T15:27:37.980 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167/smithi167/g' /etc/hostname 2023-09-08T15:27:38.064 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-09-08T15:27:38.129 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-09-08T15:27:38.205 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2023-09-08T15:27:38.206 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.4 (Ootpa)" 2023-09-08T15:27:38.206 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2023-09-08T15:27:38.206 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2023-09-08T15:27:38.206 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.4" 2023-09-08T15:27:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-09-08T15:27:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-08T15:27:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-09-08T15:27:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-08T15:27:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2023-09-08T15:27:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-08T15:27:38.208 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-08T15:27:38.208 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-09-08T15:27:38.208 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-08T15:27:38.208 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-08T15:27:38.208 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-08T15:27:38.209 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-08T15:27:38.210 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi167's OS to be ubuntu 20.04 but found rhel 8.4 2023-09-08T15:27:38.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T15:27:38.337 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3905577e8dbb48b7821c1f1fb8fabb08 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi167's OS to be ubuntu 20.04 but found rhel 8.4 2023-09-08T15:27:38.340 INFO:teuthology.nuke:Checking targets against current locks 2023-09-08T15:27:38.410 DEBUG:teuthology.nuke:shortname: smithi094 2023-09-08T15:27:38.410 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-08T15:27:38.414 INFO:teuthology.nuke:Not nuking smithi167.front.sepia.ceph.com because description doesn't match: teuthology-2023-09-08_14:22:14-upgrade:octopus-x-quincy-distro-default-smithi != /home/teuthworker/archive/teuthology-2023-09-08_14:23:02-upgrade:pacific-x-quincy-distro-default-smithi/7391081 2023-09-08T15:27:38.434 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-08_14:22:14-upgrade:octopus-x-quincy-distro-default-smithi/7391080', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-08 14:23:17.082758', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPeJPpPiovjYyAVsLcN3XYTxxZyYGI8lNzXZsxWrTwytUBFPno3VOIJ+0Hndlqy50EkfVzSu7uY+LnwwFuID2tA='} 2023-09-08T15:27:38.481 INFO:teuthology.orchestra.console.smithi094:Power off 2023-09-08T15:27:38.482 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T15:27:38.541 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-09-08T15:27:38.542 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T15:27:38.563 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-09-08T15:27:42.565 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T15:27:42.675 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-09-08T15:27:46.676 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T15:27:46.785 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-09-08T15:27:46.887 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-09-08T15:27:47.033 INFO:teuthology.lock.ops:unlocked: smithi094.front.sepia.ceph.com 2023-09-08T15:27:47.035 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAjwZ1aisVGtr5/1K5Vs0+0fnTcsorfnjeCS/7ZEK5BtP/Bi2t5vZ6rv4ngIAc7ytUHL1YtF7E5ti0aR0WmRde8= 2023-09-08T15:27:47.319 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi167's OS to be ubuntu 20.04 but found rhel 8.4