2023-09-01T19:17:44.716 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-01T19:17:44.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:17:44.852 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f744cfbb670>, signals=[15]) 2023-09-01T19:17:44.853 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2023-09-01T19:17:44.853 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2023-09-01T19:17:44.854 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-09-01T19:17:44.883 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2023-09-01T19:17:44.884 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2023-09-01T19:17:44.884 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-09-01T19:17:44.885 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"} 2023-09-01T19:17:44.909 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"} 2023-09-01T19:17:44.949 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-01T19:17:44.971 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-01T19:17:44.988 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-01T19:17:44.988 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 7} 2023-09-01T19:17:45.015 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-01T19:17:45.015 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 7} 2023-09-01T19:17:45.035 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of rhel 8.4 2023-09-01T19:17:45.036 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-01T19:17:45.058 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of rhel 8.4 2023-09-01T19:17:45.058 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:17:45.166 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"} 2023-09-01T19:17:45.171 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"} 2023-09-01T19:17:45.208 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1} 2023-09-01T19:17:45.211 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1} 2023-09-01T19:17:45.258 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-01T19:17:45.272 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:17:45.447 INFO:teuthology.orchestra.console.smithi145:Power off 2023-09-01T19:17:45.448 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-01T19:17:45.460 INFO:teuthology.orchestra.console.smithi104:Power off 2023-09-01T19:17:45.461 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-01T19:17:45.469 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2023-09-01T19:17:45.469 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T19:17:45.480 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-09-01T19:17:45.481 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T19:17:45.488 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-09-01T19:17:45.501 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-09-01T19:17:45.590 INFO:teuthology.orchestra.console.smithi145:Power off completed 2023-09-01T19:17:45.602 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-09-01T19:17:45.691 INFO:teuthology.orchestra.console.smithi145:Power on 2023-09-01T19:17:45.691 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-01T19:17:45.703 INFO:teuthology.orchestra.console.smithi104:Power on 2023-09-01T19:17:45.704 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-01T19:17:45.712 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On 2023-09-01T19:17:45.713 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T19:17:45.723 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On 2023-09-01T19:17:45.723 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T19:17:45.731 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-09-01T19:17:45.743 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-09-01T19:17:49.734 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T19:17:49.744 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T19:17:49.842 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-09-01T19:17:49.853 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-09-01T19:17:49.944 INFO:teuthology.orchestra.console.smithi145:Power on completed 2023-09-01T19:17:50.045 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2023-09-01T19:17:50.045 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:17:53.858 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T19:17:53.967 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-09-01T19:17:54.068 INFO:teuthology.orchestra.console.smithi104:Power on completed 2023-09-01T19:17:54.169 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2023-09-01T19:17:54.170 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-09-01T19:17:54.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:17:57.498 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-01T19:18:03.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:18:05.224 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:18:06.554 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-01T19:18:12.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:18:15.642 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-01T19:18:20.486 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:18:21.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:18:24.698 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-01T19:18:30.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:18:33.754 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-01T19:18:35.732 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:18:39.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:18:42.842 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-01T19:18:48.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:18:50.986 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:18:51.930 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-01T19:18:57.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:19:01.018 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-01T19:19:06.222 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:19:07.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:19:17.150 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-01T19:19:21.470 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:19:23.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:19:26.234 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-09-01T19:19:32.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:19:32.366 ERROR:teuthology.orchestra.connection:Error authenticating with smithi104.front.sepia.ceph.com: Authentication failed. 2023-09-01T19:19:32.426 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-01T19:19:32.427 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-01T19:19:32.428 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:33.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:34.439 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:35.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:36.451 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:36.763 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:19:37.457 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:38.465 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:39.470 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:40.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:41.481 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:42.486 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:43.491 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:44.497 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:45.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:46.508 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:47.514 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:48.519 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:49.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:50.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:51.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:52.492 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:19:52.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:53.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:54.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:55.559 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:56.565 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:57.571 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:58.576 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:19:59.582 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:00.588 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:01.593 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:02.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:03.606 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:04.611 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:05.617 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:06.622 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:07.628 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:08.633 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:09.638 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:09.645 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:20:10.644 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:11.650 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:12.655 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:13.660 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:14.665 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:15.670 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:16.675 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:17.682 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:18.687 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:19.692 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:20.697 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:21.702 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:22.707 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:23.712 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:24.717 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:25.723 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:26.729 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:27.734 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:28.739 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:29.744 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:30.748 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:31.754 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:32.534 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:20:32.760 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:33.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:34.770 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:35.775 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:36.780 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:37.786 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:38.791 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:39.796 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:40.801 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:41.807 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:42.813 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:43.820 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:44.825 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:45.831 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:46.836 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:47.842 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:48.847 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:49.852 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:50.857 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:51.863 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:52.868 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:53.873 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:54.332 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:20:54.879 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:55.884 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:56.889 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:57.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:58.900 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:20:59.905 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:00.911 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:01.917 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:02.922 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:03.927 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:04.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:05.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:06.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:07.950 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:08.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:09.961 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:10.966 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:11.971 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:12.977 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:13.982 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:14.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:15.428 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:21:15.994 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:17.000 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:18.006 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:19.010 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:20.014 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:21.019 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:22.024 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:23.029 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:24.034 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:25.040 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:26.045 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:27.050 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:28.056 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:29.062 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:30.067 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:31.073 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:32.078 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:32.244 ERROR:teuthology.provision.fog: on smithi104 2023-09-01T19:21:35.386 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:21:41.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-09-01T19:21:41.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:21:41.377 ERROR:teuthology.orchestra.connection:Error authenticating with smithi104.front.sepia.ceph.com: Authentication failed. 2023-09-01T19:21:41.378 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-09-01T19:21:41.379 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:21:56.956 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:22:18.327 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:22:37.827 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:22:55.491 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:23:12.543 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:23:28.996 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:23:45.290 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:23:50.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-09-01T19:23:50.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:23:50.347 ERROR:teuthology.orchestra.connection:Error authenticating with smithi104.front.sepia.ceph.com: Authentication failed. 2023-09-01T19:23:50.348 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-09-01T19:23:50.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-01T19:24:00.797 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:24:16.137 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:24:31.436 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:24:46.729 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:25:02.008 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:25:17.281 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:25:32.529 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:25:47.731 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:26:02.911 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:26:18.095 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:26:33.257 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:26:48.412 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:27:03.562 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:27:18.686 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:27:33.799 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:27:48.895 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:28:03.974 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-01T19:28:04.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:28:07.102 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-01T19:28:13.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:28:16.186 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-01T19:28:22.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:28:25.243 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-01T19:28:31.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:28:34.430 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-01T19:28:40.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:28:43.482 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-01T19:28:49.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:29:49.485 WARNING:teuthology.provision.fog.smithi145:timed out 2023-09-01T19:29:55.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:29:55.823 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-01T19:29:55.824 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-01T19:29:56.071 INFO:teuthology.provision.fog.smithi145:Node is ready 2023-09-01T19:29:56.072 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2023-09-01T19:29:56.088 INFO:teuthology.orchestra.run.smithi145.stdout:smithi036 2023-09-01T19:29:56.088 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi036 /etc/hosts 2023-09-01T19:29:56.147 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2023-09-01T19:29:56.148 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-09-01T19:29:56.256 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi036/smithi145/g' /etc/hosts 2023-09-01T19:29:56.290 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.36/172.21.15.145/g' /etc/hosts 2023-09-01T19:29:56.357 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi036/smithi145/g' /etc/hostname 2023-09-01T19:29:56.423 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-09-01T19:29:56.490 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-09-01T19:29:56.547 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2023-09-01T19:29:56.547 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.4 (Ootpa)" 2023-09-01T19:29:56.547 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2023-09-01T19:29:56.548 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2023-09-01T19:29:56.548 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.4" 2023-09-01T19:29:56.548 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-09-01T19:29:56.548 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-01T19:29:56.549 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-09-01T19:29:56.549 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-01T19:29:56.549 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2023-09-01T19:29:56.549 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-01T19:29:56.550 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-01T19:29:56.550 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-09-01T19:29:56.552 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-01T19:29:56.552 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-01T19:29:56.552 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-01T19:29:56.552 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-01T19:29:56.553 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2023-09-01T19:29:56.555 DEBUG:teuthology.parallel:result is None 2023-09-01T20:24:02.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-09-01T20:24:02.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T20:24:02.460 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-09-01T20:24:02.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-09-01T20:24:02.535 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-01T20:24:02.535 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-01T20:24:02.593 INFO:teuthology.provision.fog.smithi104:Node is ready 2023-09-01T20:24:02.593 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2023-09-01T20:24:02.652 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104 2023-09-01T20:24:02.653 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104 /etc/hosts 2023-09-01T20:24:02.712 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2023-09-01T20:24:02.712 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104 smithi104 2023-09-01T20:24:02.713 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-09-01T20:24:02.783 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104/smithi104/g' /etc/hosts 2023-09-01T20:24:02.852 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2023-09-01T20:24:02.920 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104/smithi104/g' /etc/hostname 2023-09-01T20:24:02.988 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-09-01T20:24:03.055 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-09-01T20:24:03.113 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2023-09-01T20:24:03.113 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8" 2023-09-01T20:24:03.114 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2023-09-01T20:24:03.114 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2023-09-01T20:24:03.114 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8" 2023-09-01T20:24:03.115 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2023-09-01T20:24:03.115 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-01T20:24:03.115 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-09-01T20:24:03.115 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-01T20:24:03.116 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2023-09-01T20:24:03.116 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-01T20:24:03.116 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-01T20:24:03.116 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-01T20:24:03.120 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi104's OS to be rhel 8.4 but found centos 8 2023-09-01T20:24:03.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T20:24:03.295 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=92972cd3abf54b22ae5f887cc070a56f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi104's OS to be rhel 8.4 but found centos 8 2023-09-01T20:24:03.297 INFO:teuthology.nuke:Checking targets against current locks 2023-09-01T20:24:03.390 DEBUG:teuthology.nuke:shortname: smithi104 2023-09-01T20:24:03.390 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-01T20:24:03.413 DEBUG:teuthology.nuke:shortname: smithi145 2023-09-01T20:24:03.413 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-01T20:24:03.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-01_19:14:47-rados-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7386309', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-01 19:56:48.589855', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHTi5tOcndgt4n//ODCbviZDCx8djsJsR53eAeCUbgNmzcGcXoWqJwIwxwGYN5BHNJdbREUgn0KLRVo/9WU8QsU9YuFv8lv/Cz5KtZfsfzTLw42D0aYM8i9j2myDfqwK1rnMStG5II64F6PBtBUYNOAGz5V8ArlYnA5ZAIOzTAE/TXRbk6Eu83JRACNzfsbvWstol+Z0nyyVMhS/THycUmNARK90bG5hIo39Ptbq1DcghjYmk0PXFL+8NO/rgyccEuDKks804VQBKdOeHU4aDEzTu5SPXcizHa6qWpKYTIAM0fahaAnkyTqQUBYF2Rtj7Nobe9wrpB/oDbEi5NouYp5wuxSTh5dxoj2rm336SmYiaDVPk3idSkLGDtsBKhrhnsRFwFzF210YIeab7gaWuILdLqDuEh1mT03HTwzkvTTTBJgvvfLU631rHNond7SbMdESHtqxvASGNzowPQDO+YqFfCTFRctSWLVQAs/DBV71wWkSCzhsE78n2IHJrzerc='} 2023-09-01T20:24:03.441 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-01_19:14:47-rados-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7386232', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-01 19:17:43.932966', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdeuksP6GW6qgfCbqKXD28tOv1hAUdy6dETCGyJXdNoWIFOmVx5GXnv4oAfpp0JjKJPslflci9noi88O5QJY9CMbxd4XqCeo0PwNR1qeBQ6w4So8hiO4ZY3dhSaJxBLYjr0bE7zXhjMIH2b9PocOlPS6YzOE1GTZD5Chwf5Sfu10qp3mC7AAlKPyLOhIbX2QLYLM7c1Ii29gBgeKachRtQC3rb32NFmrskgwyk3baKGfrR2myzkuwL+806LBH0JtjNTN9sBPoa4/8ZaqVR8YzE+WMYnbT2NIr0yKMrBfA4+CaMcW6JBs6XiPyF7CyOYX9qJWcBs6m9Edx9oHEdwvy3czJE0KXYK2N+sXcpM7qxuw+usyyA3wUiO1F2Xjuw0Ux+v1GkekPM1t+CY7QOl988lUiHr0J9TpPp1FutkS8oX4upuC+4av2niSZPF4ntWsWmXvEWzQ8RlwHfXhbevfvRWFVkemr/gXTnQrHayHSHdb/+FKTURjOoYEjr8VJiRFU='} 2023-09-01T20:24:03.468 INFO:teuthology.orchestra.console.smithi104:Power off 2023-09-01T20:24:03.469 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-01T20:24:03.490 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-09-01T20:24:03.491 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T20:24:03.506 INFO:teuthology.orchestra.console.smithi145:Power off 2023-09-01T20:24:03.507 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-01T20:24:03.515 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-09-01T20:24:03.530 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2023-09-01T20:24:03.531 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T20:24:03.554 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-09-01T20:24:07.516 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T20:24:07.555 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T20:24:07.626 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-09-01T20:24:07.664 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-09-01T20:24:11.628 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T20:24:11.665 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T20:24:11.740 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-09-01T20:24:11.775 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-09-01T20:24:11.842 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-09-01T20:24:11.876 INFO:teuthology.orchestra.console.smithi145:Power off completed 2023-09-01T20:24:11.988 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com 2023-09-01T20:24:12.020 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com 2023-09-01T20:24:12.302 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi104's OS to be rhel 8.4 but found centos 8