2023-07-28T23:49:41.966 INFO:root:teuthology version: 0.0.1.dev172+g6114016 2023-07-28T23:49:41.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T23:49:46.750 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdbb8098280>, signals=[15]) 2023-07-28T23:49:46.752 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-07-28T23:49:46.753 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-07-28T23:49:46.753 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-07-28T23:49:46.779 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2023-07-28T23:49:46.780 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2023-07-28T23:49:46.780 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-07-28T23:49:46.782 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-07-28T23:49:51.820 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2023-07-28T23:49:51.820 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2023-07-28T23:49:51.820 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-07-28T23:49:51.822 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"} 2023-07-28T23:50:06.337 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /host {"name": "smithi155"} 2023-07-28T23:50:12.498 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-28T23:50:21.506 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-28T23:50:31.511 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-28T23:50:31.511 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 5} 2023-07-28T23:50:36.518 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-28T23:50:41.526 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-28T23:50:41.526 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 5} 2023-07-28T23:50:46.531 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of rhel 8.6 2023-07-28T23:50:46.531 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-28T23:50:46.818 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-28T23:50:46.818 DEBUG:teuthology.provision.fog.smithi155:FOG request: PUT /host/260 {"imageID": 5} 2023-07-28T23:50:46.877 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of rhel 8.6 2023-07-28T23:50:46.878 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-28T23:50:51.887 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-07-28T23:50:51.888 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of rhel 8.6 2023-07-28T23:50:51.888 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-07-28T23:51:01.936 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-07-28T23:51:11.949 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /tasktype {"name": "deploy"} 2023-07-28T23:51:11.952 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"} 2023-07-28T23:51:22.009 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1} 2023-07-28T23:51:22.015 DEBUG:teuthology.provision.fog.smithi155:FOG request: POST /host/260/task {"taskTypeID": 1} 2023-07-28T23:51:22.027 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-28T23:51:22.073 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-07-28T23:51:22.089 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-28T23:51:27.787 INFO:teuthology.orchestra.console.smithi104:Power off 2023-07-28T23:51:27.789 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T23:51:27.802 INFO:teuthology.orchestra.console.smithi098:Power off 2023-07-28T23:51:27.803 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T23:51:27.817 INFO:teuthology.orchestra.console.smithi155:Power off 2023-07-28T23:51:27.817 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T23:51:27.825 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-07-28T23:51:27.826 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:27.834 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2023-07-28T23:51:27.835 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:27.845 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-07-28T23:51:27.846 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:27.856 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-07-28T23:51:27.857 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-07-28T23:51:27.865 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-07-28T23:51:31.860 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:31.869 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:31.878 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:32.971 DEBUG:teuthology.orchestra.console.smithi098:check power output: 2023-07-28T23:51:32.978 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:51:32.988 DEBUG:teuthology.orchestra.console.smithi155:check power output: 2023-07-28T23:51:36.973 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:36.981 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:36.989 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:37.097 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-07-28T23:51:37.198 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-07-28T23:51:37.299 INFO:teuthology.orchestra.console.smithi155:Power on 2023-07-28T23:51:37.299 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-28T23:51:38.083 DEBUG:teuthology.orchestra.console.smithi098:check power output: 2023-07-28T23:51:38.090 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:51:42.085 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:42.093 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:42.195 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-07-28T23:51:42.296 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-07-28T23:51:42.320 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On 2023-07-28T23:51:42.320 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:42.341 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-07-28T23:51:42.397 INFO:teuthology.orchestra.console.smithi098:Power on 2023-07-28T23:51:42.397 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-28T23:51:43.203 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:51:46.343 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:47.205 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:47.421 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2023-07-28T23:51:47.422 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:47.452 DEBUG:teuthology.orchestra.console.smithi155:check power output: 2023-07-28T23:51:48.318 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:51:48.433 DEBUG:teuthology.orchestra.console.smithi098:check power output: 2023-07-28T23:51:51.453 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:52.320 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:52.433 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:52.565 DEBUG:teuthology.orchestra.console.smithi155:check power output: 2023-07-28T23:51:53.433 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:51:53.543 DEBUG:teuthology.orchestra.console.smithi098:check power output: 2023-07-28T23:51:56.568 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:57.434 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:57.544 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:51:57.678 DEBUG:teuthology.orchestra.console.smithi155:check power output: 2023-07-28T23:51:58.555 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:51:58.654 DEBUG:teuthology.orchestra.console.smithi098:check power output: 2023-07-28T23:52:01.680 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:52:01.790 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-07-28T23:52:01.891 INFO:teuthology.orchestra.console.smithi155:Power on completed 2023-07-28T23:52:01.992 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2023-07-28T23:52:01.992 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-07-28T23:52:02.636 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:52:02.655 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:52:02.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:52:07.702 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-07-28T23:52:07.803 INFO:teuthology.orchestra.console.smithi098:Power on completed 2023-07-28T23:52:07.904 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-07-28T23:52:07.904 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-28T23:52:12.909 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-28T23:52:12.910 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-07-28T23:52:12.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:52:17.953 INFO:teuthology.orchestra.console.smithi104:Power off completed 2023-07-28T23:52:18.053 INFO:teuthology.orchestra.console.smithi104:Power on 2023-07-28T23:52:18.054 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-28T23:52:18.075 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On 2023-07-28T23:52:18.076 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:52:18.096 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2023-07-28T23:52:18.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:52:21.008 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-28T23:52:21.968 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-28T23:52:22.097 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:52:23.208 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:52:27.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:52:28.247 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:52:28.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:52:29.358 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:52:31.312 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-28T23:52:31.313 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-28T23:52:33.360 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:52:34.470 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:52:37.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:52:42.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:52:47.329 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:52:47.337 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-28T23:52:48.438 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:52:50.384 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-28T23:52:52.440 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:52:53.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:52:53.550 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:52:56.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:52:56.400 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-28T23:52:57.552 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:52:58.660 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:53:02.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:53:02.662 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:53:03.771 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:53:07.776 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:53:08.885 DEBUG:teuthology.orchestra.console.smithi104:check power output: 2023-07-28T23:53:12.887 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T23:53:12.996 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2023-07-28T23:53:13.097 INFO:teuthology.orchestra.console.smithi104:Power on completed 2023-07-28T23:53:13.198 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2023-07-28T23:53:13.198 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-28T23:53:13.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:53:47.892 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-28T23:53:53.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:53:56.392 WARNING:teuthology.provision.fog.smithi098:timed out 2023-07-28T23:53:56.976 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-28T23:54:02.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:54:07.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T23:54:12.592 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-28T23:54:12.593 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-28T23:54:12.710 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-28T23:54:12.711 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-28T23:54:12.861 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-28T23:54:12.861 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-28T23:54:13.103 INFO:teuthology.provision.fog.smithi155:Node is ready 2023-07-28T23:54:13.104 DEBUG:teuthology.orchestra.run.smithi155:> hostname 2023-07-28T23:54:13.110 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2023-07-28T23:54:13.110 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts 2023-07-28T23:54:13.116 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-07-28T23:54:13.116 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-07-28T23:54:13.158 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2023-07-28T23:54:13.159 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-07-28T23:54:13.174 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-07-28T23:54:13.175 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-07-28T23:54:13.234 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-07-28T23:54:13.234 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-07-28T23:54:13.239 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts 2023-07-28T23:54:13.256 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts 2023-07-28T23:54:13.265 INFO:teuthology.provision.fog.smithi104:Node is ready 2023-07-28T23:54:13.265 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2023-07-28T23:54:13.271 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2023-07-28T23:54:13.271 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts 2023-07-28T23:54:13.278 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2023-07-28T23:54:13.279 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-07-28T23:54:13.315 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname 2023-07-28T23:54:13.326 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-07-28T23:54:13.336 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-07-28T23:54:13.342 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2023-07-28T23:54:13.342 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-28T23:54:13.342 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2023-07-28T23:54:13.342 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2023-07-28T23:54:13.343 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-28T23:54:13.343 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="20.04" 2023-07-28T23:54:13.343 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-28T23:54:13.343 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-28T23:54:13.343 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-28T23:54:13.343 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-28T23:54:13.343 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=focal 2023-07-28T23:54:13.344 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=focal 2023-07-28T23:54:13.346 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi155's OS to be rhel 8.6 but found ubuntu 20.04 2023-07-28T23:54:13.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T23:54:14.074 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts 2023-07-28T23:54:14.075 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-07-28T23:54:14.097 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2023-07-28T23:54:14.116 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-07-28T23:54:14.153 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname 2023-07-28T23:54:14.164 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-07-28T23:54:14.179 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-07-28T23:54:14.184 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu" 2023-07-28T23:54:14.184 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-28T23:54:14.184 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu 2023-07-28T23:54:14.185 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian 2023-07-28T23:54:14.185 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-28T23:54:14.185 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="20.04" 2023-07-28T23:54:14.185 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-28T23:54:14.185 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-28T23:54:14.185 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-28T23:54:14.186 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-28T23:54:14.186 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=focal 2023-07-28T23:54:14.186 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=focal 2023-07-28T23:54:14.188 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-07-28T23:54:14.301 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=6d4551b41c5148aca0dce37e198e3152 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi155's OS to be rhel 8.6 but found ubuntu 20.04 2023-07-28T23:54:14.317 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi155's OS to be rhel 8.6 but found ubuntu 20.04 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/dispatcher/supervisor.py", line 236, in reimage ctx.summary['sentry_event'] = sentry.report_error(job_config, e) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/config.py", line 263, in __getattr__ raise AttributeError(name) AttributeError: summary 2023-07-28T23:54:14.323 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098