2023-10-21T10:22:07.571 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T10:22:07.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:22:07.753 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5e046b7670>, signals=[15]) 2023-10-21T10:22:07.754 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-10-21T10:22:07.755 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T10:22:07.755 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-21T10:22:07.777 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-10-21T10:22:07.778 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T10:22:07.778 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-10-21T10:22:07.781 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"} 2023-10-21T10:22:07.802 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2023-10-21T10:22:07.802 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T10:22:07.803 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-10-21T10:22:07.804 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"} 2023-10-21T10:22:07.830 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /host {"name": "smithi069"} 2023-10-21T10:22:07.854 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-21T10:22:07.872 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-21T10:22:07.892 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_centos_9.stream (ID 10) 2023-10-21T10:22:07.893 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 10} 2023-10-21T10:22:07.900 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-21T10:22:07.911 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_9.stream (ID 10) 2023-10-21T10:22:07.912 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 10} 2023-10-21T10:22:07.936 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of centos 9.stream 2023-10-21T10:22:07.937 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T10:22:07.940 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_centos_9.stream (ID 10) 2023-10-21T10:22:07.940 DEBUG:teuthology.provision.fog.smithi069:FOG request: PUT /host/174 {"imageID": 10} 2023-10-21T10:22:07.962 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 9.stream 2023-10-21T10:22:07.962 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-21T10:22:07.988 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of centos 9.stream 2023-10-21T10:22:07.989 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-10-21T10:22:07.995 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T10:22:08.025 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T10:22:08.034 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1} 2023-10-21T10:22:08.042 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T10:22:08.061 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1} 2023-10-21T10:22:08.081 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T10:22:08.084 DEBUG:teuthology.provision.fog.smithi069:FOG request: POST /host/174/task {"taskTypeID": 1} 2023-10-21T10:22:08.115 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-21T10:22:08.130 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-10-21T10:22:08.176 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-21T10:22:08.177 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:22:08.198 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-21T10:22:08.199 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:08.217 INFO:teuthology.orchestra.console.smithi064:Power off 2023-10-21T10:22:08.217 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:22:08.230 INFO:teuthology.orchestra.console.smithi069:Power off 2023-10-21T10:22:08.231 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:22:08.238 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-21T10:22:08.240 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-10-21T10:22:08.240 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:08.255 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-10-21T10:22:08.255 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:08.263 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-10-21T10:22:08.277 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-10-21T10:22:08.339 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-21T10:22:08.440 INFO:teuthology.orchestra.console.smithi057:Power on 2023-10-21T10:22:08.441 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T10:22:08.463 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2023-10-21T10:22:08.463 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:08.485 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-21T10:22:12.268 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:12.278 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:12.377 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-10-21T10:22:12.387 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-10-21T10:22:12.487 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:12.596 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-21T10:22:12.697 INFO:teuthology.orchestra.console.smithi057:Power on completed 2023-10-21T10:22:12.798 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-10-21T10:22:12.798 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T10:22:16.381 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:16.388 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:16.490 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-21T10:22:16.497 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-10-21T10:22:16.592 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-10-21T10:22:16.599 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-10-21T10:22:16.693 INFO:teuthology.orchestra.console.smithi064:Power on 2023-10-21T10:22:16.694 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T10:22:16.701 INFO:teuthology.orchestra.console.smithi069:Power on 2023-10-21T10:22:16.701 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T10:22:16.714 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2023-10-21T10:22:16.715 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:16.724 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2023-10-21T10:22:16.725 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:16.736 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-21T10:22:16.746 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-10-21T10:22:20.741 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:20.749 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:20.852 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-21T10:22:20.858 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-10-21T10:22:24.854 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:24.862 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:22:24.964 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-10-21T10:22:24.971 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-10-21T10:22:25.065 INFO:teuthology.orchestra.console.smithi064:Power on completed 2023-10-21T10:22:25.072 INFO:teuthology.orchestra.console.smithi069:Power on completed 2023-10-21T10:22:25.167 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-10-21T10:22:25.167 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-21T10:22:25.174 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2023-10-21T10:22:25.174 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-10-21T10:22:27.875 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T10:22:40.252 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-21T10:22:40.253 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-10-21T10:22:42.950 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T10:22:55.340 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-21T10:22:55.342 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-10-21T10:22:58.027 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T10:23:10.458 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-21T10:23:10.460 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-10-21T10:23:13.126 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T10:23:25.550 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-10-21T10:23:25.552 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-21T10:23:28.210 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T10:23:40.638 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-21T10:23:40.640 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-10-21T10:23:43.294 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T10:23:55.718 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-10-21T10:23:55.721 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-21T10:23:58.382 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T10:24:10.798 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-10-21T10:24:10.802 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-21T10:24:13.474 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T10:24:25.898 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-21T10:24:25.899 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-10-21T10:24:28.570 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T10:24:40.992 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-21T10:24:40.993 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-10-21T10:24:43.666 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T10:24:43.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:24:43.824 ERROR:teuthology.orchestra.connection:Error authenticating with smithi057.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-21T10:24:47.946 ERROR:teuthology.orchestra.connection:Error authenticating with smithi057.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-21T10:24:56.090 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-21T10:24:56.093 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-10-21T10:24:56.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:24:56.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:24:56.458 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-21T10:25:14.622 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-10-21T10:25:20.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:25:23.706 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-10-21T10:25:29.466 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-21T10:25:29.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:25:32.762 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-10-21T10:25:35.098 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-21T10:25:35.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:25:38.522 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-21T10:25:38.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:25:41.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:25:41.822 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-10-21T10:25:44.154 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-21T10:25:44.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:25:47.578 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-21T10:25:47.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:25:50.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:25:50.874 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-10-21T10:25:53.210 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-21T10:25:53.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:25:56.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:25:59.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:26:53.583 WARNING:teuthology.provision.fog.smithi057:timed out 2023-10-21T10:26:56.878 WARNING:teuthology.provision.fog.smithi069:timed out 2023-10-21T10:26:59.214 WARNING:teuthology.provision.fog.smithi064:timed out 2023-10-21T10:26:59.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:26:59.847 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T10:26:59.848 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T10:27:00.174 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-10-21T10:27:00.174 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2023-10-21T10:27:00.190 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-10-21T10:27:00.190 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2023-10-21T10:27:00.247 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-10-21T10:27:00.248 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-10-21T10:27:00.345 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2023-10-21T10:27:00.379 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2023-10-21T10:27:00.451 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2023-10-21T10:27:00.523 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-10-21T10:27:00.594 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-21T10:27:00.650 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2023-10-21T10:27:00.650 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2023-10-21T10:27:00.651 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2023-10-21T10:27:00.651 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:27:00.651 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2023-10-21T10:27:00.651 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:27:00.651 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:27:00.652 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-10-21T10:27:00.652 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:27:00.652 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:27:00.652 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:27:00.652 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:27:00.652 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:27:00.653 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:27:00.653 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-10-21T10:27:00.654 DEBUG:teuthology.parallel:result is None 2023-10-21T10:27:02.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:27:03.301 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T10:27:03.302 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T10:27:03.644 INFO:teuthology.provision.fog.smithi069:Node is ready 2023-10-21T10:27:03.645 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2023-10-21T10:27:03.659 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com 2023-10-21T10:27:03.660 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts 2023-10-21T10:27:03.715 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2023-10-21T10:27:03.715 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-10-21T10:27:03.829 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts 2023-10-21T10:27:03.857 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2023-10-21T10:27:03.924 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname 2023-10-21T10:27:03.991 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-10-21T10:27:04.057 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-10-21T10:27:04.111 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2023-10-21T10:27:04.111 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2023-10-21T10:27:04.112 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2023-10-21T10:27:04.112 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:27:04.112 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2023-10-21T10:27:04.112 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:27:04.112 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:27:04.112 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-10-21T10:27:04.113 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:27:04.113 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:27:04.113 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:27:04.113 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:27:04.113 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:27:04.114 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:27:04.114 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2023-10-21T10:27:04.115 DEBUG:teuthology.parallel:result is None 2023-10-21T10:27:05.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:27:05.494 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T10:27:05.495 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T10:27:05.847 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-10-21T10:27:05.847 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-10-21T10:27:05.862 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-10-21T10:27:05.863 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-10-21T10:27:05.919 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-10-21T10:27:05.919 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-10-21T10:27:06.035 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-10-21T10:27:06.067 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-10-21T10:27:06.138 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-10-21T10:27:06.210 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-10-21T10:27:06.280 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-10-21T10:27:06.334 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-10-21T10:27:06.335 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2023-10-21T10:27:06.335 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-10-21T10:27:06.335 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:27:06.335 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2023-10-21T10:27:06.336 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:27:06.336 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:27:06.336 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-10-21T10:27:06.336 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:27:06.336 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:27:06.337 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:27:06.337 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:27:06.337 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:27:06.337 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:27:06.338 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-10-21T10:27:06.338 DEBUG:teuthology.parallel:result is None 2023-10-21T10:27:06.557 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-10-21T10:27:06.558 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T10:27:06.589 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-10-21T10:27:06.589 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T10:27:06.614 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2023-10-21T10:27:06.614 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T10:27:06.640 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-10-21T10:27:06.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-21T10:27:06.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:27:06.739 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-10-21T10:27:06.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-21T10:27:06.814 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-10-21T10:27:06.867 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-10-21T10:27:06.867 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-21T10:27:06.923 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2023-10-21T10:27:06.923 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2023-10-21T10:27:06.923 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2023-10-21T10:27:06.924 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:27:06.924 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2023-10-21T10:27:06.924 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:27:06.924 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:27:06.925 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-10-21T10:27:06.925 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:27:06.925 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:27:06.925 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:27:06.925 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:27:06.926 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:27:06.926 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:27:06.927 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-21T10:27:06.947 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-10-21T10:27:06.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-21T10:27:06.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:27:07.046 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-10-21T10:27:07.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-21T10:27:07.113 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-10-21T10:27:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-10-21T10:27:07.167 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-10-21T10:27:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-10-21T10:27:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2023-10-21T10:27:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-10-21T10:27:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:27:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2023-10-21T10:27:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:27:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:27:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-10-21T10:27:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:27:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:27:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:27:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:27:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:27:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:27:07.226 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-10-21T10:27:07.247 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2023-10-21T10:27:07.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-10-21T10:27:07.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:27:07.330 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-10-21T10:27:07.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-10-21T10:27:07.398 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-10-21T10:27:07.454 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-10-21T10:27:07.454 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-10-21T10:27:07.509 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2023-10-21T10:27:07.510 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2023-10-21T10:27:07.510 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2023-10-21T10:27:07.510 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:27:07.510 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2023-10-21T10:27:07.510 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:27:07.511 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:27:07.511 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-10-21T10:27:07.511 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:27:07.511 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:27:07.511 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:27:07.512 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:27:07.512 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:27:07.512 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:27:07.512 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-10-21T10:27:07.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:27:07.608 INFO:teuthology.dispatcher.supervisor:Running job 7433912 2023-10-21T10:27:07.609 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433912 --name yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} -- /home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433912/orig.config.yaml 2023-10-21T10:27:07.612 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433912 2023-10-21T10:27:07.613 INFO:teuthology.dispatcher.supervisor:Job PID: 3251808 2023-10-21T10:27:07.613 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T10:29:07.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:31:07.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:33:07.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:35:07.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:37:07.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:39:07.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:41:08.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:41:08.124 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T10:41:08.248 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T10:41:08.248 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T10:41:08.300 DEBUG:teuthology.nuke:shortname: smithi057 2023-10-21T10:41:08.300 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T10:41:08.319 DEBUG:teuthology.nuke:shortname: smithi064 2023-10-21T10:41:08.319 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T10:41:08.323 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 10:22:06.749886', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGOOzErJ6Ck8EctrulpbD60GumNOUw/A+kGZlMMqVOiLL0Qahfowm9FGc6OMoAhnU9QmRvKaULqlMXzEdiMTGFk='} 2023-10-21T10:41:08.347 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 10:22:06.746314', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCJdegR6yhMTEe4rS0AUlYmLiA1HJsyFcr8xs9YSzCKYgzKq9jYd1UHmcmf0ud8OWZJzMuOOsPwTlALnqn6Ry+8='} 2023-10-21T10:41:08.351 DEBUG:teuthology.nuke:shortname: smithi069 2023-10-21T10:41:08.351 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T10:41:08.375 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 10:22:06.748112', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAyb3mw1KRNspPkz3gXN/JwqpqFNCkk2I/iYiVPK25oVdCKX4msvjuvlZNrfNonB5RY3wcTSp1wUsICnTZSl4Gs='} 2023-10-21T10:41:08.380 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-21T10:41:08.381 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:41:08.402 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-21T10:41:08.403 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:41:08.420 INFO:teuthology.orchestra.console.smithi064:Power off 2023-10-21T10:41:08.420 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:41:08.429 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-21T10:41:08.441 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-10-21T10:41:08.441 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:41:08.454 INFO:teuthology.orchestra.console.smithi069:Power off 2023-10-21T10:41:08.455 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:41:08.463 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-21T10:41:08.474 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-10-21T10:41:08.475 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:41:08.494 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-10-21T10:41:08.530 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-21T10:41:08.564 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-10-21T10:41:08.596 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-10-21T10:41:08.683 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com 2023-10-21T10:41:08.715 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-10-21T10:41:08.740 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com