2023-08-15T23:08:09.284 INFO:root:teuthology version: 0.0.1.dev183+g5435569
2023-08-15T23:08:09.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:08:14.518 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0efd67b7f0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f0efcf9ef70>, signals=[15])
2023-08-15T23:08:14.520 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2023-08-15T23:08:14.520 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2023-08-15T23:08:14.521 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-08-15T23:08:14.539 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging
2023-08-15T23:08:14.539 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server
2023-08-15T23:08:14.540 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2023-08-15T23:08:14.541 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"}
2023-08-15T23:08:14.607 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"}
2023-08-15T23:08:14.610 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-15T23:08:14.660 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_centos_8.stream (ID 3)
2023-08-15T23:08:14.660 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 3}
2023-08-15T23:08:14.674 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-15T23:08:14.704 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of centos 8.stream
2023-08-15T23:08:14.704 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-15T23:08:14.714 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_8.stream (ID 3)
2023-08-15T23:08:14.714 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 3}
2023-08-15T23:08:14.750 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 8.stream
2023-08-15T23:08:14.750 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-15T23:08:14.755 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"}
2023-08-15T23:08:14.789 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1}
2023-08-15T23:08:14.794 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"}
2023-08-15T23:08:14.826 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1}
2023-08-15T23:08:14.839 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-15T23:08:14.884 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-15T23:08:14.918 INFO:teuthology.orchestra.console.smithi093:Power off
2023-08-15T23:08:14.919 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-15T23:08:14.944 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2023-08-15T23:08:14.944 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:14.970 INFO:teuthology.orchestra.console.smithi187:Power off
2023-08-15T23:08:14.971 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-15T23:08:14.979 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-08-15T23:08:14.992 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off
2023-08-15T23:08:14.992 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:15.081 INFO:teuthology.orchestra.console.smithi093:Power off completed
2023-08-15T23:08:15.182 INFO:teuthology.orchestra.console.smithi093:Power on
2023-08-15T23:08:15.182 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-15T23:08:16.002 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:08:20.004 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:20.205 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On
2023-08-15T23:08:20.205 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:21.114 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:08:21.215 DEBUG:teuthology.orchestra.console.smithi093:check power output: 
2023-08-15T23:08:25.119 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:25.216 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:26.229 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:08:26.329 DEBUG:teuthology.orchestra.console.smithi093:check power output: 
2023-08-15T23:08:30.230 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:30.330 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:31.342 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:08:31.440 DEBUG:teuthology.orchestra.console.smithi093:check power output: 
2023-08-15T23:08:35.344 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:35.442 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:36.454 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:08:36.552 DEBUG:teuthology.orchestra.console.smithi093:check power output: 
2023-08-15T23:08:40.458 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:40.554 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:41.569 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:08:41.664 DEBUG:teuthology.orchestra.console.smithi093:check power output: 
2023-08-15T23:08:45.572 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:45.666 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:46.681 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:08:46.775 DEBUG:teuthology.orchestra.console.smithi093:check power output: 
2023-08-15T23:08:50.683 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:50.777 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:51.792 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:08:51.888 DEBUG:teuthology.orchestra.console.smithi093:check power output: 
2023-08-15T23:08:55.796 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:55.890 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:08:56.906 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:08:57.000 DEBUG:teuthology.orchestra.console.smithi093:check power output: 
2023-08-15T23:09:00.907 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:09:01.001 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:09:01.111 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2023-08-15T23:09:01.212 INFO:teuthology.orchestra.console.smithi093:Power on completed
2023-08-15T23:09:01.313 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2023-08-15T23:09:01.314 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-15T23:09:04.523 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:09:08.526 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:09:09.637 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:09:13.641 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:09:14.752 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:09:18.753 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:09:18.862 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2023-08-15T23:09:18.963 INFO:teuthology.orchestra.console.smithi187:Power off completed
2023-08-15T23:09:19.064 INFO:teuthology.orchestra.console.smithi187:Power on
2023-08-15T23:09:19.064 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-15T23:09:19.084 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On
2023-08-15T23:09:19.084 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:09:19.104 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2023-08-15T23:09:19.584 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-15T23:09:24.597 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:09:25.707 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:09:29.712 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:09:30.822 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:09:34.824 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:09:35.936 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:09:39.656 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-15T23:09:39.937 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:09:41.047 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:09:45.051 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:09:46.165 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:09:50.168 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:09:51.280 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:09:54.716 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-15T23:09:59.725 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:10:00.836 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:10:04.837 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:10:05.948 DEBUG:teuthology.orchestra.console.smithi187:check power output: 
2023-08-15T23:10:09.953 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:10:10.507 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2023-08-15T23:10:10.608 INFO:teuthology.orchestra.console.smithi187:Power on completed
2023-08-15T23:10:10.709 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish
2023-08-15T23:10:10.710 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-15T23:10:14.798 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-15T23:10:25.783 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-15T23:10:29.868 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-15T23:10:40.845 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-15T23:10:49.940 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-15T23:11:00.906 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-15T23:11:15.004 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-08-15T23:11:20.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:11:20.963 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-15T23:11:25.969 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-15T23:11:31.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:11:35.056 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-15T23:11:41.020 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-15T23:11:43.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:11:46.256 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-15T23:11:52.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:11:55.316 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-15T23:11:58.252 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-15T23:12:03.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:12:08.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:12:11.376 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-15T23:12:17.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:12:20.432 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-15T23:12:26.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:12:26.736 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-08-15T23:12:29.488 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-15T23:12:32.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:12:37.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:12:43.027 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-15T23:12:43.028 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-15T23:12:45.812 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-15T23:12:51.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:12:59.892 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-15T23:13:03.237 INFO:teuthology.provision.fog.smithi093:Node is ready
2023-08-15T23:13:03.238 DEBUG:teuthology.orchestra.run.smithi093:> hostname
2023-08-15T23:13:03.263 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com
2023-08-15T23:13:03.263 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093.front.sepia.ceph.com /etc/hosts
2023-08-15T23:13:03.325 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093
2023-08-15T23:13:03.325 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-08-15T23:13:03.451 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hosts
2023-08-15T23:13:03.487 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts
2023-08-15T23:13:03.562 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hostname
2023-08-15T23:13:03.636 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-08-15T23:13:03.709 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-08-15T23:13:03.771 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream"
2023-08-15T23:13:03.771 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8"
2023-08-15T23:13:03.772 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos"
2023-08-15T23:13:03.772 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora"
2023-08-15T23:13:03.772 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8"
2023-08-15T23:13:03.772 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2023-08-15T23:13:03.772 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-15T23:13:03.772 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-08-15T23:13:03.773 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-15T23:13:03.773 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/"
2023-08-15T23:13:03.773 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-15T23:13:03.773 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-15T23:13:03.773 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-15T23:13:03.774 INFO:teuthology.provision.fog.smithi093:Deploy complete!
2023-08-15T23:13:03.777 DEBUG:teuthology.parallel:result is None
2023-08-15T23:13:05.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:14:05.952 WARNING:teuthology.provision.fog.smithi187:timed out
2023-08-15T23:14:11.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:14:17.200 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-15T23:14:17.201 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-15T23:14:17.486 INFO:teuthology.provision.fog.smithi187:Node is ready
2023-08-15T23:14:17.486 DEBUG:teuthology.orchestra.run.smithi187:> hostname
2023-08-15T23:14:17.505 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com
2023-08-15T23:14:17.506 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts
2023-08-15T23:14:17.564 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187
2023-08-15T23:14:17.565 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187
2023-08-15T23:14:17.675 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts
2023-08-15T23:14:17.704 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts
2023-08-15T23:14:17.772 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname
2023-08-15T23:14:17.840 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187
2023-08-15T23:14:17.907 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release
2023-08-15T23:14:17.965 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream"
2023-08-15T23:14:17.965 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8"
2023-08-15T23:14:17.966 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos"
2023-08-15T23:14:17.966 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora"
2023-08-15T23:14:17.966 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8"
2023-08-15T23:14:17.966 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8"
2023-08-15T23:14:17.967 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-15T23:14:17.967 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31"
2023-08-15T23:14:17.967 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-15T23:14:17.967 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/"
2023-08-15T23:14:17.967 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-15T23:14:17.967 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-15T23:14:17.968 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-15T23:14:17.968 INFO:teuthology.provision.fog.smithi187:Deploy complete!
2023-08-15T23:14:17.968 DEBUG:teuthology.parallel:result is None
2023-08-15T23:14:23.118 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com
2023-08-15T23:14:23.119 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-15T23:14:28.151 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com
2023-08-15T23:14:28.151 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-15T23:14:33.176 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server
2023-08-15T23:14:33.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-08-15T23:14:33.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:14:38.246 DEBUG:teuthology.orchestra.run.smithi093:> true
2023-08-15T23:14:38.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-08-15T23:14:38.393 DEBUG:teuthology.orchestra.run.smithi093:> uname -m
2023-08-15T23:14:38.451 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64
2023-08-15T23:14:38.452 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-08-15T23:14:38.518 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream"
2023-08-15T23:14:38.518 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8"
2023-08-15T23:14:38.519 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos"
2023-08-15T23:14:38.519 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora"
2023-08-15T23:14:38.519 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8"
2023-08-15T23:14:38.519 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2023-08-15T23:14:38.519 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-15T23:14:38.519 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-08-15T23:14:38.519 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-15T23:14:38.520 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/"
2023-08-15T23:14:38.520 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-15T23:14:38.520 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-15T23:14:38.520 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-15T23:14:38.521 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-08-15T23:14:38.549 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server
2023-08-15T23:14:38.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2023-08-15T23:14:38.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:14:38.619 DEBUG:teuthology.orchestra.run.smithi187:> true
2023-08-15T23:14:38.755 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com'
2023-08-15T23:14:38.755 DEBUG:teuthology.orchestra.run.smithi187:> uname -m
2023-08-15T23:14:38.814 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64
2023-08-15T23:14:38.814 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release
2023-08-15T23:14:38.873 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream"
2023-08-15T23:14:38.873 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8"
2023-08-15T23:14:38.874 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos"
2023-08-15T23:14:38.874 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora"
2023-08-15T23:14:38.874 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8"
2023-08-15T23:14:38.874 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8"
2023-08-15T23:14:38.874 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-15T23:14:38.874 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31"
2023-08-15T23:14:38.874 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-15T23:14:38.875 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/"
2023-08-15T23:14:38.875 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-15T23:14:38.875 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-15T23:14:38.875 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-15T23:14:38.875 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2023-08-15T23:14:43.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:14:49.007 INFO:teuthology.dispatcher.supervisor:Running job 7368985
2023-08-15T23:14:49.007 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368985 --name yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi --description fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368985/orig.config.yaml
2023-08-15T23:14:49.011 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368985
2023-08-15T23:14:49.012 INFO:teuthology.dispatcher.supervisor:Job PID: 25107
2023-08-15T23:14:49.012 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-15T23:16:49.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:18:54.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:20:59.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:23:04.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:25:09.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:27:14.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:29:19.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:31:19.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:33:25.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:35:30.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:37:35.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:39:40.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:41:45.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:43:49.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:45:54.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:47:59.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:50:04.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:52:05.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:54:09.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:56:14.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:56:19.925 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-15T23:56:30.043 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-15T23:56:30.044 INFO:teuthology.nuke:Checking targets against current locks
2023-08-15T23:56:43.713 DEBUG:teuthology.nuke:shortname: smithi093
2023-08-15T23:56:43.714 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-15T23:56:50.780 DEBUG:teuthology.nuke:shortname: smithi187
2023-08-15T23:56:50.781 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-15T23:56:53.999 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368985', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 23:07:59.385282', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH6ZHxE3wOgidPwSfTsCon/3kmZGWUDimR5xm5I96CBmznVOjxtthsDLaUpclXNuccWCFezB/xZi2m2ykkMvmhU='}
2023-08-15T23:56:54.024 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368985', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 23:07:59.387241', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjILHWAd+uWlmHiMcr8L9aIHQL+rOtBs+zAGmwDV4pBLh+KLb8RPVIa4WXLRmJ3UvEjsAnoUzR9o/Xl9IhLS7IP83U5/C8uAghzUA7nMrzND8rprgnDEUqKV5sW1h5KDzb4bMGwVPMNNx4KHxqBLMN3MjR5+FSqZovsBSc5VbkJXV8URXGdgl8QRiOuumvnkcAM9FtNCp4QQ8lIhxgztSszlVObIvRZHa81ZBnUysqpkK2KzbA/XuUah93G276bjlx9hVEt/REcAM/cdFsAQpG+084hCjgOW1SY4wi0UQZeUjN9DJye+Ej5rYC053neVpd2zVcL6ItJ9dS22afZ7PKklemolu8hfYWDs10XLfzOET1XwXPiSbyc+1cVGwaVhrBSESluz2JE9hM2+fFjCheqvgPXTy2J1x9Jfqw0uUG87OVXsaVddbwDXEbzpnk+Ok4rmoQ61/7waABmL4RmRbPSze6orKomHVSJOQ9qfdZNlF1QulPKWbAwh8d0M1PV3U='}
2023-08-15T23:56:54.052 INFO:teuthology.orchestra.console.smithi093:Power off
2023-08-15T23:56:54.052 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-15T23:56:54.074 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2023-08-15T23:56:54.074 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:56:54.090 INFO:teuthology.orchestra.console.smithi187:Power off
2023-08-15T23:56:54.090 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-15T23:56:54.100 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-08-15T23:56:54.111 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off
2023-08-15T23:56:54.112 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:56:54.133 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2023-08-15T23:56:54.201 INFO:teuthology.orchestra.console.smithi093:Power off completed
2023-08-15T23:56:54.235 INFO:teuthology.orchestra.console.smithi187:Power off completed
2023-08-15T23:56:54.346 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com
2023-08-15T23:56:54.382 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com