2023-11-09T21:44:55.460 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-09T21:44:55.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T21:44:55.615 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1dffa16b80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1e00519670>, signals=[15])
2023-11-09T21:44:55.616 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging
2023-11-09T21:44:55.617 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T21:44:55.617 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2023-11-09T21:44:55.637 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging
2023-11-09T21:44:55.638 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T21:44:55.638 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2023-11-09T21:44:55.639 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /host {"name": "smithi061"}
2023-11-09T21:44:55.663 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"}
2023-11-09T21:44:55.717 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-11-09T21:44:55.727 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-11-09T21:44:55.762 DEBUG:teuthology.provision.fog.smithi061:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-09T21:44:55.762 DEBUG:teuthology.provision.fog.smithi061:FOG request: PUT /host/166 {"imageID": 7}
2023-11-09T21:44:55.769 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-09T21:44:55.769 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 7}
2023-11-09T21:44:55.810 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of rhel 8.4
2023-11-09T21:44:55.811 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:44:55.816 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of rhel 8.4
2023-11-09T21:44:55.817 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:44:55.921 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T21:44:55.923 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T21:44:55.960 DEBUG:teuthology.provision.fog.smithi061:FOG request: POST /host/166/task {"taskTypeID": 1}
2023-11-09T21:44:55.965 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1}
2023-11-09T21:44:56.032 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:44:56.046 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:44:56.183 INFO:teuthology.orchestra.console.smithi102:Power off
2023-11-09T21:44:56.184 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T21:44:56.199 INFO:teuthology.orchestra.console.smithi061:Power off
2023-11-09T21:44:56.199 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T21:44:56.207 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2023-11-09T21:44:56.208 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:44:56.221 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off
2023-11-09T21:44:56.222 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:44:56.232 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2023-11-09T21:44:56.246 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on
2023-11-09T21:45:00.234 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:00.247 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:00.344 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2023-11-09T21:45:00.357 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on
2023-11-09T21:45:04.348 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:04.359 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:04.461 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2023-11-09T21:45:04.468 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on
2023-11-09T21:45:08.466 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:08.472 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:08.575 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2023-11-09T21:45:08.581 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off
2023-11-09T21:45:08.676 INFO:teuthology.orchestra.console.smithi102:Power off completed
2023-11-09T21:45:08.682 INFO:teuthology.orchestra.console.smithi061:Power off completed
2023-11-09T21:45:08.778 INFO:teuthology.orchestra.console.smithi102:Power on
2023-11-09T21:45:08.778 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T21:45:08.785 INFO:teuthology.orchestra.console.smithi061:Power on
2023-11-09T21:45:08.785 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T21:45:08.800 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On
2023-11-09T21:45:08.801 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:08.808 DEBUG:teuthology.orchestra.console.smithi061:power on output: Chassis Power Control: Up/On
2023-11-09T21:45:08.808 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:08.820 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2023-11-09T21:45:08.830 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off
2023-11-09T21:45:12.822 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:12.831 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:12.932 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2023-11-09T21:45:12.940 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on
2023-11-09T21:45:13.033 INFO:teuthology.orchestra.console.smithi102:Power on completed
2023-11-09T21:45:13.041 INFO:teuthology.orchestra.console.smithi061:Power on completed
2023-11-09T21:45:13.135 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2023-11-09T21:45:13.225 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:45:13.229 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish
2023-11-09T21:45:13.229 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:45:28.390 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:45:28.392 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:45:43.554 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:45:43.556 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:45:58.730 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:45:58.732 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:46:13.895 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:46:13.896 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:46:29.090 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:46:29.092 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:46:44.286 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:46:44.288 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:46:59.478 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:46:59.480 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:47:14.685 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:47:14.687 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:47:29.903 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:47:29.905 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:47:45.110 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:47:45.111 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:48:00.329 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:48:00.331 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:48:15.548 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:48:15.550 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:48:30.766 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:48:30.768 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:48:45.982 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:48:45.984 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:49:01.206 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:49:01.208 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:49:16.446 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:49:16.448 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:49:31.659 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:49:31.660 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:49:46.874 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:49:46.876 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:50:02.090 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:50:02.092 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:50:17.244 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:50:17.246 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:50:32.410 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:50:32.411 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:50:47.586 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:50:47.588 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-11-09T21:50:47.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:50:50.778 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-11-09T21:50:56.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:50:59.834 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-11-09T21:51:02.727 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:51:05.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:08.890 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-11-09T21:51:14.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:17.866 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None
2023-11-09T21:51:17.946 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-11-09T21:51:17.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:21.050 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-11-09T21:51:23.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:27.002 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-11-09T21:51:27.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:30.106 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-11-09T21:51:33.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:36.059 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-11-09T21:51:36.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:39.162 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-11-09T21:51:42.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:45.114 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-11-09T21:51:45.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:48.218 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-11-09T21:51:51.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:54.170 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-11-09T21:51:54.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:57.274 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-11-09T21:52:00.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:52:03.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:52:06.330 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-11-09T21:52:12.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:52:15.390 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-11-09T21:52:21.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:52:39.802 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-11-09T21:52:45.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:52:48.858 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-11-09T21:52:54.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:52:57.946 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2023-11-09T21:53:00.179 WARNING:teuthology.provision.fog.smithi061:timed out
2023-11-09T21:53:03.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:53:04.377 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T21:53:04.378 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T21:53:06.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:53:06.516 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T21:53:06.517 DEBUG:teuthology.orchestra.run.smithi061:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T21:53:06.797 INFO:teuthology.provision.fog.smithi061:Node is ready
2023-11-09T21:53:06.798 DEBUG:teuthology.orchestra.run.smithi061:> hostname
2023-11-09T21:53:06.854 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com
2023-11-09T21:53:06.854 DEBUG:teuthology.orchestra.run.smithi061:> grep smithi061.front.sepia.ceph.com /etc/hosts
2023-11-09T21:53:06.910 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061
2023-11-09T21:53:06.910 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061
2023-11-09T21:53:07.025 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hosts
2023-11-09T21:53:07.051 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/172.21.15.61/172.21.15.61/g' /etc/hosts
2023-11-09T21:53:07.116 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hostname
2023-11-09T21:53:07.182 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061
2023-11-09T21:53:07.246 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release
2023-11-09T21:53:07.300 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T21:53:07.300 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.4 (Ootpa)"
2023-11-09T21:53:07.300 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel"
2023-11-09T21:53:07.301 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora"
2023-11-09T21:53:07.301 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.4"
2023-11-09T21:53:07.301 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8"
2023-11-09T21:53:07.301 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-09T21:53:07.302 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31"
2023-11-09T21:53:07.302 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-09T21:53:07.302 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T21:53:07.302 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T21:53:07.302 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T21:53:07.303 INFO:teuthology.orchestra.run.smithi061.stdout:
2023-11-09T21:53:07.303 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T21:53:07.303 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-09T21:53:07.303 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T21:53:07.303 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-09T21:53:07.304 INFO:teuthology.provision.fog.smithi061:Deploy complete!
2023-11-09T21:53:07.306 DEBUG:teuthology.parallel:result is None
2023-11-09T21:53:24.639 INFO:teuthology.provision.fog.smithi102:Node is ready
2023-11-09T21:53:24.639 DEBUG:teuthology.orchestra.run.smithi102:> hostname
2023-11-09T21:53:24.655 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com
2023-11-09T21:53:24.655 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts
2023-11-09T21:53:24.709 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102
2023-11-09T21:53:24.709 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2023-11-09T21:53:24.868 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts
2023-11-09T21:53:24.891 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts
2023-11-09T21:53:24.956 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname
2023-11-09T21:53:25.020 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2023-11-09T21:53:25.084 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2023-11-09T21:53:25.137 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T21:53:25.138 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.4 (Ootpa)"
2023-11-09T21:53:25.138 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel"
2023-11-09T21:53:25.138 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora"
2023-11-09T21:53:25.138 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.4"
2023-11-09T21:53:25.138 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8"
2023-11-09T21:53:25.139 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-09T21:53:25.139 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2023-11-09T21:53:25.139 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-09T21:53:25.139 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T21:53:25.139 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T21:53:25.140 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T21:53:25.140 INFO:teuthology.orchestra.run.smithi102.stdout:
2023-11-09T21:53:25.140 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T21:53:25.140 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-09T21:53:25.140 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T21:53:25.141 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-09T21:53:25.141 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2023-11-09T21:53:25.141 DEBUG:teuthology.parallel:result is None
2023-11-09T21:53:25.284 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com
2023-11-09T21:53:25.284 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T21:53:25.310 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com
2023-11-09T21:53:25.310 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T21:53:25.327 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server
2023-11-09T21:53:25.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com'
2023-11-09T21:53:25.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:53:25.395 DEBUG:teuthology.orchestra.run.smithi061:> true
2023-11-09T21:53:25.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi061.front.sepia.ceph.com'
2023-11-09T21:53:25.514 DEBUG:teuthology.orchestra.run.smithi061:> uname -m
2023-11-09T21:53:25.569 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64
2023-11-09T21:53:25.570 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release
2023-11-09T21:53:25.625 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T21:53:25.625 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.4 (Ootpa)"
2023-11-09T21:53:25.626 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel"
2023-11-09T21:53:25.626 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora"
2023-11-09T21:53:25.626 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.4"
2023-11-09T21:53:25.626 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8"
2023-11-09T21:53:25.626 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-09T21:53:25.627 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31"
2023-11-09T21:53:25.627 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-09T21:53:25.627 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T21:53:25.627 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T21:53:25.628 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T21:53:25.628 INFO:teuthology.orchestra.run.smithi061.stdout:
2023-11-09T21:53:25.628 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T21:53:25.628 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-09T21:53:25.628 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T21:53:25.628 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-09T21:53:25.629 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2023-11-09T21:53:25.652 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server
2023-11-09T21:53:25.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2023-11-09T21:53:25.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:53:25.719 DEBUG:teuthology.orchestra.run.smithi102:> true
2023-11-09T21:53:25.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com'
2023-11-09T21:53:25.788 DEBUG:teuthology.orchestra.run.smithi102:> uname -m
2023-11-09T21:53:25.841 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64
2023-11-09T21:53:25.842 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2023-11-09T21:53:25.895 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T21:53:25.895 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.4 (Ootpa)"
2023-11-09T21:53:25.895 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel"
2023-11-09T21:53:25.896 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora"
2023-11-09T21:53:25.896 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.4"
2023-11-09T21:53:25.896 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8"
2023-11-09T21:53:25.896 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-09T21:53:25.897 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2023-11-09T21:53:25.897 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-09T21:53:25.897 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T21:53:25.897 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T21:53:25.897 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T21:53:25.898 INFO:teuthology.orchestra.run.smithi102.stdout:
2023-11-09T21:53:25.898 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T21:53:25.898 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-09T21:53:25.898 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T21:53:25.898 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-09T21:53:25.899 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2023-11-09T21:53:25.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T21:53:26.011 INFO:teuthology.dispatcher.supervisor:Running job 7453157
2023-11-09T21:53:26.012 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453157 --name yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi --description fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} -- /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453157/orig.config.yaml
2023-11-09T21:53:26.015 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453157
2023-11-09T21:53:26.016 INFO:teuthology.dispatcher.supervisor:Job PID: 3301222
2023-11-09T21:53:26.016 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-09T21:55:26.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T21:57:26.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T21:59:26.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:01:26.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:03:26.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:05:26.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:07:27.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:09:27.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:11:27.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:13:27.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:13:27.664 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-09T22:13:27.769 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-09T22:13:27.770 INFO:teuthology.nuke:Checking targets against current locks
2023-11-09T22:13:27.823 DEBUG:teuthology.nuke:shortname: smithi061
2023-11-09T22:13:27.823 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T22:13:27.849 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453157', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 21:44:54.608280', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB4IhDPygXQLp/2PXJycpm5ryhKm7dh5hADH0Law+6UkMYe4YseKKh1WlVksE0mNVfVtQ+EnkdxJwWmmqn+zTPU='}
2023-11-09T22:13:27.852 DEBUG:teuthology.nuke:shortname: smithi102
2023-11-09T22:13:27.853 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T22:13:27.873 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453157', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 21:44:54.609512', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAa3PPz79oUNaDacOcs4hY79wxMWvYmHOp5PO7A8ACPac1vk6ZR1t3mW+rodnL2IsU9y0P/ZicCRY6duL0mrFd0='}
2023-11-09T22:13:27.904 INFO:teuthology.orchestra.console.smithi061:Power off
2023-11-09T22:13:27.905 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T22:13:27.926 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off
2023-11-09T22:13:27.927 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:13:27.938 INFO:teuthology.orchestra.console.smithi102:Power off
2023-11-09T22:13:27.939 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T22:13:27.947 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off
2023-11-09T22:13:27.959 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2023-11-09T22:13:27.959 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:13:27.978 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2023-11-09T22:13:28.049 INFO:teuthology.orchestra.console.smithi061:Power off completed
2023-11-09T22:13:28.080 INFO:teuthology.orchestra.console.smithi102:Power off completed
2023-11-09T22:13:28.198 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com
2023-11-09T22:13:28.223 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com