2023-11-09T05:53:04.556 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-09T05:53:04.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T05:53:04.740 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd794962670>, signals=[15]) 2023-11-09T05:53:04.741 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2023-11-09T05:53:04.741 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T05:53:04.742 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-11-09T05:53:04.764 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2023-11-09T05:53:04.765 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T05:53:04.765 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-11-09T05:53:04.767 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"} 2023-11-09T05:53:04.789 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging 2023-11-09T05:53:04.789 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T05:53:04.790 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-11-09T05:53:04.791 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"} 2023-11-09T05:53:04.815 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /host {"name": "smithi160"} 2023-11-09T05:53:04.840 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-09T05:53:04.872 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-09T05:53:04.881 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-09T05:53:04.884 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-09T05:53:04.885 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 5} 2023-11-09T05:53:04.914 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-09T05:53:04.915 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 5} 2023-11-09T05:53:04.920 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-09T05:53:04.920 DEBUG:teuthology.provision.fog.smithi160:FOG request: PUT /host/265 {"imageID": 5} 2023-11-09T05:53:04.929 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of rhel 8.6 2023-11-09T05:53:04.930 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:53:04.954 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of rhel 8.6 2023-11-09T05:53:04.955 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:53:04.968 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of rhel 8.6 2023-11-09T05:53:04.968 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:53:04.971 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T05:53:05.001 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T05:53:05.004 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1} 2023-11-09T05:53:05.011 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T05:53:05.037 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1} 2023-11-09T05:53:05.048 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:53:05.062 DEBUG:teuthology.provision.fog.smithi160:FOG request: POST /host/265/task {"taskTypeID": 1} 2023-11-09T05:53:05.097 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:53:05.111 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:53:05.133 INFO:teuthology.orchestra.console.smithi103:Power off 2023-11-09T05:53:05.135 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T05:53:05.161 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-11-09T05:53:05.162 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:05.190 INFO:teuthology.orchestra.console.smithi153:Power off 2023-11-09T05:53:05.191 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T05:53:05.212 INFO:teuthology.orchestra.console.smithi160:Power off 2023-11-09T05:53:05.213 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T05:53:05.221 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-11-09T05:53:05.222 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-11-09T05:53:05.223 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:05.242 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-11-09T05:53:05.243 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:05.251 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-11-09T05:53:05.265 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-11-09T05:53:09.223 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:09.253 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:09.266 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:09.336 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-11-09T05:53:09.362 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-11-09T05:53:09.377 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-11-09T05:53:13.340 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:13.363 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:13.378 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:13.449 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-11-09T05:53:13.475 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-11-09T05:53:13.491 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-11-09T05:53:13.550 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-11-09T05:53:13.577 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-11-09T05:53:13.592 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-11-09T05:53:13.651 INFO:teuthology.orchestra.console.smithi103:Power on 2023-11-09T05:53:13.652 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T05:53:13.676 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2023-11-09T05:53:13.677 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:13.687 INFO:teuthology.orchestra.console.smithi153:Power on 2023-11-09T05:53:13.687 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T05:53:13.695 INFO:teuthology.orchestra.console.smithi160:Power on 2023-11-09T05:53:13.695 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T05:53:13.704 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-11-09T05:53:13.707 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On 2023-11-09T05:53:13.707 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:13.723 DEBUG:teuthology.orchestra.console.smithi160:power on output: Chassis Power Control: Up/On 2023-11-09T05:53:13.723 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:13.738 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-11-09T05:53:13.751 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-11-09T05:53:17.706 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:17.740 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:17.752 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:17.817 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-11-09T05:53:17.850 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-11-09T05:53:17.862 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-11-09T05:53:21.822 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:21.850 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:21.863 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T05:53:21.932 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-11-09T05:53:21.961 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-11-09T05:53:21.978 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-11-09T05:53:22.033 INFO:teuthology.orchestra.console.smithi103:Power on completed 2023-11-09T05:53:22.063 INFO:teuthology.orchestra.console.smithi153:Power on completed 2023-11-09T05:53:22.079 INFO:teuthology.orchestra.console.smithi160:Power on completed 2023-11-09T05:53:22.134 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2023-11-09T05:53:22.135 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:53:22.165 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2023-11-09T05:53:22.165 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:53:22.180 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2023-11-09T05:53:22.181 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:53:37.210 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:53:37.222 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:53:37.234 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:53:52.290 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:53:52.295 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:53:52.299 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:54:07.370 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:54:07.372 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:54:07.373 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:54:22.442 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:54:22.444 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:54:22.448 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:54:37.518 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:54:37.520 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:54:37.521 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:54:52.593 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:54:52.597 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:54:52.598 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:55:07.670 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:55:07.672 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:55:07.673 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:55:22.754 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:55:22.756 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:55:22.757 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:55:37.835 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:55:37.836 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:55:37.837 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:55:52.918 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:55:52.920 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:55:52.921 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:56:08.002 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-11-09T05:56:08.004 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-11-09T05:56:08.008 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:56:08.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:08.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:11.130 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-11-09T05:56:11.131 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-09T05:56:17.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:17.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:20.188 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-11-09T05:56:20.222 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-09T05:56:23.070 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-09T05:56:23.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:26.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:26.202 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-09T05:56:26.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:29.278 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-11-09T05:56:29.278 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-09T05:56:32.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:35.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:35.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:35.290 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-09T05:56:38.364 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-11-09T05:56:38.365 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-09T05:56:41.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:44.350 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-09T05:56:44.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:44.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:47.418 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-11-09T05:56:47.451 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-09T05:56:50.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:53.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:53.434 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-09T05:56:53.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:56:56.474 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-11-09T05:56:56.506 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-09T05:56:59.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:57:02.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:57:02.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:57:02.522 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-09T05:57:05.530 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-11-09T05:57:05.562 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-09T05:57:08.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:57:11.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:57:11.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:57:11.579 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-09T05:57:17.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:57:20.666 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-09T05:57:26.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:58:11.578 WARNING:teuthology.provision.fog.smithi153:timed out 2023-11-09T05:58:11.580 WARNING:teuthology.provision.fog.smithi160:timed out 2023-11-09T05:58:17.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:58:17.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:58:17.956 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T05:58:17.957 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T05:58:17.958 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T05:58:17.958 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T05:58:18.256 INFO:teuthology.provision.fog.smithi153:Node is ready 2023-11-09T05:58:18.257 DEBUG:teuthology.orchestra.run.smithi153:> hostname 2023-11-09T05:58:18.276 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2023-11-09T05:58:18.277 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts 2023-11-09T05:58:18.287 INFO:teuthology.provision.fog.smithi160:Node is ready 2023-11-09T05:58:18.288 DEBUG:teuthology.orchestra.run.smithi160:> hostname 2023-11-09T05:58:18.305 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com 2023-11-09T05:58:18.306 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts 2023-11-09T05:58:18.336 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2023-11-09T05:58:18.337 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-11-09T05:58:18.366 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160 2023-11-09T05:58:18.367 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-11-09T05:58:18.461 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts 2023-11-09T05:58:18.473 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts 2023-11-09T05:58:18.489 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts 2023-11-09T05:58:18.502 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts 2023-11-09T05:58:18.561 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname 2023-11-09T05:58:18.583 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname 2023-11-09T05:58:18.628 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-11-09T05:58:18.655 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-11-09T05:58:18.695 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-11-09T05:58:18.735 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-11-09T05:58:18.751 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux" 2023-11-09T05:58:18.752 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)" 2023-11-09T05:58:18.752 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel" 2023-11-09T05:58:18.752 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora" 2023-11-09T05:58:18.752 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6" 2023-11-09T05:58:18.753 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2023-11-09T05:58:18.753 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-09T05:58:18.753 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-11-09T05:58:18.753 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-09T05:58:18.753 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/" 2023-11-09T05:58:18.754 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-09T05:58:18.754 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T05:58:18.754 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-09T05:58:18.754 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T05:58:18.754 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-09T05:58:18.755 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-09T05:58:18.755 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-09T05:58:18.756 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2023-11-09T05:58:18.757 DEBUG:teuthology.parallel:result is None 2023-11-09T05:58:18.798 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux" 2023-11-09T05:58:18.799 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.6 (Ootpa)" 2023-11-09T05:58:18.799 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel" 2023-11-09T05:58:18.799 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora" 2023-11-09T05:58:18.800 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.6" 2023-11-09T05:58:18.800 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2023-11-09T05:58:18.800 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-09T05:58:18.800 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2023-11-09T05:58:18.800 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-09T05:58:18.801 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/" 2023-11-09T05:58:18.801 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-09T05:58:18.801 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T05:58:18.801 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-09T05:58:18.802 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T05:58:18.802 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-09T05:58:18.803 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-09T05:58:18.803 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-09T05:58:18.803 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2023-11-09T05:58:18.804 DEBUG:teuthology.parallel:result is None 2023-11-09T05:58:26.678 WARNING:teuthology.provision.fog.smithi103:timed out 2023-11-09T05:58:32.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:58:33.017 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T05:58:33.017 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T05:58:33.319 INFO:teuthology.provision.fog.smithi103:Node is ready 2023-11-09T05:58:33.320 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2023-11-09T05:58:33.340 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2023-11-09T05:58:33.340 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2023-11-09T05:58:33.398 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2023-11-09T05:58:33.399 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-11-09T05:58:33.523 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2023-11-09T05:58:33.554 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2023-11-09T05:58:33.623 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2023-11-09T05:58:33.691 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-11-09T05:58:33.758 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-11-09T05:58:33.819 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2023-11-09T05:58:33.819 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)" 2023-11-09T05:58:33.820 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2023-11-09T05:58:33.820 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2023-11-09T05:58:33.820 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6" 2023-11-09T05:58:33.820 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-11-09T05:58:33.820 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-09T05:58:33.821 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-11-09T05:58:33.821 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-09T05:58:33.821 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2023-11-09T05:58:33.821 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-09T05:58:33.821 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T05:58:33.822 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-11-09T05:58:33.822 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T05:58:33.822 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-09T05:58:33.822 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-09T05:58:33.822 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-09T05:58:33.823 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2023-11-09T05:58:33.823 DEBUG:teuthology.parallel:result is None 2023-11-09T05:58:34.136 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2023-11-09T05:58:34.137 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-09T05:58:34.169 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2023-11-09T05:58:34.170 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-09T05:58:34.190 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2023-11-09T05:58:34.191 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-09T05:58:34.217 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2023-11-09T05:58:34.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-11-09T05:58:34.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:58:34.289 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-11-09T05:58:34.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-11-09T05:58:34.359 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2023-11-09T05:58:34.416 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2023-11-09T05:58:34.417 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-11-09T05:58:34.477 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2023-11-09T05:58:34.477 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)" 2023-11-09T05:58:34.477 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2023-11-09T05:58:34.477 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2023-11-09T05:58:34.478 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6" 2023-11-09T05:58:34.478 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-11-09T05:58:34.478 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-09T05:58:34.478 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-11-09T05:58:34.478 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-09T05:58:34.479 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2023-11-09T05:58:34.479 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-09T05:58:34.479 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T05:58:34.479 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-11-09T05:58:34.479 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T05:58:34.480 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-09T05:58:34.480 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-09T05:58:34.480 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-09T05:58:34.481 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-11-09T05:58:34.510 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2023-11-09T05:58:34.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-11-09T05:58:34.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:58:34.592 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-11-09T05:58:34.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-11-09T05:58:34.730 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-11-09T05:58:34.791 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-11-09T05:58:34.792 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-11-09T05:58:34.850 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux" 2023-11-09T05:58:34.851 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)" 2023-11-09T05:58:34.851 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel" 2023-11-09T05:58:34.851 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora" 2023-11-09T05:58:34.851 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6" 2023-11-09T05:58:34.851 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2023-11-09T05:58:34.852 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-09T05:58:34.852 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-11-09T05:58:34.852 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-09T05:58:34.852 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/" 2023-11-09T05:58:34.852 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-09T05:58:34.853 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T05:58:34.853 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-11-09T05:58:34.853 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T05:58:34.853 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-09T05:58:34.853 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-09T05:58:34.854 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-09T05:58:34.854 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-11-09T05:58:34.882 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2023-11-09T05:58:34.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-11-09T05:58:34.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T05:58:34.950 DEBUG:teuthology.orchestra.run.smithi160:> true 2023-11-09T05:58:35.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-11-09T05:58:35.076 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2023-11-09T05:58:35.135 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2023-11-09T05:58:35.135 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-11-09T05:58:35.194 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux" 2023-11-09T05:58:35.195 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.6 (Ootpa)" 2023-11-09T05:58:35.195 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel" 2023-11-09T05:58:35.195 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora" 2023-11-09T05:58:35.195 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.6" 2023-11-09T05:58:35.196 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2023-11-09T05:58:35.196 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-09T05:58:35.196 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2023-11-09T05:58:35.196 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-09T05:58:35.196 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/" 2023-11-09T05:58:35.197 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-09T05:58:35.197 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T05:58:35.197 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-11-09T05:58:35.197 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T05:58:35.197 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-09T05:58:35.197 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-09T05:58:35.198 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-09T05:58:35.198 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-11-09T05:58:35.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T05:58:35.438 INFO:teuthology.dispatcher.supervisor:Running job 7452578 2023-11-09T05:58:35.438 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-11-09_05:47:18-fs:workload-main-distro-default-smithi/7452578 --name mchangir-2023-11-09_05:47:18-fs:workload-main-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/mchangir-2023-11-09_05:47:18-fs:workload-main-distro-default-smithi/7452578/orig.config.yaml 2023-11-09T05:58:35.446 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-11-09_05:47:18-fs:workload-main-distro-default-smithi/7452578 2023-11-09T05:58:35.447 INFO:teuthology.dispatcher.supervisor:Job PID: 2080894 2023-11-09T05:58:35.447 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-09T06:00:35.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:02:35.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:04:35.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:06:35.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:08:36.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:10:36.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:12:36.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:14:36.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:16:36.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:18:36.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:20:37.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:22:37.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:24:37.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:26:37.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:28:37.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:30:37.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:32:38.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:34:38.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:36:38.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:38:38.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:40:38.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:42:38.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:44:39.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:46:39.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:48:39.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:50:39.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:52:39.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:54:39.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T06:54:39.916 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-09T06:54:40.119 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-09T06:54:40.119 INFO:teuthology.nuke:Checking targets against current locks 2023-11-09T06:54:40.170 DEBUG:teuthology.nuke:shortname: smithi103 2023-11-09T06:54:40.171 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T06:54:40.196 DEBUG:teuthology.nuke:shortname: smithi153 2023-11-09T06:54:40.197 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T06:54:40.201 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-09_05:47:18-fs:workload-main-distro-default-smithi/7452578', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 05:53:03.638477', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-09T06:54:40.222 DEBUG:teuthology.nuke:shortname: smithi160 2023-11-09T06:54:40.223 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T06:54:40.227 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-09_05:47:18-fs:workload-main-distro-default-smithi/7452578', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 05:53:03.640205', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-09T06:54:40.257 INFO:teuthology.orchestra.console.smithi103:Power off 2023-11-09T06:54:40.257 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T06:54:40.268 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-09_05:47:18-fs:workload-main-distro-default-smithi/7452578', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 05:53:03.636458', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-09T06:54:40.279 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-11-09T06:54:40.280 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T06:54:40.303 INFO:teuthology.orchestra.console.smithi153:Power off 2023-11-09T06:54:40.304 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T06:54:40.313 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-11-09T06:54:40.324 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-11-09T06:54:40.325 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T06:54:40.338 INFO:teuthology.orchestra.console.smithi160:Power off 2023-11-09T06:54:40.339 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T06:54:40.348 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-11-09T06:54:40.362 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-11-09T06:54:40.362 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T06:54:40.382 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-11-09T06:54:40.414 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-11-09T06:54:40.449 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-11-09T06:54:40.483 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-11-09T06:54:40.565 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com 2023-11-09T06:54:40.598 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2023-11-09T06:54:40.632 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com