2023-09-08T07:04:15.299 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-08T07:04:15.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:04:15.472 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff44f5d8670>, signals=[15]) 2023-09-08T07:04:15.474 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2023-09-08T07:04:15.475 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2023-09-08T07:04:15.475 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-09-08T07:04:15.498 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2023-09-08T07:04:15.498 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2023-09-08T07:04:15.499 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-09-08T07:04:15.500 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"} 2023-09-08T07:04:15.522 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2023-09-08T07:04:15.523 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2023-09-08T07:04:15.523 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-09-08T07:04:15.524 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"} 2023-09-08T07:04:15.548 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /host {"name": "smithi173"} 2023-09-08T07:04:15.575 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-08T07:04:15.596 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-08T07:04:15.616 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-08T07:04:15.619 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-08T07:04:15.620 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 5} 2023-09-08T07:04:15.632 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-08T07:04:15.632 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 5} 2023-09-08T07:04:15.661 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-08T07:04:15.662 DEBUG:teuthology.provision.fog.smithi173:FOG request: PUT /host/278 {"imageID": 5} 2023-09-08T07:04:15.667 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.6 2023-09-08T07:04:15.668 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:04:15.672 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of rhel 8.6 2023-09-08T07:04:15.673 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:04:15.699 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of rhel 8.6 2023-09-08T07:04:15.699 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:04:15.721 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"} 2023-09-08T07:04:15.724 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"} 2023-09-08T07:04:15.748 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /tasktype {"name": "deploy"} 2023-09-08T07:04:15.754 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1} 2023-09-08T07:04:15.765 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1} 2023-09-08T07:04:15.785 DEBUG:teuthology.provision.fog.smithi173:FOG request: POST /host/278/task {"taskTypeID": 1} 2023-09-08T07:04:15.810 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:04:15.812 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:04:15.854 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:04:15.908 INFO:teuthology.orchestra.console.smithi093:Power off 2023-09-08T07:04:15.909 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T07:04:15.920 INFO:teuthology.orchestra.console.smithi103:Power off 2023-09-08T07:04:15.921 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T07:04:15.932 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-09-08T07:04:15.932 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:15.940 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-09-08T07:04:15.941 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:15.954 INFO:teuthology.orchestra.console.smithi173:Power off 2023-09-08T07:04:15.955 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T07:04:15.962 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-08T07:04:15.962 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-09-08T07:04:15.974 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-09-08T07:04:15.975 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:15.994 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-09-08T07:04:19.967 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:19.976 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:19.995 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:20.078 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-08T07:04:20.086 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-09-08T07:04:20.103 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-09-08T07:04:24.082 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:24.088 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:24.105 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:24.191 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-08T07:04:24.196 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-09-08T07:04:24.213 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-09-08T07:04:24.298 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-09-08T07:04:24.399 INFO:teuthology.orchestra.console.smithi093:Power on 2023-09-08T07:04:24.399 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-08T07:04:24.419 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On 2023-09-08T07:04:24.420 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:24.439 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-09-08T07:04:28.194 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:28.214 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:28.302 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-08T07:04:28.321 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-09-08T07:04:28.404 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-09-08T07:04:28.423 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-09-08T07:04:28.439 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:28.505 INFO:teuthology.orchestra.console.smithi103:Power on 2023-09-08T07:04:28.506 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-08T07:04:28.524 INFO:teuthology.orchestra.console.smithi173:Power on 2023-09-08T07:04:28.524 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-08T07:04:28.530 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2023-09-08T07:04:28.531 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:28.544 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On 2023-09-08T07:04:28.544 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:28.549 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-09-08T07:04:28.550 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-08T07:04:28.565 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-09-08T07:04:32.555 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:32.561 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:32.567 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:32.663 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-09-08T07:04:32.669 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-08T07:04:32.675 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-09-08T07:04:32.764 INFO:teuthology.orchestra.console.smithi093:Power on completed 2023-09-08T07:04:32.776 INFO:teuthology.orchestra.console.smithi173:Power on completed 2023-09-08T07:04:32.866 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2023-09-08T07:04:32.866 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:04:32.877 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2023-09-08T07:04:32.877 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:04:36.674 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:36.782 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-08T07:04:36.883 INFO:teuthology.orchestra.console.smithi103:Power on completed 2023-09-08T07:04:36.983 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2023-09-08T07:04:36.984 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:04:48.060 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:04:48.062 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:04:52.159 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:05:03.256 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:05:03.257 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:05:07.330 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:05:18.437 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:05:18.439 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:05:22.502 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:05:33.615 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:05:33.618 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:05:37.676 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:05:48.814 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:05:48.816 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:05:52.849 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:06:04.005 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:06:04.007 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:06:08.038 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:06:19.251 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:06:19.253 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:06:23.254 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:06:34.490 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:06:34.506 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:06:38.489 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:06:49.750 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:06:49.751 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:06:53.774 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:07:34.994 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:07:34.997 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:07:35.257 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:07:53.760 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:07:53.762 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:07:53.767 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:08:13.402 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:08:13.746 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:08:13.906 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:08:29.389 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:08:31.702 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:08:31.706 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:08:44.671 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:08:48.252 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:08:48.406 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:08:59.932 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:09:04.263 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:09:04.731 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:09:15.187 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:09:19.515 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:09:20.678 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:09:30.465 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:09:34.772 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:09:36.617 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:09:45.712 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:09:50.020 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:09:52.351 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:10:00.933 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:10:05.242 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:10:07.570 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:10:16.131 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:10:20.442 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-08T07:10:20.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:10:22.820 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-09-08T07:10:22.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:10:31.317 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:10:39.006 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-08T07:10:41.306 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-09-08T07:10:45.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:10:46.473 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:10:47.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:10:48.090 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-08T07:10:50.362 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-09-08T07:10:54.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:10:56.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:10:57.146 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-08T07:10:59.418 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-09-08T07:11:01.638 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:11:03.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:11:05.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:11:06.206 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-08T07:11:08.474 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-09-08T07:11:12.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:11:14.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:11:15.290 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-08T07:11:16.795 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:11:21.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:11:31.946 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-09-08T07:11:32.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:11:50.433 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-09-08T07:11:56.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:11:59.514 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-09-08T07:12:05.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:08.570 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-09-08T07:12:14.484 WARNING:teuthology.provision.fog.smithi173:timed out 2023-09-08T07:12:14.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:17.626 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-09-08T07:12:20.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:20.824 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-08T07:12:20.825 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-08T07:12:21.156 INFO:teuthology.provision.fog.smithi173:Node is ready 2023-09-08T07:12:21.156 DEBUG:teuthology.orchestra.run.smithi173:> hostname 2023-09-08T07:12:21.174 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173 2023-09-08T07:12:21.174 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173 /etc/hosts 2023-09-08T07:12:21.232 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2023-09-08T07:12:21.232 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-09-08T07:12:21.299 WARNING:teuthology.provision.fog.smithi103:timed out 2023-09-08T07:12:21.356 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173/smithi173/g' /etc/hosts 2023-09-08T07:12:21.385 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts 2023-09-08T07:12:21.453 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173/smithi173/g' /etc/hostname 2023-09-08T07:12:21.523 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-09-08T07:12:21.590 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-09-08T07:12:21.648 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Red Hat Enterprise Linux" 2023-09-08T07:12:21.648 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8.6 (Ootpa)" 2023-09-08T07:12:21.648 INFO:teuthology.orchestra.run.smithi173.stdout:ID="rhel" 2023-09-08T07:12:21.649 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="fedora" 2023-09-08T07:12:21.649 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8.6" 2023-09-08T07:12:21.649 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2023-09-08T07:12:21.650 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-08T07:12:21.650 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-09-08T07:12:21.650 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-08T07:12:21.650 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.redhat.com/" 2023-09-08T07:12:21.651 INFO:teuthology.orchestra.run.smithi173.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-08T07:12:21.651 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-08T07:12:21.651 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-09-08T07:12:21.651 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-08T07:12:21.652 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-08T07:12:21.652 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-08T07:12:21.652 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-08T07:12:21.653 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2023-09-08T07:12:21.654 DEBUG:teuthology.parallel:result is None 2023-09-08T07:12:23.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:27.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:27.623 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-08T07:12:27.623 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-08T07:12:27.886 INFO:teuthology.provision.fog.smithi103:Node is ready 2023-09-08T07:12:27.887 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2023-09-08T07:12:27.904 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103 2023-09-08T07:12:27.904 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103 /etc/hosts 2023-09-08T07:12:27.962 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2023-09-08T07:12:27.962 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-09-08T07:12:28.090 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103/smithi103/g' /etc/hosts 2023-09-08T07:12:28.120 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2023-09-08T07:12:28.188 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103/smithi103/g' /etc/hostname 2023-09-08T07:12:28.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-09-08T07:12:28.322 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-09-08T07:12:28.379 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2023-09-08T07:12:28.379 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)" 2023-09-08T07:12:28.379 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2023-09-08T07:12:28.379 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2023-09-08T07:12:28.380 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6" 2023-09-08T07:12:28.380 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-09-08T07:12:28.380 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-08T07:12:28.380 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-09-08T07:12:28.380 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-08T07:12:28.381 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2023-09-08T07:12:28.381 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-08T07:12:28.381 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-08T07:12:28.381 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-09-08T07:12:28.381 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-08T07:12:28.382 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-08T07:12:28.382 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-08T07:12:28.382 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-08T07:12:28.382 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2023-09-08T07:12:28.383 DEBUG:teuthology.parallel:result is None 2023-09-08T07:12:42.139 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-09-08T07:12:48.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:51.226 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-09-08T07:12:57.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:58.222 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-08T07:12:58.222 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-08T07:12:58.440 INFO:teuthology.provision.fog.smithi093:Node is ready 2023-09-08T07:12:58.441 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2023-09-08T07:12:58.458 INFO:teuthology.orchestra.run.smithi093.stdout:smithi022 2023-09-08T07:12:58.458 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi022 /etc/hosts 2023-09-08T07:12:58.516 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-09-08T07:12:58.516 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-09-08T07:12:58.631 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi022/smithi093/g' /etc/hosts 2023-09-08T07:12:58.657 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.22/172.21.15.93/g' /etc/hosts 2023-09-08T07:12:58.723 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi022/smithi093/g' /etc/hostname 2023-09-08T07:12:58.790 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-09-08T07:12:58.855 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-09-08T07:12:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2023-09-08T07:12:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2023-09-08T07:12:58.912 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2023-09-08T07:12:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2023-09-08T07:12:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2023-09-08T07:12:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-09-08T07:12:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-08T07:12:58.913 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-09-08T07:12:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-08T07:12:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2023-09-08T07:12:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-08T07:12:58.914 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-08T07:12:58.915 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-09-08T07:12:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-08T07:12:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-08T07:12:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-08T07:12:58.915 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-08T07:12:58.916 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2023-09-08T07:12:58.916 DEBUG:teuthology.parallel:result is None 2023-09-08T07:12:59.098 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2023-09-08T07:12:59.098 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-08T07:12:59.132 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2023-09-08T07:12:59.133 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-08T07:12:59.149 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2023-09-08T07:12:59.149 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-08T07:12:59.167 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2023-09-08T07:12:59.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-09-08T07:12:59.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:59.232 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-09-08T07:12:59.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-09-08T07:12:59.298 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-09-08T07:12:59.353 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-09-08T07:12:59.353 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-09-08T07:12:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2023-09-08T07:12:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2023-09-08T07:12:59.411 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2023-09-08T07:12:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2023-09-08T07:12:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2023-09-08T07:12:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-09-08T07:12:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-08T07:12:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-09-08T07:12:59.412 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-08T07:12:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2023-09-08T07:12:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-08T07:12:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-08T07:12:59.413 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-09-08T07:12:59.413 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-08T07:12:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-08T07:12:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-08T07:12:59.414 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-08T07:12:59.414 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-09-08T07:12:59.432 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2023-09-08T07:12:59.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-09-08T07:12:59.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:59.499 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-09-08T07:12:59.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-09-08T07:12:59.632 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2023-09-08T07:12:59.688 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2023-09-08T07:12:59.688 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-09-08T07:12:59.745 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2023-09-08T07:12:59.745 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)" 2023-09-08T07:12:59.745 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2023-09-08T07:12:59.746 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2023-09-08T07:12:59.746 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6" 2023-09-08T07:12:59.746 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-09-08T07:12:59.746 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-08T07:12:59.746 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-09-08T07:12:59.747 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-08T07:12:59.747 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2023-09-08T07:12:59.747 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-08T07:12:59.747 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-08T07:12:59.747 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-09-08T07:12:59.747 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-08T07:12:59.748 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-08T07:12:59.748 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-08T07:12:59.748 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-08T07:12:59.748 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-09-08T07:12:59.783 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2023-09-08T07:12:59.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-09-08T07:12:59.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:59.850 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-09-08T07:12:59.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-09-08T07:12:59.938 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2023-09-08T07:12:59.995 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2023-09-08T07:12:59.995 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-09-08T07:13:00.052 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Red Hat Enterprise Linux" 2023-09-08T07:13:00.052 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8.6 (Ootpa)" 2023-09-08T07:13:00.053 INFO:teuthology.orchestra.run.smithi173.stdout:ID="rhel" 2023-09-08T07:13:00.053 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="fedora" 2023-09-08T07:13:00.053 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8.6" 2023-09-08T07:13:00.053 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2023-09-08T07:13:00.053 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-08T07:13:00.054 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-09-08T07:13:00.054 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-08T07:13:00.054 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.redhat.com/" 2023-09-08T07:13:00.054 INFO:teuthology.orchestra.run.smithi173.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-08T07:13:00.054 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-08T07:13:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-09-08T07:13:00.055 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-08T07:13:00.055 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-08T07:13:00.055 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-08T07:13:00.055 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-08T07:13:00.056 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-09-08T07:13:00.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:13:00.159 INFO:teuthology.dispatcher.supervisor:Running job 7391015 2023-09-08T07:13:00.159 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391015 --name vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391015/orig.config.yaml 2023-09-08T07:13:00.162 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391015 2023-09-08T07:13:00.163 INFO:teuthology.dispatcher.supervisor:Job PID: 1732851 2023-09-08T07:13:00.163 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-08T07:15:00.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:17:00.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:19:00.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:21:00.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:23:00.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:25:01.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:27:01.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:29:01.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:31:01.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:33:01.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:35:01.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:37:02.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:39:02.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:41:02.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:43:02.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:45:02.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:47:02.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:49:02.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:51:02.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:53:03.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:55:03.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:57:03.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:59:03.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T08:01:03.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T08:03:03.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T08:05:04.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T08:07:04.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T08:09:04.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T08:09:04.444 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-08T08:09:04.656 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-08T08:09:04.657 INFO:teuthology.nuke:Checking targets against current locks 2023-09-08T08:09:04.707 DEBUG:teuthology.nuke:shortname: smithi093 2023-09-08T08:09:04.708 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-08T08:09:04.730 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391015', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-08 07:04:14.492540', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-08T08:09:04.732 DEBUG:teuthology.nuke:shortname: smithi103 2023-09-08T08:09:04.732 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-08T08:09:04.753 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391015', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-08 07:04:14.489774', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-08T08:09:04.758 DEBUG:teuthology.nuke:shortname: smithi173 2023-09-08T08:09:04.758 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-08T08:09:04.785 INFO:teuthology.orchestra.console.smithi093:Power off 2023-09-08T08:09:04.785 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T08:09:04.796 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391015', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-08 07:04:14.491164', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-08T08:09:04.806 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-09-08T08:09:04.806 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T08:09:04.825 INFO:teuthology.orchestra.console.smithi103:Power off 2023-09-08T08:09:04.826 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T08:09:04.836 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-09-08T08:09:04.845 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-09-08T08:09:04.846 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T08:09:04.862 INFO:teuthology.orchestra.console.smithi173:Power off 2023-09-08T08:09:04.863 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T08:09:04.870 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-08T08:09:04.881 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-09-08T08:09:04.881 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T08:09:04.900 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-09-08T08:09:04.938 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-09-08T08:09:04.971 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-09-08T08:09:05.001 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-09-08T08:09:05.102 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com 2023-09-08T08:09:05.118 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com 2023-09-08T08:09:05.142 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com