2023-11-05T19:39:47.299 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-05T19:39:47.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:39:47.485 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f18ea4c7ca0>, signals=[15]) 2023-11-05T19:39:47.487 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2023-11-05T19:39:47.487 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2023-11-05T19:39:47.487 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-11-05T19:39:47.520 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging 2023-11-05T19:39:47.521 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server 2023-11-05T19:39:47.521 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2023-11-05T19:39:47.522 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /host {"name": "smithi005"} 2023-11-05T19:39:47.555 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-11-05T19:39:47.555 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-11-05T19:39:47.555 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-11-05T19:39:47.557 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /host {"name": "smithi080"} 2023-11-05T19:39:47.595 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"} 2023-11-05T19:39:47.604 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-05T19:39:47.645 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-05T19:39:47.652 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-05T19:39:47.652 DEBUG:teuthology.provision.fog.smithi005:FOG request: PUT /host/111 {"imageID": 5} 2023-11-05T19:39:47.672 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-05T19:39:47.694 DEBUG:teuthology.provision.fog.smithi080:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-05T19:39:47.695 DEBUG:teuthology.provision.fog.smithi080:FOG request: PUT /host/185 {"imageID": 5} 2023-11-05T19:39:47.700 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of rhel 8.6 2023-11-05T19:39:47.700 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-11-05T19:39:47.713 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-05T19:39:47.714 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 5} 2023-11-05T19:39:47.736 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of rhel 8.6 2023-11-05T19:39:47.736 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:39:47.774 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of rhel 8.6 2023-11-05T19:39:47.774 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:39:47.790 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /tasktype {"name": "deploy"} 2023-11-05T19:39:47.819 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /tasktype {"name": "deploy"} 2023-11-05T19:39:47.834 DEBUG:teuthology.provision.fog.smithi005:FOG request: POST /host/111/task {"taskTypeID": 1} 2023-11-05T19:39:47.850 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"} 2023-11-05T19:39:47.865 DEBUG:teuthology.provision.fog.smithi080:FOG request: POST /host/185/task {"taskTypeID": 1} 2023-11-05T19:39:47.889 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-11-05T19:39:47.893 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1} 2023-11-05T19:39:47.936 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:39:47.961 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:39:48.020 INFO:teuthology.orchestra.console.smithi005:Power off 2023-11-05T19:39:48.021 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T19:39:48.052 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2023-11-05T19:39:48.052 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T19:39:48.070 INFO:teuthology.orchestra.console.smithi080:Power off 2023-11-05T19:39:48.071 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T19:39:48.087 INFO:teuthology.orchestra.console.smithi167:Power off 2023-11-05T19:39:48.088 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T19:39:48.097 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-11-05T19:39:48.098 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2023-11-05T19:39:48.098 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T19:39:48.112 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-11-05T19:39:48.113 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T19:39:48.123 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2023-11-05T19:39:48.140 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-11-05T19:39:48.225 INFO:teuthology.orchestra.console.smithi080:Power off completed 2023-11-05T19:39:48.242 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-11-05T19:39:48.327 INFO:teuthology.orchestra.console.smithi080:Power on 2023-11-05T19:39:48.327 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-05T19:39:48.344 INFO:teuthology.orchestra.console.smithi167:Power on 2023-11-05T19:39:48.344 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-05T19:39:48.353 DEBUG:teuthology.orchestra.console.smithi080:power on output: Chassis Power Control: Up/On 2023-11-05T19:39:48.354 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T19:39:48.365 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2023-11-05T19:39:48.366 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T19:39:48.377 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2023-11-05T19:39:48.386 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-11-05T19:39:52.098 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T19:39:52.208 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-11-05T19:39:52.379 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T19:39:52.387 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T19:39:52.489 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2023-11-05T19:39:52.496 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-11-05T19:39:52.596 INFO:teuthology.orchestra.console.smithi167:Power on completed 2023-11-05T19:39:52.697 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-11-05T19:39:52.698 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:39:56.210 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T19:39:56.319 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-11-05T19:39:56.419 INFO:teuthology.orchestra.console.smithi005:Power off completed 2023-11-05T19:39:56.490 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T19:39:56.521 INFO:teuthology.orchestra.console.smithi005:Power on 2023-11-05T19:39:56.522 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-05T19:39:56.543 DEBUG:teuthology.orchestra.console.smithi005:power on output: Chassis Power Control: Up/On 2023-11-05T19:39:56.544 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T19:39:56.565 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-11-05T19:39:56.603 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2023-11-05T19:39:56.704 INFO:teuthology.orchestra.console.smithi080:Power on completed 2023-11-05T19:39:56.805 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish 2023-11-05T19:39:56.805 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:40:00.570 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T19:40:00.679 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-11-05T19:40:04.682 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T19:40:04.792 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-11-05T19:40:04.893 INFO:teuthology.orchestra.console.smithi005:Power on completed 2023-11-05T19:40:04.994 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2023-11-05T19:40:04.994 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-11-05T19:40:07.794 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:40:11.895 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:40:20.079 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-11-05T19:40:22.870 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:40:26.978 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:40:35.167 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-11-05T19:40:37.958 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:40:42.080 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:40:50.265 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-11-05T19:40:53.028 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:40:57.173 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:41:05.350 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-11-05T19:41:08.106 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:41:12.257 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:41:20.426 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-11-05T19:41:23.174 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:41:27.335 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:41:35.502 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-11-05T19:41:38.257 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:41:42.423 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:41:50.582 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-11-05T19:41:53.326 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:41:57.494 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:42:05.658 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-11-05T19:42:08.402 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:42:12.578 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:42:20.734 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-11-05T19:42:23.461 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:42:27.646 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:42:35.806 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-11-05T19:42:35.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:42:38.522 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-11-05T19:42:38.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:42:38.938 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-11-05T19:42:41.662 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-05T19:42:42.709 DEBUG:teuthology.provision.fog.smithi080:FOG request: GET /task/active None 2023-11-05T19:42:42.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:42:44.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:42:45.818 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-11-05T19:42:47.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:42:47.998 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-11-05T19:42:50.746 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-05T19:42:51.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:42:54.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:42:54.878 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-11-05T19:42:56.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:42:57.082 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-11-05T19:42:59.802 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-05T19:43:00.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:03.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:03.966 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-11-05T19:43:05.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:06.142 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-11-05T19:43:08.858 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-05T19:43:09.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:12.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:13.050 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-11-05T19:43:14.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:15.230 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-11-05T19:43:17.914 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-05T19:43:19.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:21.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:22.110 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-11-05T19:43:23.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:24.318 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-11-05T19:43:26.970 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-05T19:43:28.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:30.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:31.198 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2023-11-05T19:43:32.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:36.026 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-05T19:43:37.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:42.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:43:45.086 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-05T19:43:51.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:44:09.594 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-05T19:44:15.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:44:18.654 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-05T19:44:24.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:44:26.364 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-05T19:44:26.365 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-05T19:44:26.642 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-11-05T19:44:26.642 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2023-11-05T19:44:26.658 INFO:teuthology.orchestra.run.smithi167.stdout:smithi022 2023-11-05T19:44:26.658 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi022 /etc/hosts 2023-11-05T19:44:26.715 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-11-05T19:44:26.715 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-11-05T19:44:26.829 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi022/smithi167/g' /etc/hosts 2023-11-05T19:44:26.857 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.22/172.21.15.167/g' /etc/hosts 2023-11-05T19:44:26.925 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi022/smithi167/g' /etc/hostname 2023-11-05T19:44:26.993 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-11-05T19:44:27.062 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-11-05T19:44:27.119 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2023-11-05T19:44:27.119 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)" 2023-11-05T19:44:27.119 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2023-11-05T19:44:27.120 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2023-11-05T19:44:27.120 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6" 2023-11-05T19:44:27.120 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-11-05T19:44:27.120 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-05T19:44:27.120 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-11-05T19:44:27.121 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-05T19:44:27.121 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2023-11-05T19:44:27.121 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-05T19:44:27.121 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T19:44:27.122 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-05T19:44:27.122 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-05T19:44:27.122 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-05T19:44:27.122 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-05T19:44:27.122 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-05T19:44:27.123 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-11-05T19:44:27.124 DEBUG:teuthology.parallel:result is None 2023-11-05T19:44:30.326 WARNING:teuthology.provision.fog.smithi005:timed out 2023-11-05T19:44:36.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:44:36.869 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-05T19:44:36.870 DEBUG:teuthology.orchestra.run.smithi005:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-05T19:44:37.203 WARNING:teuthology.provision.fog.smithi080:timed out 2023-11-05T19:44:37.298 INFO:teuthology.provision.fog.smithi005:Node is ready 2023-11-05T19:44:37.299 DEBUG:teuthology.orchestra.run.smithi005:> hostname 2023-11-05T19:44:37.319 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2023-11-05T19:44:37.319 DEBUG:teuthology.orchestra.run.smithi005:> grep smithi005.front.sepia.ceph.com /etc/hosts 2023-11-05T19:44:37.378 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2023-11-05T19:44:37.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2023-11-05T19:44:37.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hosts 2023-11-05T19:44:37.527 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.5/172.21.15.5/g' /etc/hosts 2023-11-05T19:44:37.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hostname 2023-11-05T19:44:37.666 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2023-11-05T19:44:37.733 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-11-05T19:44:37.791 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2023-11-05T19:44:37.791 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)" 2023-11-05T19:44:37.792 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2023-11-05T19:44:37.792 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2023-11-05T19:44:37.792 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6" 2023-11-05T19:44:37.792 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2023-11-05T19:44:37.792 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-05T19:44:37.793 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-11-05T19:44:37.793 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-05T19:44:37.793 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2023-11-05T19:44:37.793 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-05T19:44:37.793 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T19:44:37.794 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-05T19:44:37.794 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-05T19:44:37.794 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-05T19:44:37.794 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-05T19:44:37.794 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-05T19:44:37.795 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2023-11-05T19:44:37.795 DEBUG:teuthology.parallel:result is None 2023-11-05T19:44:43.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:44:43.572 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-05T19:44:43.572 DEBUG:teuthology.orchestra.run.smithi080:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-05T19:44:43.842 INFO:teuthology.provision.fog.smithi080:Node is ready 2023-11-05T19:44:43.843 DEBUG:teuthology.orchestra.run.smithi080:> hostname 2023-11-05T19:44:43.862 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080 2023-11-05T19:44:43.863 DEBUG:teuthology.orchestra.run.smithi080:> grep smithi080 /etc/hosts 2023-11-05T19:44:43.926 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080 2023-11-05T19:44:43.926 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2023-11-05T19:44:44.071 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080/smithi080/g' /etc/hosts 2023-11-05T19:44:44.101 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts 2023-11-05T19:44:44.173 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080/smithi080/g' /etc/hostname 2023-11-05T19:44:44.244 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2023-11-05T19:44:44.313 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2023-11-05T19:44:44.373 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux" 2023-11-05T19:44:44.373 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8.6 (Ootpa)" 2023-11-05T19:44:44.374 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel" 2023-11-05T19:44:44.374 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora" 2023-11-05T19:44:44.374 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8.6" 2023-11-05T19:44:44.374 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2023-11-05T19:44:44.374 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-05T19:44:44.375 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2023-11-05T19:44:44.375 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-05T19:44:44.375 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/" 2023-11-05T19:44:44.375 INFO:teuthology.orchestra.run.smithi080.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-05T19:44:44.375 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T19:44:44.376 INFO:teuthology.orchestra.run.smithi080.stdout: 2023-11-05T19:44:44.376 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-05T19:44:44.376 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-05T19:44:44.376 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-05T19:44:44.376 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-05T19:44:44.377 INFO:teuthology.provision.fog.smithi080:Deploy complete! 2023-11-05T19:44:44.377 DEBUG:teuthology.parallel:result is None 2023-11-05T19:44:44.562 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2023-11-05T19:44:44.563 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com 2023-11-05T19:44:44.563 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-05T19:44:44.591 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-11-05T19:44:44.591 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-05T19:44:44.618 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2023-11-05T19:44:44.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-05T19:44:44.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:44:44.686 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-11-05T19:44:44.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-11-05T19:44:44.759 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2023-11-05T19:44:44.818 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2023-11-05T19:44:44.818 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-11-05T19:44:44.878 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2023-11-05T19:44:44.878 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)" 2023-11-05T19:44:44.879 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2023-11-05T19:44:44.879 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2023-11-05T19:44:44.879 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6" 2023-11-05T19:44:44.879 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2023-11-05T19:44:44.880 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-05T19:44:44.880 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-11-05T19:44:44.880 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-05T19:44:44.880 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2023-11-05T19:44:44.881 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-05T19:44:44.881 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T19:44:44.881 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-11-05T19:44:44.881 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-05T19:44:44.881 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-05T19:44:44.882 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-05T19:44:44.882 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-05T19:44:44.883 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-11-05T19:44:44.908 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server 2023-11-05T19:44:44.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2023-11-05T19:44:44.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:44:44.978 DEBUG:teuthology.orchestra.run.smithi080:> true 2023-11-05T19:44:45.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2023-11-05T19:44:45.004 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2023-11-05T19:44:45.062 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2023-11-05T19:44:45.063 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2023-11-05T19:44:45.122 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux" 2023-11-05T19:44:45.122 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8.6 (Ootpa)" 2023-11-05T19:44:45.123 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel" 2023-11-05T19:44:45.123 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora" 2023-11-05T19:44:45.123 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8.6" 2023-11-05T19:44:45.123 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2023-11-05T19:44:45.123 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-05T19:44:45.123 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2023-11-05T19:44:45.124 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-05T19:44:45.124 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/" 2023-11-05T19:44:45.124 INFO:teuthology.orchestra.run.smithi080.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-05T19:44:45.124 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T19:44:45.124 INFO:teuthology.orchestra.run.smithi080.stdout: 2023-11-05T19:44:45.125 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-05T19:44:45.125 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-05T19:44:45.125 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-05T19:44:45.125 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-05T19:44:45.125 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2023-11-05T19:44:45.149 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-11-05T19:44:45.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-05T19:44:45.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T19:44:45.217 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-11-05T19:44:45.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-05T19:44:45.353 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-11-05T19:44:45.410 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-11-05T19:44:45.410 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-11-05T19:44:45.467 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2023-11-05T19:44:45.468 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)" 2023-11-05T19:44:45.468 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2023-11-05T19:44:45.468 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2023-11-05T19:44:45.468 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6" 2023-11-05T19:44:45.468 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-11-05T19:44:45.469 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-05T19:44:45.469 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-11-05T19:44:45.469 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-05T19:44:45.469 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2023-11-05T19:44:45.469 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-05T19:44:45.470 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T19:44:45.470 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-05T19:44:45.470 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-05T19:44:45.470 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-05T19:44:45.470 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-05T19:44:45.471 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-05T19:44:45.471 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-11-05T19:44:45.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:44:45.586 INFO:teuthology.dispatcher.supervisor:Running job 7448190 2023-11-05T19:44:45.587 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-05_14:10:09-fs-rishabh-2023nov3-testing-default-smithi/7448190 --name rishabh-2023-11-05_14:10:09-fs-rishabh-2023nov3-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/rishabh-2023-11-05_14:10:09-fs-rishabh-2023nov3-testing-default-smithi/7448190/orig.config.yaml 2023-11-05T19:44:45.589 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-11-05_14:10:09-fs-rishabh-2023nov3-testing-default-smithi/7448190 2023-11-05T19:44:45.590 INFO:teuthology.dispatcher.supervisor:Job PID: 180138 2023-11-05T19:44:45.591 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-05T19:46:45.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:48:45.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:50:46.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:52:46.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:54:46.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:56:46.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T19:58:46.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:00:46.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:02:47.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:04:47.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:06:47.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:08:47.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:10:47.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:12:47.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:14:47.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:16:48.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:18:48.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:20:48.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:22:48.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:24:48.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:26:48.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:28:49.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:30:49.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:32:49.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:34:49.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:36:49.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T20:36:49.874 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-05T20:36:50.103 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-05T20:36:50.104 INFO:teuthology.nuke:Checking targets against current locks 2023-11-05T20:36:50.157 DEBUG:teuthology.nuke:shortname: smithi005 2023-11-05T20:36:50.159 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T20:36:50.189 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-05_14:10:09-fs-rishabh-2023nov3-testing-default-smithi/7448190', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 19:39:46.473496', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-05T20:36:50.193 DEBUG:teuthology.nuke:shortname: smithi080 2023-11-05T20:36:50.194 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T20:36:50.221 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-05_14:10:09-fs-rishabh-2023nov3-testing-default-smithi/7448190', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 19:39:46.472100', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-05T20:36:50.222 DEBUG:teuthology.nuke:shortname: smithi167 2023-11-05T20:36:50.223 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T20:36:50.249 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-05_14:10:09-fs-rishabh-2023nov3-testing-default-smithi/7448190', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 19:39:46.469937', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-05T20:36:50.256 INFO:teuthology.orchestra.console.smithi005:Power off 2023-11-05T20:36:50.256 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T20:36:50.357 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2023-11-05T20:36:50.358 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T20:36:50.378 INFO:teuthology.orchestra.console.smithi080:Power off 2023-11-05T20:36:50.379 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T20:36:50.389 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-11-05T20:36:50.400 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2023-11-05T20:36:50.400 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T20:36:50.413 INFO:teuthology.orchestra.console.smithi167:Power off 2023-11-05T20:36:50.414 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T20:36:50.425 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2023-11-05T20:36:50.435 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-11-05T20:36:50.435 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T20:36:50.456 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-11-05T20:36:50.490 INFO:teuthology.orchestra.console.smithi005:Power off completed 2023-11-05T20:36:50.526 INFO:teuthology.orchestra.console.smithi080:Power off completed 2023-11-05T20:36:50.558 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-11-05T20:36:50.641 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com 2023-11-05T20:36:50.672 INFO:teuthology.lock.ops:unlocked: smithi080.front.sepia.ceph.com 2023-11-05T20:36:50.705 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com