2023-08-31T01:43:27.006 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-31T01:43:27.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T01:43:27.189 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f12f554adc0>, signals=[15]) 2023-08-31T01:43:27.190 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2023-08-31T01:43:27.190 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2023-08-31T01:43:27.190 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-08-31T01:43:27.218 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging 2023-08-31T01:43:27.218 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server 2023-08-31T01:43:27.219 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-08-31T01:43:27.220 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /host {"name": "smithi029"} 2023-08-31T01:43:27.242 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-08-31T01:43:27.243 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-08-31T01:43:27.243 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-08-31T01:43:27.244 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /host {"name": "smithi052"} 2023-08-31T01:43:27.267 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"} 2023-08-31T01:43:27.297 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-31T01:43:27.323 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-31T01:43:27.328 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-31T01:43:27.334 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-31T01:43:27.335 DEBUG:teuthology.provision.fog.smithi029:FOG request: PUT /host/134 {"imageID": 5} 2023-08-31T01:43:27.377 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of rhel 8.6 2023-08-31T01:43:27.377 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:43:27.381 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-31T01:43:27.382 DEBUG:teuthology.provision.fog.smithi052:FOG request: PUT /host/157 {"imageID": 5} 2023-08-31T01:43:27.383 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-31T01:43:27.383 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 5} 2023-08-31T01:43:27.428 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /tasktype {"name": "deploy"} 2023-08-31T01:43:27.435 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of rhel 8.6 2023-08-31T01:43:27.435 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-31T01:43:27.441 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of rhel 8.6 2023-08-31T01:43:27.441 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-08-31T01:43:27.476 DEBUG:teuthology.provision.fog.smithi029:FOG request: POST /host/134/task {"taskTypeID": 1} 2023-08-31T01:43:27.479 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"} 2023-08-31T01:43:27.492 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /tasktype {"name": "deploy"} 2023-08-31T01:43:27.516 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1} 2023-08-31T01:43:27.535 DEBUG:teuthology.provision.fog.smithi052:FOG request: POST /host/157/task {"taskTypeID": 1} 2023-08-31T01:43:27.545 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:43:27.572 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-31T01:43:27.605 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-08-31T01:43:27.650 INFO:teuthology.orchestra.console.smithi029:Power off 2023-08-31T01:43:27.651 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T01:43:27.665 INFO:teuthology.orchestra.console.smithi102:Power off 2023-08-31T01:43:27.665 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T01:43:27.677 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-08-31T01:43:27.677 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:27.685 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-08-31T01:43:27.686 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:27.702 INFO:teuthology.orchestra.console.smithi052:Power off 2023-08-31T01:43:27.703 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T01:43:27.709 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-08-31T01:43:27.710 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-08-31T01:43:27.723 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2023-08-31T01:43:27.723 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:27.747 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-08-31T01:43:31.714 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:31.721 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:31.748 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:31.823 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-08-31T01:43:31.829 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-08-31T01:43:31.856 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-08-31T01:43:35.826 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:35.833 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:35.858 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:35.936 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-08-31T01:43:35.942 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-31T01:43:35.967 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-08-31T01:43:36.038 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-08-31T01:43:36.043 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-08-31T01:43:36.068 INFO:teuthology.orchestra.console.smithi052:Power off completed 2023-08-31T01:43:36.139 INFO:teuthology.orchestra.console.smithi029:Power on 2023-08-31T01:43:36.140 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-31T01:43:36.148 INFO:teuthology.orchestra.console.smithi102:Power on 2023-08-31T01:43:36.148 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-31T01:43:36.161 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On 2023-08-31T01:43:36.162 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:36.168 INFO:teuthology.orchestra.console.smithi052:Power on 2023-08-31T01:43:36.169 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-31T01:43:36.175 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2023-08-31T01:43:36.176 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:36.186 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-08-31T01:43:36.189 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On 2023-08-31T01:43:36.189 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:36.197 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-31T01:43:36.209 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-08-31T01:43:40.191 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:40.198 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:40.211 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:40.300 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-08-31T01:43:40.306 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-31T01:43:40.319 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-08-31T01:43:44.306 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:44.313 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:44.320 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T01:43:44.415 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-08-31T01:43:44.421 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-08-31T01:43:44.428 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-08-31T01:43:44.517 INFO:teuthology.orchestra.console.smithi029:Power on completed 2023-08-31T01:43:44.522 INFO:teuthology.orchestra.console.smithi102:Power on completed 2023-08-31T01:43:44.530 INFO:teuthology.orchestra.console.smithi052:Power on completed 2023-08-31T01:43:44.618 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2023-08-31T01:43:44.619 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:43:44.623 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-08-31T01:43:44.623 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-31T01:43:44.631 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish 2023-08-31T01:43:44.632 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-08-31T01:43:59.694 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-31T01:43:59.696 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-08-31T01:43:59.697 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:44:14.762 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-31T01:44:14.763 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:44:14.767 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-08-31T01:44:29.834 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-31T01:44:29.836 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-08-31T01:44:29.840 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:44:44.914 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-31T01:44:44.915 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:44:44.916 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-08-31T01:44:59.990 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-08-31T01:44:59.992 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:44:59.993 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-31T01:45:15.086 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-31T01:45:15.088 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-08-31T01:45:15.089 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:45:30.170 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-31T01:45:30.171 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-08-31T01:45:30.175 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:45:45.254 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-31T01:45:45.256 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-08-31T01:45:45.257 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:46:00.332 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:46:00.335 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-31T01:46:00.336 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-08-31T01:46:15.431 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:46:15.433 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-31T01:46:15.434 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-08-31T01:46:15.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:46:15.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:46:15.686 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: Authentication failed. 2023-08-31T01:46:15.716 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T01:46:15.717 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T01:46:18.554 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-08-31T01:46:24.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:46:27.610 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-08-31T01:46:30.503 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:46:33.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:46:36.666 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-08-31T01:46:42.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:46:45.575 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-08-31T01:46:45.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:46:45.722 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-08-31T01:46:48.730 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-08-31T01:46:51.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:46:54.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:46:54.782 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-08-31T01:46:57.791 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-08-31T01:47:00.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:47:03.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:47:03.866 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-08-31T01:47:06.874 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-08-31T01:47:09.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:47:12.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:47:15.934 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-08-31T01:47:21.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:47:24.986 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-08-31T01:47:30.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:47:34.042 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-08-31T01:47:40.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:48:09.870 WARNING:teuthology.provision.fog.smithi052:timed out 2023-08-31T01:48:15.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:48:16.215 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T01:48:16.216 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T01:48:16.576 INFO:teuthology.provision.fog.smithi052:Node is ready 2023-08-31T01:48:16.576 DEBUG:teuthology.orchestra.run.smithi052:> hostname 2023-08-31T01:48:16.596 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com 2023-08-31T01:48:16.596 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts 2023-08-31T01:48:16.656 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052 2023-08-31T01:48:16.657 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-08-31T01:48:16.769 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts 2023-08-31T01:48:16.799 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts 2023-08-31T01:48:16.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname 2023-08-31T01:48:16.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-08-31T01:48:17.006 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-08-31T01:48:17.064 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T01:48:17.064 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T01:48:17.064 INFO:teuthology.orchestra.run.smithi052.stdout:ID="rhel" 2023-08-31T01:48:17.065 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="fedora" 2023-08-31T01:48:17.065 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8.6" 2023-08-31T01:48:17.065 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8" 2023-08-31T01:48:17.065 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T01:48:17.066 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-08-31T01:48:17.066 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T01:48:17.066 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T01:48:17.067 INFO:teuthology.orchestra.run.smithi052.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T01:48:17.067 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T01:48:17.067 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-08-31T01:48:17.067 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T01:48:17.068 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T01:48:17.069 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T01:48:17.069 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T01:48:17.070 INFO:teuthology.provision.fog.smithi052:Deploy complete! 2023-08-31T01:48:17.071 DEBUG:teuthology.parallel:result is None 2023-08-31T01:48:35.098 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-31T01:48:35.100 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi102 2023-08-31T01:48:40.050 WARNING:teuthology.provision.fog.smithi029:timed out 2023-08-31T01:48:44.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-08-31T01:48:44.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:48:44.623 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-08-31T01:48:44.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-08-31T01:48:44.904 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T01:48:44.905 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T01:48:44.924 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-08-31T01:48:44.924 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-08-31T01:48:44.983 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102 2023-08-31T01:48:44.984 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102 /etc/hosts 2023-08-31T01:48:45.043 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-08-31T01:48:45.044 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-08-31T01:48:45.173 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102/smithi102/g' /etc/hosts 2023-08-31T01:48:45.204 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-08-31T01:48:45.273 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102/smithi102/g' /etc/hostname 2023-08-31T01:48:45.341 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-08-31T01:48:45.409 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-08-31T01:48:45.466 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T01:48:45.466 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T01:48:45.466 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-08-31T01:48:45.467 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-08-31T01:48:45.467 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.6" 2023-08-31T01:48:45.467 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-08-31T01:48:45.467 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T01:48:45.467 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-08-31T01:48:45.468 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T01:48:45.468 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T01:48:45.468 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T01:48:45.468 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T01:48:45.468 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-08-31T01:48:45.469 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T01:48:45.469 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T01:48:45.469 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T01:48:45.469 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T01:48:45.469 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-08-31T01:48:45.470 DEBUG:teuthology.parallel:result is None 2023-08-31T01:48:46.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:48:46.384 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T01:48:46.384 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T01:48:46.691 INFO:teuthology.provision.fog.smithi029:Node is ready 2023-08-31T01:48:46.691 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2023-08-31T01:48:46.710 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2023-08-31T01:48:46.710 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts 2023-08-31T01:48:46.771 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2023-08-31T01:48:46.771 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-08-31T01:48:46.907 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts 2023-08-31T01:48:46.942 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts 2023-08-31T01:48:47.013 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname 2023-08-31T01:48:47.086 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-08-31T01:48:47.156 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-08-31T01:48:47.214 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T01:48:47.214 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T01:48:47.217 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel" 2023-08-31T01:48:47.217 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora" 2023-08-31T01:48:47.217 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.6" 2023-08-31T01:48:47.217 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-08-31T01:48:47.218 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T01:48:47.218 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-08-31T01:48:47.218 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T01:48:47.218 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T01:48:47.218 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T01:48:47.219 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T01:48:47.219 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-08-31T01:48:47.219 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T01:48:47.219 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T01:48:47.219 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T01:48:47.220 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T01:48:47.220 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2023-08-31T01:48:47.221 DEBUG:teuthology.parallel:result is None 2023-08-31T01:48:47.451 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2023-08-31T01:48:47.452 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-31T01:48:47.476 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com 2023-08-31T01:48:47.476 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2023-08-31T01:48:47.478 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2023-08-31T01:48:47.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-08-31T01:48:47.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:48:47.545 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-08-31T01:48:47.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-08-31T01:48:47.613 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2023-08-31T01:48:47.670 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-08-31T01:48:47.671 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-08-31T01:48:47.731 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T01:48:47.731 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T01:48:47.732 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel" 2023-08-31T01:48:47.732 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora" 2023-08-31T01:48:47.732 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.6" 2023-08-31T01:48:47.732 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-08-31T01:48:47.732 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T01:48:47.733 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-08-31T01:48:47.733 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T01:48:47.733 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T01:48:47.733 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T01:48:47.733 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T01:48:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-08-31T01:48:47.734 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T01:48:47.734 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T01:48:47.735 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T01:48:47.735 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T01:48:47.736 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-08-31T01:48:47.759 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server 2023-08-31T01:48:47.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-08-31T01:48:47.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:48:47.872 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-08-31T01:48:48.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-08-31T01:48:48.012 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2023-08-31T01:48:48.071 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2023-08-31T01:48:48.071 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-08-31T01:48:48.132 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T01:48:48.133 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T01:48:48.133 INFO:teuthology.orchestra.run.smithi052.stdout:ID="rhel" 2023-08-31T01:48:48.134 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="fedora" 2023-08-31T01:48:48.134 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8.6" 2023-08-31T01:48:48.134 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8" 2023-08-31T01:48:48.135 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T01:48:48.135 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-08-31T01:48:48.135 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T01:48:48.136 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T01:48:48.137 INFO:teuthology.orchestra.run.smithi052.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T01:48:48.137 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T01:48:48.138 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-08-31T01:48:48.138 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T01:48:48.138 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T01:48:48.138 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T01:48:48.138 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T01:48:48.139 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-08-31T01:48:48.160 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2023-08-31T01:48:48.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-08-31T01:48:48.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T01:48:48.228 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-08-31T01:48:48.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-08-31T01:48:48.298 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-08-31T01:48:48.356 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-08-31T01:48:48.357 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-08-31T01:48:48.417 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T01:48:48.418 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T01:48:48.418 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-08-31T01:48:48.418 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-08-31T01:48:48.418 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.6" 2023-08-31T01:48:48.419 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-08-31T01:48:48.419 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T01:48:48.419 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-08-31T01:48:48.419 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T01:48:48.419 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T01:48:48.420 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T01:48:48.420 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T01:48:48.420 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-08-31T01:48:48.420 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T01:48:48.420 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T01:48:48.421 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T01:48:48.421 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T01:48:48.421 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-08-31T01:48:48.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T01:48:48.549 INFO:teuthology.dispatcher.supervisor:Running job 7385125 2023-08-31T01:48:48.550 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385125 --name pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385125/orig.config.yaml 2023-08-31T01:48:48.552 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385125 2023-08-31T01:48:48.553 INFO:teuthology.dispatcher.supervisor:Job PID: 1840724 2023-08-31T01:48:48.554 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-31T01:50:48.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T01:52:48.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T01:54:48.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T01:56:48.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T01:58:48.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:00:48.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:02:48.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:04:49.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:06:49.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:08:49.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:10:49.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:12:49.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:14:49.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:16:49.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:18:49.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:20:49.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:22:49.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:24:49.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:26:49.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:28:49.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:30:50.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:32:50.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:34:50.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:36:50.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T02:36:50.388 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-31T02:36:50.633 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-31T02:36:50.634 INFO:teuthology.nuke:Checking targets against current locks 2023-08-31T02:36:50.688 DEBUG:teuthology.nuke:shortname: smithi029 2023-08-31T02:36:50.689 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T02:36:50.709 DEBUG:teuthology.nuke:shortname: smithi052 2023-08-31T02:36:50.709 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T02:36:50.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385125', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 01:43:26.164301', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-31T02:36:50.727 DEBUG:teuthology.nuke:shortname: smithi102 2023-08-31T02:36:50.728 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T02:36:50.735 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385125', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 01:43:26.165389', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-31T02:36:50.746 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385125', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 01:43:26.166199', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-31T02:36:50.761 INFO:teuthology.orchestra.console.smithi029:Power off 2023-08-31T02:36:50.762 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T02:36:50.782 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-08-31T02:36:50.782 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T02:36:50.795 INFO:teuthology.orchestra.console.smithi102:Power off 2023-08-31T02:36:50.796 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T02:36:50.807 INFO:teuthology.orchestra.console.smithi052:Power off 2023-08-31T02:36:50.808 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T02:36:50.814 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-08-31T02:36:50.815 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-08-31T02:36:50.815 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T02:36:50.827 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2023-08-31T02:36:50.827 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T02:36:50.836 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-31T02:36:50.847 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-08-31T02:36:50.915 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-08-31T02:36:50.937 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-08-31T02:36:50.948 INFO:teuthology.orchestra.console.smithi052:Power off completed 2023-08-31T02:36:51.068 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2023-08-31T02:36:51.085 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com 2023-08-31T02:36:51.094 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com