2023-09-13T14:12:07.331 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-13T14:12:07.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:12:07.506 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa92c14d670>, signals=[15]) 2023-09-13T14:12:07.507 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2023-09-13T14:12:07.508 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2023-09-13T14:12:07.508 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-09-13T14:12:07.530 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-09-13T14:12:07.531 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-09-13T14:12:07.531 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-09-13T14:12:07.533 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /host {"name": "smithi059"} 2023-09-13T14:12:07.554 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2023-09-13T14:12:07.555 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2023-09-13T14:12:07.555 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-09-13T14:12:07.556 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /host {"name": "smithi143"} 2023-09-13T14:12:07.579 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /host {"name": "smithi158"} 2023-09-13T14:12:07.611 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-13T14:12:07.625 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-13T14:12:07.643 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-13T14:12:07.651 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-13T14:12:07.652 DEBUG:teuthology.provision.fog.smithi059:FOG request: PUT /host/164 {"imageID": 5} 2023-09-13T14:12:07.665 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-13T14:12:07.666 DEBUG:teuthology.provision.fog.smithi143:FOG request: PUT /host/248 {"imageID": 5} 2023-09-13T14:12:07.683 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-13T14:12:07.683 DEBUG:teuthology.provision.fog.smithi158:FOG request: PUT /host/263 {"imageID": 5} 2023-09-13T14:12:07.702 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of rhel 8.6 2023-09-13T14:12:07.702 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-09-13T14:12:07.720 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of rhel 8.6 2023-09-13T14:12:07.720 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:12:07.724 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of rhel 8.6 2023-09-13T14:12:07.724 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:12:07.766 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /tasktype {"name": "deploy"} 2023-09-13T14:12:07.781 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /tasktype {"name": "deploy"} 2023-09-13T14:12:07.792 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /tasktype {"name": "deploy"} 2023-09-13T14:12:07.803 DEBUG:teuthology.provision.fog.smithi059:FOG request: POST /host/164/task {"taskTypeID": 1} 2023-09-13T14:12:07.816 DEBUG:teuthology.provision.fog.smithi158:FOG request: POST /host/263/task {"taskTypeID": 1} 2023-09-13T14:12:07.828 DEBUG:teuthology.provision.fog.smithi143:FOG request: POST /host/248/task {"taskTypeID": 1} 2023-09-13T14:12:07.856 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-09-13T14:12:07.865 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:12:07.896 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:12:07.956 INFO:teuthology.orchestra.console.smithi158:Power off 2023-09-13T14:12:07.957 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T14:12:07.969 INFO:teuthology.orchestra.console.smithi059:Power off 2023-09-13T14:12:07.969 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T14:12:07.981 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-09-13T14:12:07.982 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:07.991 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-09-13T14:12:07.991 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:08.002 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-09-13T14:12:08.015 INFO:teuthology.orchestra.console.smithi143:Power off 2023-09-13T14:12:08.016 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T14:12:08.023 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-09-13T14:12:08.038 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-09-13T14:12:08.038 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:08.057 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-09-13T14:12:12.007 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:12.024 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:12.058 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:12.116 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-09-13T14:12:12.133 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-09-13T14:12:12.167 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-09-13T14:12:16.121 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:16.134 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:16.169 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:16.231 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-09-13T14:12:16.242 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-09-13T14:12:16.277 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-09-13T14:12:16.333 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-09-13T14:12:16.433 INFO:teuthology.orchestra.console.smithi158:Power on 2023-09-13T14:12:16.434 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-13T14:12:16.455 DEBUG:teuthology.orchestra.console.smithi158:power on output: Chassis Power Control: Up/On 2023-09-13T14:12:16.456 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:16.477 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-09-13T14:12:20.246 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:20.278 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:20.355 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-09-13T14:12:20.387 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-09-13T14:12:20.457 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-09-13T14:12:20.478 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:20.488 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-09-13T14:12:20.558 INFO:teuthology.orchestra.console.smithi059:Power on 2023-09-13T14:12:20.559 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-13T14:12:20.578 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2023-09-13T14:12:20.579 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:20.587 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-09-13T14:12:20.590 INFO:teuthology.orchestra.console.smithi143:Power on 2023-09-13T14:12:20.590 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-13T14:12:20.600 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-09-13T14:12:20.612 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2023-09-13T14:12:20.613 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:20.633 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-09-13T14:12:24.590 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:24.601 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:24.634 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:24.702 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-09-13T14:12:24.710 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-09-13T14:12:24.745 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-09-13T14:12:24.803 INFO:teuthology.orchestra.console.smithi158:Power on completed 2023-09-13T14:12:24.811 INFO:teuthology.orchestra.console.smithi059:Power on completed 2023-09-13T14:12:24.904 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2023-09-13T14:12:24.904 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:12:24.913 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2023-09-13T14:12:24.913 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-09-13T14:12:28.747 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:12:28.856 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-09-13T14:12:28.957 INFO:teuthology.orchestra.console.smithi143:Power on completed 2023-09-13T14:12:29.058 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-09-13T14:12:29.059 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:12:39.991 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-09-13T14:12:39.994 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:12:44.146 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:12:55.076 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-09-13T14:12:55.078 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:12:59.218 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:13:10.156 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:13:10.158 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-09-13T14:13:14.298 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:13:25.248 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-09-13T14:13:25.250 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:13:29.366 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:13:40.334 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-09-13T14:13:40.335 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:13:44.438 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:13:55.419 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:13:55.421 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-09-13T14:13:59.506 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:14:10.506 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-09-13T14:14:10.508 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:14:14.594 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:14:25.582 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:14:25.584 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-09-13T14:14:29.678 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:14:40.666 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:14:40.668 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-09-13T14:14:44.746 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:14:55.734 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:14:55.736 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-09-13T14:14:55.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:14:55.881 ERROR:teuthology.orchestra.connection:Error authenticating with smithi059.front.sepia.ceph.com: Authentication failed. 2023-09-13T14:14:55.883 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-13T14:14:55.884 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-13T14:14:55.884 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-13T14:14:56.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-13T14:14:57.897 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-13T14:14:59.805 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:15:10.797 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:15:14.863 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-13T14:15:14.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:18.010 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-13T14:15:24.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:25.855 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-13T14:15:25.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:27.066 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-13T14:15:28.986 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-13T14:15:33.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:34.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:36.122 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-13T14:15:38.042 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-13T14:15:42.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:44.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:45.178 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-13T14:15:47.102 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-13T14:15:51.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:53.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:54.238 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-13T14:15:56.154 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-13T14:16:00.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:02.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:03.290 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-13T14:16:05.210 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-13T14:16:09.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:11.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:14.266 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-13T14:16:20.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:23.322 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-13T14:16:27.802 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-13T14:16:29.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:32.378 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-13T14:16:33.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:36.858 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-13T14:16:38.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:41.434 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-13T14:16:42.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:45.613 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-13T14:16:45.613 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-13T14:16:45.894 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-09-13T14:16:45.894 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2023-09-13T14:16:45.910 INFO:teuthology.orchestra.run.smithi143.stdout:smithi022 2023-09-13T14:16:45.911 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi022 /etc/hosts 2023-09-13T14:16:45.967 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-09-13T14:16:45.967 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-09-13T14:16:46.080 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi022/smithi143/g' /etc/hosts 2023-09-13T14:16:46.107 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.22/172.21.15.143/g' /etc/hosts 2023-09-13T14:16:46.174 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi022/smithi143/g' /etc/hostname 2023-09-13T14:16:46.234 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-09-13T14:16:46.235 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi059 2023-09-13T14:16:46.240 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-09-13T14:16:46.306 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-09-13T14:16:46.363 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T14:16:46.363 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T14:16:46.364 INFO:teuthology.orchestra.run.smithi143.stdout:ID="rhel" 2023-09-13T14:16:46.364 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="fedora" 2023-09-13T14:16:46.364 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8.6" 2023-09-13T14:16:46.364 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-09-13T14:16:46.364 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T14:16:46.365 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-09-13T14:16:46.365 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T14:16:46.365 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T14:16:46.365 INFO:teuthology.orchestra.run.smithi143.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T14:16:46.365 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T14:16:46.366 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-09-13T14:16:46.366 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T14:16:46.366 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T14:16:46.366 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T14:16:46.366 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T14:16:46.367 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-09-13T14:16:46.368 DEBUG:teuthology.parallel:result is None 2023-09-13T14:16:47.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:55.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-09-13T14:16:55.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:55.484 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-09-13T14:16:55.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-09-13T14:16:55.757 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-13T14:16:55.757 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-13T14:16:55.775 INFO:teuthology.provision.fog.smithi059:Node is ready 2023-09-13T14:16:55.776 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2023-09-13T14:16:55.833 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2023-09-13T14:16:55.834 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2023-09-13T14:16:55.893 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2023-09-13T14:16:55.894 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-09-13T14:16:56.101 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2023-09-13T14:16:56.130 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2023-09-13T14:16:56.200 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2023-09-13T14:16:56.268 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-09-13T14:16:56.335 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-09-13T14:16:56.392 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T14:16:56.393 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T14:16:56.393 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2023-09-13T14:16:56.393 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2023-09-13T14:16:56.393 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.6" 2023-09-13T14:16:56.393 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-09-13T14:16:56.394 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T14:16:56.394 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-09-13T14:16:56.394 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T14:16:56.394 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T14:16:56.395 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T14:16:56.395 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T14:16:56.395 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-13T14:16:56.395 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T14:16:56.395 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T14:16:56.396 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T14:16:56.396 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T14:16:56.396 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2023-09-13T14:16:56.397 DEBUG:teuthology.parallel:result is None 2023-09-13T14:17:47.440 WARNING:teuthology.provision.fog.smithi158:timed out 2023-09-13T14:17:53.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:17:53.671 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-13T14:17:53.671 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-13T14:17:53.986 INFO:teuthology.provision.fog.smithi158:Node is ready 2023-09-13T14:17:53.986 DEBUG:teuthology.orchestra.run.smithi158:> hostname 2023-09-13T14:17:54.004 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2023-09-13T14:17:54.005 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2023-09-13T14:17:54.063 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2023-09-13T14:17:54.063 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-09-13T14:17:54.177 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2023-09-13T14:17:54.207 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2023-09-13T14:17:54.275 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2023-09-13T14:17:54.344 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-09-13T14:17:54.411 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-09-13T14:17:54.468 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T14:17:54.468 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T14:17:54.469 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel" 2023-09-13T14:17:54.469 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora" 2023-09-13T14:17:54.469 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.6" 2023-09-13T14:17:54.469 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-09-13T14:17:54.469 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T14:17:54.470 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-09-13T14:17:54.470 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T14:17:54.470 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T14:17:54.471 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T14:17:54.471 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T14:17:54.471 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-13T14:17:54.471 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T14:17:54.471 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T14:17:54.472 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T14:17:54.472 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T14:17:54.472 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2023-09-13T14:17:54.473 DEBUG:teuthology.parallel:result is None 2023-09-13T14:17:54.669 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2023-09-13T14:17:54.670 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-13T14:17:54.696 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2023-09-13T14:17:54.697 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-13T14:17:54.713 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2023-09-13T14:17:54.713 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-13T14:17:54.739 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2023-09-13T14:17:54.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-09-13T14:17:54.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:17:54.808 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-09-13T14:17:54.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-09-13T14:17:54.879 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-09-13T14:17:54.937 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-09-13T14:17:54.938 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-09-13T14:17:54.997 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T14:17:54.997 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T14:17:54.998 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2023-09-13T14:17:54.998 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2023-09-13T14:17:54.998 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.6" 2023-09-13T14:17:54.998 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-09-13T14:17:54.999 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T14:17:54.999 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-09-13T14:17:54.999 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T14:17:54.999 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T14:17:54.999 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T14:17:55.000 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T14:17:55.000 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-13T14:17:55.000 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T14:17:55.000 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T14:17:55.001 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T14:17:55.001 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T14:17:55.001 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-09-13T14:17:55.021 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2023-09-13T14:17:55.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-09-13T14:17:55.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:17:55.088 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-09-13T14:17:55.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-09-13T14:17:55.224 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-09-13T14:17:55.282 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-09-13T14:17:55.283 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-09-13T14:17:55.340 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T14:17:55.340 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T14:17:55.341 INFO:teuthology.orchestra.run.smithi143.stdout:ID="rhel" 2023-09-13T14:17:55.341 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="fedora" 2023-09-13T14:17:55.341 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8.6" 2023-09-13T14:17:55.341 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-09-13T14:17:55.342 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T14:17:55.342 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-09-13T14:17:55.342 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T14:17:55.342 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T14:17:55.342 INFO:teuthology.orchestra.run.smithi143.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T14:17:55.343 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T14:17:55.343 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-09-13T14:17:55.343 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T14:17:55.343 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T14:17:55.343 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T14:17:55.343 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T14:17:55.344 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-09-13T14:17:55.363 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2023-09-13T14:17:55.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-09-13T14:17:55.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:17:55.429 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-09-13T14:17:55.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-09-13T14:17:55.500 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-09-13T14:17:55.557 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-09-13T14:17:55.558 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-09-13T14:17:55.616 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T14:17:55.616 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T14:17:55.616 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel" 2023-09-13T14:17:55.616 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora" 2023-09-13T14:17:55.617 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.6" 2023-09-13T14:17:55.617 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-09-13T14:17:55.617 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T14:17:55.617 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-09-13T14:17:55.617 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T14:17:55.618 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T14:17:55.618 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T14:17:55.618 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T14:17:55.618 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-13T14:17:55.619 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T14:17:55.619 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T14:17:55.619 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T14:17:55.619 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T14:17:55.620 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-09-13T14:17:55.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:17:55.743 INFO:teuthology.dispatcher.supervisor:Running job 7396270 2023-09-13T14:17:55.744 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-09-13_10:54:59-fs-wip-vshankar-testing-20230913.074344-testing-default-smithi/7396270 --name vshankar-2023-09-13_10:54:59-fs-wip-vshankar-testing-20230913.074344-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/vshankar-2023-09-13_10:54:59-fs-wip-vshankar-testing-20230913.074344-testing-default-smithi/7396270/orig.config.yaml 2023-09-13T14:17:55.748 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-09-13_10:54:59-fs-wip-vshankar-testing-20230913.074344-testing-default-smithi/7396270 2023-09-13T14:17:55.749 INFO:teuthology.dispatcher.supervisor:Job PID: 410292 2023-09-13T14:17:55.749 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-13T14:19:55.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:21:56.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:23:56.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:25:56.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:27:56.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:29:56.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:31:56.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:33:57.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:35:57.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:37:57.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:39:57.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:41:57.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:43:57.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:45:58.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:47:58.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:49:58.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:51:58.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:53:58.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:55:58.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:57:59.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:59:59.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:01:59.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:03:59.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:05:59.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:07:59.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:10:00.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:12:00.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:14:00.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:16:00.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:18:00.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:20:00.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:22:01.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:24:01.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:26:01.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:28:01.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:30:01.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:32:02.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:34:02.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:36:02.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:38:02.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:40:02.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:42:02.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:44:03.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:46:03.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:48:03.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:50:03.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:52:03.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:54:03.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:56:04.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T15:58:04.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:00:04.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:02:04.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:04:04.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:06:04.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:08:05.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:10:05.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:12:05.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:14:05.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:16:05.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:18:05.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:20:06.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:22:06.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:24:06.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:26:06.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:28:06.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:30:06.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T16:30:06.959 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-13T16:30:07.183 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-13T16:30:07.184 INFO:teuthology.nuke:Checking targets against current locks 2023-09-13T16:30:07.235 DEBUG:teuthology.nuke:shortname: smithi059 2023-09-13T16:30:07.236 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T16:30:07.259 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-13_10:54:59-fs-wip-vshankar-testing-20230913.074344-testing-default-smithi/7396270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 14:12:06.493637', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T16:30:07.260 DEBUG:teuthology.nuke:shortname: smithi143 2023-09-13T16:30:07.261 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T16:30:07.286 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-13_10:54:59-fs-wip-vshankar-testing-20230913.074344-testing-default-smithi/7396270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 14:12:06.495364', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T16:30:07.287 DEBUG:teuthology.nuke:shortname: smithi158 2023-09-13T16:30:07.288 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T16:30:07.308 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-13_10:54:59-fs-wip-vshankar-testing-20230913.074344-testing-default-smithi/7396270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 14:12:06.491654', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T16:30:07.317 INFO:teuthology.orchestra.console.smithi059:Power off 2023-09-13T16:30:07.318 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T16:30:07.338 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-09-13T16:30:07.338 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T16:30:07.355 INFO:teuthology.orchestra.console.smithi143:Power off 2023-09-13T16:30:07.356 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T16:30:07.364 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-09-13T16:30:07.375 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-09-13T16:30:07.376 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T16:30:07.388 INFO:teuthology.orchestra.console.smithi158:Power off 2023-09-13T16:30:07.389 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T16:30:07.396 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-09-13T16:30:07.407 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-09-13T16:30:07.408 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T16:30:07.430 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-09-13T16:30:07.466 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-09-13T16:30:07.497 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-09-13T16:30:07.531 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-09-13T16:30:07.617 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com 2023-09-13T16:30:07.641 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com 2023-09-13T16:30:07.675 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com