2023-08-08T02:50:10.945 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-08T02:50:10.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:50:11.137 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f234e937280>, signals=[15]) 2023-08-08T02:50:11.138 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging 2023-08-08T02:50:11.139 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T02:50:11.139 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-08-08T02:50:11.155 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2023-08-08T02:50:11.156 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T02:50:11.156 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-08-08T02:50:11.157 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /host {"name": "smithi023"} 2023-08-08T02:50:11.180 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-08-08T02:50:11.181 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T02:50:11.181 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-08-08T02:50:11.182 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"} 2023-08-08T02:50:11.205 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"} 2023-08-08T02:50:11.258 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-08T02:50:11.262 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-08T02:50:11.281 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-08T02:50:11.300 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-08T02:50:11.301 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 5} 2023-08-08T02:50:11.303 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-08T02:50:11.303 DEBUG:teuthology.provision.fog.smithi023:FOG request: PUT /host/129 {"imageID": 5} 2023-08-08T02:50:11.320 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-08T02:50:11.320 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 5} 2023-08-08T02:50:11.341 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of rhel 8.6 2023-08-08T02:50:11.341 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:50:11.343 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of rhel 8.6 2023-08-08T02:50:11.344 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:50:11.364 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.6 2023-08-08T02:50:11.364 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:50:11.384 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T02:50:11.389 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T02:50:11.404 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T02:50:11.425 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1} 2023-08-08T02:50:11.430 DEBUG:teuthology.provision.fog.smithi023:FOG request: POST /host/129/task {"taskTypeID": 1} 2023-08-08T02:50:11.434 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1} 2023-08-08T02:50:11.477 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:50:11.479 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:50:11.482 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:50:11.559 INFO:teuthology.orchestra.console.smithi124:Power off 2023-08-08T02:50:11.560 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T02:50:11.578 INFO:teuthology.orchestra.console.smithi023:Power off 2023-08-08T02:50:11.579 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T02:50:11.593 INFO:teuthology.orchestra.console.smithi079:Power off 2023-08-08T02:50:11.594 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T02:50:11.603 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2023-08-08T02:50:11.604 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:11.615 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-08-08T02:50:11.616 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:11.626 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-08-08T02:50:11.627 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:11.636 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-08-08T02:50:11.640 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-08-08T02:50:11.648 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-08-08T02:50:15.640 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:15.650 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:15.658 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:15.753 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-08-08T02:50:15.760 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-08-08T02:50:15.768 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-08-08T02:50:19.758 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:19.767 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:19.776 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:19.870 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-08-08T02:50:19.877 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-08-08T02:50:19.887 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-08-08T02:50:23.872 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:23.881 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:23.890 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:23.982 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-08-08T02:50:23.992 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-08-08T02:50:24.000 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-08T02:50:24.084 INFO:teuthology.orchestra.console.smithi023:Power off completed 2023-08-08T02:50:24.093 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-08-08T02:50:24.101 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-08-08T02:50:24.186 INFO:teuthology.orchestra.console.smithi023:Power on 2023-08-08T02:50:24.186 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T02:50:24.194 INFO:teuthology.orchestra.console.smithi124:Power on 2023-08-08T02:50:24.195 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T02:50:24.205 INFO:teuthology.orchestra.console.smithi079:Power on 2023-08-08T02:50:24.206 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T02:50:24.216 DEBUG:teuthology.orchestra.console.smithi023:power on output: Chassis Power Control: Up/On 2023-08-08T02:50:24.217 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:24.225 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-08-08T02:50:24.225 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:24.233 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2023-08-08T02:50:24.234 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:24.246 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-08-08T02:50:24.247 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-08-08T02:50:24.257 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-08T02:50:28.248 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:28.257 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:28.264 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:28.359 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-08-08T02:50:28.366 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-08-08T02:50:28.373 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-08-08T02:50:28.468 INFO:teuthology.orchestra.console.smithi023:Power on completed 2023-08-08T02:50:28.474 INFO:teuthology.orchestra.console.smithi079:Power on completed 2023-08-08T02:50:28.569 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2023-08-08T02:50:28.570 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:50:28.574 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2023-08-08T02:50:28.574 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:50:32.364 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T02:50:32.473 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-08-08T02:50:32.574 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-08-08T02:50:32.675 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-08-08T02:50:32.676 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:50:43.632 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:50:43.633 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:50:47.740 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:50:58.694 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:50:58.695 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:51:02.793 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:51:13.756 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:51:13.757 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:51:17.865 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:51:28.824 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:51:28.825 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:51:32.924 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:51:43.892 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:51:43.936 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:51:47.984 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:51:59.000 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:51:59.002 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:52:03.052 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:52:14.072 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:52:14.073 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:52:18.124 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:52:29.148 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:52:29.149 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:52:33.196 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:52:44.228 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:52:44.229 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:52:48.279 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:52:59.304 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:52:59.305 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:53:03.352 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:53:14.388 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-08T02:53:14.389 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:53:14.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:53:17.520 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-08T02:53:18.431 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-08-08T02:53:18.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:53:21.552 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-08T02:53:23.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:53:26.576 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-08T02:53:27.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:53:29.459 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:53:30.608 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-08T02:53:32.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:53:35.635 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-08T02:53:36.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:53:39.668 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-08T02:53:41.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:53:44.520 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T02:53:44.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:53:44.654 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: Authentication failed. 2023-08-08T02:53:44.655 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T02:53:44.656 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T02:53:44.657 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-08T02:53:44.688 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-08T02:53:45.661 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-08T02:53:45.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:53:46.666 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-08T02:53:48.720 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-08T02:53:50.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:53:53.744 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-08T02:53:54.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:53:57.776 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-08T02:53:59.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:54:03.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:54:06.832 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-08-08T02:54:12.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:54:59.747 WARNING:teuthology.provision.fog.smithi079:timed out 2023-08-08T02:55:05.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:55:06.098 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T02:55:06.098 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T02:55:06.400 INFO:teuthology.provision.fog.smithi079:Node is ready 2023-08-08T02:55:06.400 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2023-08-08T02:55:06.419 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2023-08-08T02:55:06.419 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2023-08-08T02:55:06.477 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2023-08-08T02:55:06.478 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-08-08T02:55:06.605 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2023-08-08T02:55:06.633 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2023-08-08T02:55:06.701 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2023-08-08T02:55:06.767 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-08-08T02:55:06.832 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-08-08T02:55:06.889 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2023-08-08T02:55:06.889 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2023-08-08T02:55:06.890 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2023-08-08T02:55:06.890 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2023-08-08T02:55:06.890 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2023-08-08T02:55:06.890 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-08-08T02:55:06.890 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-08T02:55:06.890 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-08-08T02:55:06.890 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-08T02:55:06.891 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2023-08-08T02:55:06.891 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-08T02:55:06.891 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T02:55:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-08-08T02:55:06.891 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T02:55:06.891 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-08T02:55:06.891 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-08T02:55:06.891 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-08T02:55:06.892 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2023-08-08T02:55:06.893 DEBUG:teuthology.parallel:result is None 2023-08-08T02:55:12.836 WARNING:teuthology.provision.fog.smithi124:timed out 2023-08-08T02:55:18.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:55:19.161 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T02:55:19.161 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T02:55:19.453 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-08-08T02:55:19.453 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-08-08T02:55:19.514 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124 2023-08-08T02:55:19.514 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124 /etc/hosts 2023-08-08T02:55:19.575 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-08-08T02:55:19.576 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-08-08T02:55:19.700 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124/smithi124/g' /etc/hosts 2023-08-08T02:55:19.727 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-08-08T02:55:19.798 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124/smithi124/g' /etc/hostname 2023-08-08T02:55:19.868 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-08-08T02:55:19.937 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-08-08T02:55:19.997 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-08-08T02:55:19.997 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)" 2023-08-08T02:55:19.997 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-08-08T02:55:19.997 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-08-08T02:55:19.998 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6" 2023-08-08T02:55:19.998 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-08-08T02:55:19.998 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-08T02:55:19.998 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-08-08T02:55:19.998 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-08T02:55:19.998 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-08-08T02:55:19.998 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-08T02:55:19.999 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T02:55:19.999 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-08-08T02:55:19.999 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T02:55:19.999 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-08T02:55:19.999 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-08T02:55:19.999 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-08T02:55:19.999 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-08-08T02:55:20.000 DEBUG:teuthology.parallel:result is None 2023-08-08T02:56:00.624 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-08T02:56:00.625 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi023 2023-08-08T02:56:09.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-08-08T02:56:09.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:56:09.957 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-08-08T02:56:10.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-08-08T02:56:10.256 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T02:56:10.256 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T02:56:10.273 INFO:teuthology.provision.fog.smithi023:Node is ready 2023-08-08T02:56:10.273 DEBUG:teuthology.orchestra.run.smithi023:> hostname 2023-08-08T02:56:10.331 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2023-08-08T02:56:10.331 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts 2023-08-08T02:56:10.389 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2023-08-08T02:56:10.390 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-08-08T02:56:10.510 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts 2023-08-08T02:56:10.539 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts 2023-08-08T02:56:10.608 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname 2023-08-08T02:56:10.676 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-08-08T02:56:10.743 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-08-08T02:56:10.800 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Red Hat Enterprise Linux" 2023-08-08T02:56:10.800 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8.6 (Ootpa)" 2023-08-08T02:56:10.800 INFO:teuthology.orchestra.run.smithi023.stdout:ID="rhel" 2023-08-08T02:56:10.800 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="fedora" 2023-08-08T02:56:10.800 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8.6" 2023-08-08T02:56:10.801 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8" 2023-08-08T02:56:10.801 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-08T02:56:10.801 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2023-08-08T02:56:10.801 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-08T02:56:10.801 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.redhat.com/" 2023-08-08T02:56:10.801 INFO:teuthology.orchestra.run.smithi023.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-08T02:56:10.801 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T02:56:10.802 INFO:teuthology.orchestra.run.smithi023.stdout: 2023-08-08T02:56:10.802 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T02:56:10.802 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-08T02:56:10.802 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-08T02:56:10.802 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-08T02:56:10.802 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2023-08-08T02:56:10.803 DEBUG:teuthology.parallel:result is None 2023-08-08T02:56:10.977 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2023-08-08T02:56:10.978 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T02:56:10.997 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2023-08-08T02:56:10.998 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T02:56:11.014 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2023-08-08T02:56:11.015 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T02:56:11.040 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2023-08-08T02:56:11.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-08-08T02:56:11.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:56:11.106 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-08-08T02:56:11.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-08-08T02:56:11.173 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2023-08-08T02:56:11.229 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2023-08-08T02:56:11.230 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-08-08T02:56:11.287 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Red Hat Enterprise Linux" 2023-08-08T02:56:11.288 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8.6 (Ootpa)" 2023-08-08T02:56:11.288 INFO:teuthology.orchestra.run.smithi023.stdout:ID="rhel" 2023-08-08T02:56:11.288 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="fedora" 2023-08-08T02:56:11.288 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8.6" 2023-08-08T02:56:11.289 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8" 2023-08-08T02:56:11.289 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-08T02:56:11.290 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2023-08-08T02:56:11.290 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-08T02:56:11.290 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.redhat.com/" 2023-08-08T02:56:11.291 INFO:teuthology.orchestra.run.smithi023.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-08T02:56:11.291 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T02:56:11.291 INFO:teuthology.orchestra.run.smithi023.stdout: 2023-08-08T02:56:11.292 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T02:56:11.292 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-08T02:56:11.292 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-08T02:56:11.293 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-08T02:56:11.293 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-08-08T02:56:11.314 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2023-08-08T02:56:11.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-08-08T02:56:11.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:56:11.381 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-08-08T02:56:11.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-08-08T02:56:11.510 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-08-08T02:56:11.567 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-08-08T02:56:11.567 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-08-08T02:56:11.624 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2023-08-08T02:56:11.625 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2023-08-08T02:56:11.625 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2023-08-08T02:56:11.625 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2023-08-08T02:56:11.625 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2023-08-08T02:56:11.625 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-08-08T02:56:11.625 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-08T02:56:11.625 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-08-08T02:56:11.626 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-08T02:56:11.626 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2023-08-08T02:56:11.626 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-08T02:56:11.626 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T02:56:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-08-08T02:56:11.626 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T02:56:11.626 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-08T02:56:11.627 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-08T02:56:11.627 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-08T02:56:11.627 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-08-08T02:56:11.647 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2023-08-08T02:56:11.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-08-08T02:56:11.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T02:56:11.713 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-08-08T02:56:11.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-08-08T02:56:11.802 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-08-08T02:56:11.860 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-08-08T02:56:11.860 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-08-08T02:56:11.918 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-08-08T02:56:11.918 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)" 2023-08-08T02:56:11.919 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-08-08T02:56:11.919 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-08-08T02:56:11.919 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6" 2023-08-08T02:56:11.919 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-08-08T02:56:11.920 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-08T02:56:11.920 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-08-08T02:56:11.920 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-08T02:56:11.920 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-08-08T02:56:11.921 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-08T02:56:11.921 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T02:56:11.921 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-08-08T02:56:11.921 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T02:56:11.922 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-08T02:56:11.922 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-08T02:56:11.922 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-08T02:56:11.923 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-08-08T02:56:11.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T02:56:12.054 INFO:teuthology.dispatcher.supervisor:Running job 7361228 2023-08-08T02:56:12.054 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361228 --name rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} -- /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361228/orig.config.yaml 2023-08-08T02:56:12.058 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361228 2023-08-08T02:56:12.059 INFO:teuthology.dispatcher.supervisor:Job PID: 3295 2023-08-08T02:56:12.059 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-08T02:58:12.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:00:12.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:02:12.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:04:12.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:06:12.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:08:12.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:10:13.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:12:13.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:14:13.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:16:13.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:18:13.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:20:13.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:22:14.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:24:14.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:26:14.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:28:14.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:30:14.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:32:14.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:34:15.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:36:15.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:38:15.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T03:38:15.451 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-08T03:38:15.617 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-08T03:38:15.618 INFO:teuthology.nuke:Checking targets against current locks 2023-08-08T03:38:15.666 DEBUG:teuthology.nuke:shortname: smithi023 2023-08-08T03:38:15.667 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T03:38:15.693 DEBUG:teuthology.nuke:shortname: smithi079 2023-08-08T03:38:15.693 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T03:38:15.696 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi023.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 02:50:10.070356', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-08T03:38:15.717 DEBUG:teuthology.nuke:shortname: smithi124 2023-08-08T03:38:15.717 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T03:38:15.722 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 02:50:10.067661', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-08T03:38:15.752 INFO:teuthology.orchestra.console.smithi023:Power off 2023-08-08T03:38:15.753 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T03:38:15.772 INFO:teuthology.orchestra.console.smithi079:Power off 2023-08-08T03:38:15.773 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T03:38:15.784 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 02:50:10.069160', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-08T03:38:15.789 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2023-08-08T03:38:15.789 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T03:38:15.800 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-08-08T03:38:15.801 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T03:38:15.814 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-08-08T03:38:15.822 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-08T03:38:15.841 INFO:teuthology.orchestra.console.smithi124:Power off 2023-08-08T03:38:15.841 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T03:38:15.864 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-08-08T03:38:15.865 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T03:38:15.888 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-08-08T03:38:15.915 INFO:teuthology.orchestra.console.smithi023:Power off completed 2023-08-08T03:38:15.923 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-08-08T03:38:15.990 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-08-08T03:38:16.066 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com 2023-08-08T03:38:16.075 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2023-08-08T03:38:16.132 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com