2023-09-13T07:54:23.234 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-13T07:54:23.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T07:54:23.425 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe9cbea1ca0>, signals=[15]) 2023-09-13T07:54:23.428 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging 2023-09-13T07:54:23.428 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server 2023-09-13T07:54:23.428 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-09-13T07:54:23.450 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2023-09-13T07:54:23.451 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2023-09-13T07:54:23.451 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-09-13T07:54:23.453 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /host {"name": "smithi050"} 2023-09-13T07:54:23.475 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-09-13T07:54:23.476 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-09-13T07:54:23.476 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-09-13T07:54:23.477 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /host {"name": "smithi083"} 2023-09-13T07:54:23.501 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-09-13T07:54:23.529 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-13T07:54:23.554 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-13T07:54:23.572 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-13T07:54:23.572 DEBUG:teuthology.provision.fog.smithi050:FOG request: PUT /host/155 {"imageID": 5} 2023-09-13T07:54:23.579 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-13T07:54:23.594 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-13T07:54:23.595 DEBUG:teuthology.provision.fog.smithi083:FOG request: PUT /host/188 {"imageID": 5} 2023-09-13T07:54:23.617 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-13T07:54:23.618 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5} 2023-09-13T07:54:23.630 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of rhel 8.6 2023-09-13T07:54:23.630 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-09-13T07:54:23.643 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of rhel 8.6 2023-09-13T07:54:23.643 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:54:23.660 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-09-13T07:54:23.660 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:54:23.676 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /tasktype {"name": "deploy"} 2023-09-13T07:54:23.694 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /tasktype {"name": "deploy"} 2023-09-13T07:54:23.709 DEBUG:teuthology.provision.fog.smithi050:FOG request: POST /host/155/task {"taskTypeID": 1} 2023-09-13T07:54:23.725 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-09-13T07:54:23.735 DEBUG:teuthology.provision.fog.smithi083:FOG request: POST /host/188/task {"taskTypeID": 1} 2023-09-13T07:54:23.766 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-09-13T07:54:23.783 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-09-13T07:54:23.805 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:54:23.819 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:54:23.869 INFO:teuthology.orchestra.console.smithi050:Power off 2023-09-13T07:54:23.870 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T07:54:23.916 INFO:teuthology.orchestra.console.smithi083:Power off 2023-09-13T07:54:23.917 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T07:54:23.954 INFO:teuthology.orchestra.console.smithi140:Power off 2023-09-13T07:54:23.955 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T07:54:23.964 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-09-13T07:54:23.964 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T07:54:23.972 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-09-13T07:54:23.974 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T07:54:23.984 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-09-13T07:54:23.984 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T07:54:23.993 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-09-13T07:54:23.995 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-09-13T07:54:24.009 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-13T07:54:24.096 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-09-13T07:54:24.111 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-09-13T07:54:24.198 INFO:teuthology.orchestra.console.smithi050:Power on 2023-09-13T07:54:24.198 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-13T07:54:24.212 INFO:teuthology.orchestra.console.smithi140:Power on 2023-09-13T07:54:24.213 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-13T07:54:24.222 DEBUG:teuthology.orchestra.console.smithi050:power on output: Chassis Power Control: Up/On 2023-09-13T07:54:24.222 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T07:54:24.234 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-09-13T07:54:24.235 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T07:54:24.244 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-09-13T07:54:24.255 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-13T07:54:27.998 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T07:54:28.106 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-09-13T07:54:28.245 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T07:54:28.257 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T07:54:28.354 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-09-13T07:54:28.365 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-13T07:54:28.455 INFO:teuthology.orchestra.console.smithi050:Power on completed 2023-09-13T07:54:28.467 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-09-13T07:54:28.556 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2023-09-13T07:54:28.557 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-09-13T07:54:28.568 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-09-13T07:54:28.569 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:54:32.110 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T07:54:32.224 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-09-13T07:54:36.229 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T07:54:36.338 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-09-13T07:54:36.439 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-09-13T07:54:36.540 INFO:teuthology.orchestra.console.smithi083:Power on 2023-09-13T07:54:36.540 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-13T07:54:36.565 DEBUG:teuthology.orchestra.console.smithi083:power on output: Chassis Power Control: Up/On 2023-09-13T07:54:36.566 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T07:54:36.586 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-09-13T07:54:40.591 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T07:54:40.700 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-09-13T07:54:43.622 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-09-13T07:54:43.627 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:54:44.702 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T07:54:44.811 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-09-13T07:54:44.912 INFO:teuthology.orchestra.console.smithi083:Power on completed 2023-09-13T07:54:45.013 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2023-09-13T07:54:45.013 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:54:58.707 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:54:58.709 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-09-13T07:55:00.077 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:55:13.786 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:55:13.787 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-09-13T07:55:15.160 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:55:28.862 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-09-13T07:55:28.864 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:55:30.236 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:55:43.942 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-09-13T07:55:43.944 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:55:45.298 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:55:59.032 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-09-13T07:55:59.033 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:56:00.370 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:56:14.114 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-09-13T07:56:14.115 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:56:15.584 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:56:29.206 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:56:29.208 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-09-13T07:56:30.660 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:56:44.298 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-09-13T07:56:44.300 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:56:45.728 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:56:59.390 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:56:59.391 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-09-13T07:56:59.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:56:59.596 ERROR:teuthology.orchestra.connection:Error authenticating with smithi050.front.sepia.ceph.com: Authentication failed. 2023-09-13T07:56:59.598 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-13T07:56:59.599 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-13T07:56:59.600 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-13T07:57:00.809 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:57:14.469 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T07:57:14.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:57:15.905 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:57:30.973 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-13T07:57:31.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:57:32.954 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T07:57:34.106 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-09-13T07:57:38.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:57:40.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:57:42.010 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T07:57:43.166 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-09-13T07:57:48.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:57:49.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:57:51.066 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T07:57:52.250 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-09-13T07:57:57.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:57:58.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:58:00.122 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T07:58:01.310 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-09-13T07:58:06.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:58:07.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:58:09.178 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T07:58:10.366 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-09-13T07:58:15.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:58:16.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:58:18.234 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T07:58:19.418 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-09-13T07:58:24.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:58:25.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:58:50.782 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-09-13T07:58:50.784 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi050 2023-09-13T07:58:59.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-09-13T07:58:59.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:59:00.126 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-09-13T07:59:00.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-09-13T07:59:00.389 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-13T07:59:00.389 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-13T07:59:00.410 INFO:teuthology.provision.fog.smithi050:Node is ready 2023-09-13T07:59:00.410 DEBUG:teuthology.orchestra.run.smithi050:> hostname 2023-09-13T07:59:00.467 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2023-09-13T07:59:00.468 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts 2023-09-13T07:59:00.525 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2023-09-13T07:59:00.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-09-13T07:59:00.656 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts 2023-09-13T07:59:00.685 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts 2023-09-13T07:59:00.753 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname 2023-09-13T07:59:00.822 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-09-13T07:59:00.889 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-09-13T07:59:00.945 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T07:59:00.946 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T07:59:00.946 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel" 2023-09-13T07:59:00.946 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora" 2023-09-13T07:59:00.946 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.6" 2023-09-13T07:59:00.947 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2023-09-13T07:59:00.947 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T07:59:00.947 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-09-13T07:59:00.947 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T07:59:00.947 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T07:59:00.948 INFO:teuthology.orchestra.run.smithi050.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T07:59:00.948 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T07:59:00.948 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-09-13T07:59:00.948 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T07:59:00.948 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T07:59:00.949 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T07:59:00.949 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T07:59:00.949 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2023-09-13T07:59:00.951 DEBUG:teuthology.parallel:result is None 2023-09-13T07:59:24.258 WARNING:teuthology.provision.fog.smithi140:timed out 2023-09-13T07:59:25.423 WARNING:teuthology.provision.fog.smithi083:timed out 2023-09-13T07:59:30.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:59:31.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:59:31.792 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-13T07:59:31.793 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-13T07:59:32.097 INFO:teuthology.provision.fog.smithi083:Node is ready 2023-09-13T07:59:32.097 DEBUG:teuthology.orchestra.run.smithi083:> hostname 2023-09-13T07:59:32.115 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083 2023-09-13T07:59:32.116 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083 /etc/hosts 2023-09-13T07:59:32.180 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2023-09-13T07:59:32.181 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-09-13T07:59:32.317 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083/smithi083/g' /etc/hosts 2023-09-13T07:59:32.345 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts 2023-09-13T07:59:32.416 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083/smithi083/g' /etc/hostname 2023-09-13T07:59:32.487 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-09-13T07:59:32.556 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-09-13T07:59:32.618 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T07:59:32.618 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T07:59:32.619 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-09-13T07:59:32.619 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-09-13T07:59:32.619 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2023-09-13T07:59:32.620 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-09-13T07:59:32.620 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T07:59:32.620 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-09-13T07:59:32.620 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T07:59:32.621 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T07:59:32.621 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T07:59:32.621 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T07:59:32.622 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-13T07:59:32.622 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T07:59:32.622 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T07:59:32.622 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T07:59:32.622 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T07:59:32.623 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2023-09-13T07:59:32.623 DEBUG:teuthology.parallel:result is None 2023-09-13T07:59:48.634 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T07:59:54.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T07:59:57.690 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:00:03.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:00:06.750 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:00:12.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:00:15.838 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:00:21.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:00:24.922 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:00:30.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:00:33.982 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:00:39.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:00:43.070 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:00:49.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:00:52.154 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:00:58.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:01:01.214 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:01:07.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:01:10.302 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:01:16.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:01:19.390 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:01:25.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:01:28.474 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:01:34.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:01:37.530 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:01:43.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:01:46.622 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:01:52.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:01:55.710 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:02:01.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:02:04.794 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:02:10.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:02:13.850 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:02:19.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:02:22.938 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:02:28.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:02:32.026 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:02:38.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:02:41.082 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:02:47.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:02:50.142 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:02:56.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:02:59.230 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:03:05.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:03:08.314 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:03:14.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:03:17.406 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:03:23.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:03:26.490 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:03:32.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:03:35.578 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:03:41.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:03:44.634 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:03:50.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:03:53.694 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:03:59.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:04:02.782 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:04:08.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:04:11.866 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:04:17.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:04:20.926 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:04:26.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:04:30.010 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:04:36.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:04:39.066 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:04:45.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:04:48.126 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:04:54.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:04:57.210 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:05:03.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:05:06.266 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:05:12.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:05:15.354 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:05:21.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:05:24.410 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:05:30.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:05:33.470 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:05:39.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:05:42.558 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:05:48.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:05:51.646 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:05:57.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:06:00.730 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:06:06.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:06:09.786 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:06:15.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:06:18.842 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:06:24.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:06:27.934 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:06:33.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:06:37.022 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:06:43.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:06:46.110 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:06:52.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:06:55.194 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:07:01.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:07:04.250 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:07:10.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:07:13.306 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:07:19.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:07:22.394 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:07:28.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:07:31.454 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:07:37.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:07:40.538 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:07:46.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:07:49.598 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:07:55.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:07:58.682 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:08:04.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:08:07.738 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:08:13.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:08:16.798 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:08:22.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:08:25.886 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:08:31.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:08:34.970 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:08:40.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:08:44.030 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:08:50.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:08:53.118 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:08:59.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:09:02.202 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:09:08.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:09:11.258 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:09:17.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:09:20.346 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:09:26.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:09:29.402 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:09:35.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:09:38.458 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:09:44.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:09:47.514 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:09:53.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:09:56.602 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:10:02.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:10:05.658 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:10:11.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:10:14.750 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:10:20.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:10:23.834 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:10:29.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:10:32.890 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:10:38.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:10:41.946 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:10:47.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:10:51.002 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:10:57.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:11:00.058 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:11:06.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:11:09.150 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:11:15.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:11:18.238 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:11:24.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:11:27.322 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:11:33.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:11:36.410 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:11:42.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:11:45.466 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:11:51.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:11:54.522 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:12:00.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:12:03.610 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:12:09.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:12:12.666 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:12:18.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:12:21.722 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:12:27.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:12:30.778 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:12:36.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:12:39.834 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:12:45.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:12:48.894 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:12:54.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:12:57.982 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:13:03.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:13:07.070 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:13:13.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:13:16.154 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:13:22.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:13:25.210 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:13:31.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:13:34.266 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:13:40.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:13:43.322 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-13T08:13:43.325 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-09-13T08:13:43.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T08:13:45.031 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=0e7a68f5e0b14022a8fa8278876c61dd Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-09-13T08:13:45.045 INFO:teuthology.nuke:Checking targets against current locks 2023-09-13T08:13:45.121 DEBUG:teuthology.nuke:shortname: smithi050 2023-09-13T08:13:45.122 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T08:13:45.140 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394872', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 07:54:22.044354', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMaTFWrXuC4JylWGZa7L4MF9luh+dbrU4uWP0Zu7swEZEGR5U+qplZDY0hOfpliqkHnXxg7LT8cXXRl1NHwv0Ss='} 2023-09-13T08:13:45.145 DEBUG:teuthology.nuke:shortname: smithi083 2023-09-13T08:13:45.146 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T08:13:45.168 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394872', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 07:54:22.042873', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN39V6v3KhsF3y7V7ymNLip8COwtkQtX73jUht2szuSE9QEXDp9zgj3GyUTlt2L+uXbtE9RXPFgKzy1AxC2Fzqw='} 2023-09-13T08:13:45.175 DEBUG:teuthology.nuke:shortname: smithi140 2023-09-13T08:13:45.175 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T08:13:45.195 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394872', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 07:54:22.045641', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlwyKd0gGULW9IL+floRUvZlus/YSDte8iDB6UINn9DSRbi+spzm/6vVvJQNxrQZQUDSWbaf+BRJHwTpybwaZc='} 2023-09-13T08:13:45.205 INFO:teuthology.orchestra.console.smithi050:Power off 2023-09-13T08:13:45.206 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T08:13:45.231 INFO:teuthology.orchestra.console.smithi083:Power off 2023-09-13T08:13:45.232 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T08:13:45.247 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-09-13T08:13:45.247 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T08:13:45.260 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-09-13T08:13:45.263 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T08:13:45.282 INFO:teuthology.orchestra.console.smithi140:Power off 2023-09-13T08:13:45.282 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T08:13:45.293 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-09-13T08:13:45.294 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-09-13T08:13:45.311 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-09-13T08:13:45.312 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T08:13:45.337 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-13T08:13:49.299 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T08:13:49.306 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T08:13:49.339 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T08:13:49.408 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-09-13T08:13:49.415 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-09-13T08:13:49.449 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-13T08:13:53.414 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T08:13:53.423 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T08:13:53.451 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T08:13:53.525 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-09-13T08:13:53.533 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-09-13T08:13:53.561 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-13T08:13:53.627 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-09-13T08:13:53.634 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-09-13T08:13:53.784 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2023-09-13T08:13:53.792 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2023-09-13T08:13:57.566 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T08:13:57.676 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-13T08:13:57.777 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-09-13T08:13:57.933 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-09-13T08:13:58.306 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds