2023-11-15T11:56:57.251 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-15T11:56:57.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T11:56:57.387 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f20496a4670>, signals=[15]) 2023-11-15T11:56:57.389 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2023-11-15T11:56:57.389 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T11:56:57.389 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-11-15T11:56:57.414 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-11-15T11:56:57.415 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T11:56:57.415 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-11-15T11:56:57.416 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"} 2023-11-15T11:56:57.439 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-11-15T11:56:57.496 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-15T11:56:57.507 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-15T11:56:57.536 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-15T11:56:57.536 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 5} 2023-11-15T11:56:57.554 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-15T11:56:57.555 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5} 2023-11-15T11:56:57.583 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of rhel 8.6 2023-11-15T11:56:57.583 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T11:56:57.615 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-11-15T11:56:57.615 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T11:56:57.630 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T11:56:57.667 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1} 2023-11-15T11:56:57.671 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T11:56:57.706 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-11-15T11:56:57.797 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T11:56:57.809 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T11:56:57.886 INFO:teuthology.orchestra.console.smithi103:Power off 2023-11-15T11:56:57.887 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T11:56:57.901 INFO:teuthology.orchestra.console.smithi140:Power off 2023-11-15T11:56:57.902 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T11:56:57.911 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-11-15T11:56:57.912 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T11:56:57.923 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-11-15T11:56:57.924 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T11:56:57.933 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-11-15T11:56:57.946 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-11-15T11:57:01.938 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T11:57:01.947 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T11:57:02.049 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-11-15T11:57:02.056 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-11-15T11:57:06.053 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T11:57:06.060 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T11:57:06.162 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-11-15T11:57:06.169 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-11-15T11:57:06.265 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-11-15T11:57:06.366 INFO:teuthology.orchestra.console.smithi103:Power on 2023-11-15T11:57:06.366 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T11:57:06.389 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2023-11-15T11:57:06.390 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T11:57:06.415 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-11-15T11:57:10.172 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T11:57:10.282 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-11-15T11:57:10.383 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-11-15T11:57:10.416 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T11:57:10.484 INFO:teuthology.orchestra.console.smithi140:Power on 2023-11-15T11:57:10.485 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T11:57:10.507 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-11-15T11:57:10.507 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T11:57:10.526 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-11-15T11:57:10.535 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-11-15T11:57:14.530 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T11:57:14.537 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T11:57:14.640 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-11-15T11:57:14.647 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-11-15T11:57:14.741 INFO:teuthology.orchestra.console.smithi103:Power on completed 2023-11-15T11:57:14.749 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-11-15T11:57:14.842 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2023-11-15T11:57:14.843 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T11:57:14.850 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-11-15T11:57:14.850 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T11:57:29.918 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T11:57:29.920 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T11:57:44.997 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T11:57:44.999 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T11:58:00.062 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T11:58:00.064 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T11:58:15.140 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T11:58:15.142 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T11:58:30.210 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T11:58:30.212 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T11:58:45.278 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T11:58:45.280 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T11:59:00.347 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T11:59:00.348 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T11:59:15.423 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T11:59:15.425 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T11:59:30.518 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T11:59:30.520 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T11:59:45.600 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T11:59:45.602 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T12:00:00.684 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T12:00:00.686 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-11-15T12:00:00.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:00:03.838 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:00:09.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:00:12.922 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:00:15.762 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-15T12:00:15.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:00:18.906 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-15T12:00:18.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:00:21.978 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:00:24.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:00:27.966 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-15T12:00:27.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:00:31.034 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:00:33.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:00:37.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:00:37.050 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-15T12:00:40.094 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:00:43.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:00:46.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:00:46.131 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-15T12:00:49.182 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:00:52.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:00:55.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:00:55.194 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-15T12:00:58.266 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:01:01.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:01:04.250 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-15T12:01:04.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:01:10.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:01:13.306 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-15T12:01:19.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:02:04.315 WARNING:teuthology.provision.fog.smithi140:timed out 2023-11-15T12:02:10.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:02:13.405 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:02:19.318 WARNING:teuthology.provision.fog.smithi103:timed out 2023-11-15T12:02:19.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:02:22.458 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:02:25.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:02:25.644 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T12:02:25.645 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T12:02:25.941 INFO:teuthology.provision.fog.smithi103:Node is ready 2023-11-15T12:02:25.941 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2023-11-15T12:02:25.959 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2023-11-15T12:02:25.959 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2023-11-15T12:02:26.016 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2023-11-15T12:02:26.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-11-15T12:02:26.133 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2023-11-15T12:02:26.161 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2023-11-15T12:02:26.229 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2023-11-15T12:02:26.296 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-11-15T12:02:26.362 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-11-15T12:02:26.419 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Red Hat Enterprise Linux" 2023-11-15T12:02:26.419 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8.6 (Ootpa)" 2023-11-15T12:02:26.419 INFO:teuthology.orchestra.run.smithi103.stdout:ID="rhel" 2023-11-15T12:02:26.419 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="fedora" 2023-11-15T12:02:26.420 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8.6" 2023-11-15T12:02:26.420 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-11-15T12:02:26.420 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-15T12:02:26.420 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-11-15T12:02:26.420 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-15T12:02:26.421 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.redhat.com/" 2023-11-15T12:02:26.421 INFO:teuthology.orchestra.run.smithi103.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-15T12:02:26.421 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T12:02:26.421 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-11-15T12:02:26.421 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T12:02:26.422 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-15T12:02:26.423 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-15T12:02:26.423 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-15T12:02:26.424 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2023-11-15T12:02:26.426 DEBUG:teuthology.parallel:result is None 2023-11-15T12:02:28.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:02:31.514 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:02:37.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:02:40.602 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:02:46.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:02:49.690 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:02:55.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:02:58.782 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:03:04.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:03:07.870 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:03:13.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:03:16.957 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:03:22.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:03:26.042 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:03:32.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:03:35.098 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:03:41.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:03:44.154 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:03:50.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:03:53.210 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:03:59.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:04:02.270 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:04:08.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:04:11.354 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:04:17.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:04:20.413 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:04:26.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:04:29.502 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:04:35.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:04:38.590 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:04:44.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:04:47.678 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:04:53.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:04:56.762 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:05:02.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:05:05.818 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:05:11.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:05:14.906 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:05:20.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:05:23.962 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:05:29.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:05:33.050 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:05:39.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:05:42.110 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:05:48.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:05:51.194 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:05:57.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:06:00.253 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:06:06.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:06:09.341 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:06:15.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:06:18.426 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:06:24.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:06:27.483 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:06:33.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:06:36.570 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:06:42.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:06:45.630 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:06:51.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:06:54.714 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:07:00.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:07:03.802 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:07:09.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:07:12.862 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:07:18.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:07:21.946 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:07:27.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:07:31.002 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:07:37.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:07:40.058 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:07:46.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:07:49.114 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:07:55.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:07:58.174 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:08:04.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:08:07.265 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:08:13.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:08:16.346 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:08:22.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:08:25.402 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:08:31.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:08:34.458 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:08:40.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:08:43.546 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:08:49.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:08:52.602 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:08:58.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:09:01.658 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:09:07.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:09:10.716 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:09:16.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:09:19.802 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:09:25.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:09:28.858 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:09:34.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:09:37.950 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:09:43.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:09:47.034 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:09:53.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:09:56.090 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:10:02.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:10:05.146 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:10:11.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:10:14.202 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:10:20.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:10:23.258 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:10:29.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:10:32.346 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:10:38.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:10:41.402 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:10:47.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:10:50.462 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:10:56.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:10:59.546 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:11:05.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:11:08.602 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:11:14.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:11:17.690 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:11:23.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:11:26.746 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:11:32.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:11:35.834 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:11:41.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:11:44.922 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:11:50.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:11:54.014 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:12:00.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:12:03.102 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:12:09.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:12:12.190 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:12:18.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:12:21.279 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:12:27.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:12:30.362 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:12:36.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:12:39.422 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:12:45.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:12:48.506 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:12:54.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:12:57.562 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:13:03.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:13:06.622 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:13:12.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:13:15.710 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:13:21.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:13:24.794 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:13:30.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:13:33.850 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:13:39.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:13:42.942 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:13:48.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:13:52.030 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:13:58.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:14:01.114 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:14:07.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:14:10.206 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:14:16.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:14:19.290 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:14:25.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:14:28.346 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:14:34.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:14:37.402 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:14:43.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:14:46.490 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:14:52.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:14:55.582 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:15:01.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:15:04.666 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:15:10.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:15:13.726 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:15:19.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:15:22.810 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:15:28.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:15:31.866 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:15:37.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:15:40.922 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:15:46.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:15:50.010 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:15:56.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T12:15:59.070 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-11-15T12:15:59.072 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-11-15T12:15:59.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T12:15:59.220 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2fc43ce71b554fe58f365c382639153c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-11-15T12:15:59.224 INFO:teuthology.nuke:Checking targets against current locks 2023-11-15T12:15:59.292 DEBUG:teuthology.nuke:shortname: smithi103 2023-11-15T12:15:59.293 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T12:15:59.315 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-15_09:32:33-fs-wip-vshankar-testing2-2023-11-15-1128-reef-testing-default-smithi/7458973', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 11:56:56.391972', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKPFLYuRrrU2yfW83XcuL9PXWK9UrXTCJ1urNfPasIDHkMw0awg8BKd7LzB47mTj5mxiqld+Z9CaCm7ZH32hpgM='} 2023-11-15T12:15:59.319 DEBUG:teuthology.nuke:shortname: smithi140 2023-11-15T12:15:59.319 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T12:15:59.339 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-15_09:32:33-fs-wip-vshankar-testing2-2023-11-15-1128-reef-testing-default-smithi/7458973', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 11:56:56.393895', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOoxrL42Ldn1b7w3iJhhuGkGIJJ4s2hD57LP+UXbkWmE8JIYABXlhqpeuiNBPPrQHuPT9E7NH56WyGFLGedXzlw='} 2023-11-15T12:15:59.373 INFO:teuthology.orchestra.console.smithi103:Power off 2023-11-15T12:15:59.374 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T12:15:59.397 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-11-15T12:15:59.398 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T12:15:59.415 INFO:teuthology.orchestra.console.smithi140:Power off 2023-11-15T12:15:59.415 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T12:15:59.425 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-11-15T12:15:59.440 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-11-15T12:15:59.440 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T12:15:59.466 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-11-15T12:16:03.430 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T12:16:03.467 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T12:16:03.539 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-11-15T12:16:03.579 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-11-15T12:16:07.542 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T12:16:07.581 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T12:16:07.652 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-11-15T12:16:07.692 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-11-15T12:16:07.792 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-11-15T12:16:07.941 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-11-15T12:16:11.654 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T12:16:11.764 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-11-15T12:16:11.865 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-11-15T12:16:12.014 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com 2023-11-15T12:16:12.244 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds