2023-09-13T23:57:35.505 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-13T23:57:35.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T23:57:35.642 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5f64ff8670>, signals=[15]) 2023-09-13T23:57:35.643 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging 2023-09-13T23:57:35.644 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server 2023-09-13T23:57:35.644 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-09-13T23:57:35.668 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-09-13T23:57:35.668 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-09-13T23:57:35.669 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-09-13T23:57:35.670 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /host {"name": "smithi134"} 2023-09-13T23:57:35.693 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-09-13T23:57:35.740 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-13T23:57:35.757 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-13T23:57:35.797 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-13T23:57:35.798 DEBUG:teuthology.provision.fog.smithi134:FOG request: PUT /host/239 {"imageID": 5} 2023-09-13T23:57:35.813 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-13T23:57:35.813 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5} 2023-09-13T23:57:35.858 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of rhel 8.6 2023-09-13T23:57:35.858 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-13T23:57:35.867 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-09-13T23:57:35.867 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T23:57:35.933 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /tasktype {"name": "deploy"} 2023-09-13T23:57:35.937 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-09-13T23:57:35.972 DEBUG:teuthology.provision.fog.smithi134:FOG request: POST /host/239/task {"taskTypeID": 1} 2023-09-13T23:57:35.975 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-09-13T23:57:36.120 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-13T23:57:36.124 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T23:57:36.229 INFO:teuthology.orchestra.console.smithi140:Power off 2023-09-13T23:57:36.230 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T23:57:36.242 INFO:teuthology.orchestra.console.smithi134:Power off 2023-09-13T23:57:36.243 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T23:57:36.252 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-09-13T23:57:36.253 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T23:57:36.264 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-09-13T23:57:36.265 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T23:57:36.272 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-13T23:57:36.284 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-09-13T23:57:36.374 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-09-13T23:57:36.385 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-09-13T23:57:36.475 INFO:teuthology.orchestra.console.smithi140:Power on 2023-09-13T23:57:36.475 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-13T23:57:36.486 INFO:teuthology.orchestra.console.smithi134:Power on 2023-09-13T23:57:36.487 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-13T23:57:36.496 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-09-13T23:57:36.496 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T23:57:36.510 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On 2023-09-13T23:57:36.511 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T23:57:36.518 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-13T23:57:36.531 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-09-13T23:57:40.522 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T23:57:40.532 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T23:57:40.631 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-13T23:57:40.640 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-09-13T23:57:40.741 INFO:teuthology.orchestra.console.smithi134:Power on completed 2023-09-13T23:57:40.842 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2023-09-13T23:57:40.842 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-13T23:57:44.634 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T23:57:44.744 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-13T23:57:44.845 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-09-13T23:57:44.945 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-09-13T23:57:44.946 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T23:57:55.924 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-13T23:58:00.016 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T23:58:11.009 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-13T23:58:15.106 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T23:58:26.108 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-13T23:58:30.190 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T23:58:41.206 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-13T23:58:45.283 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T23:58:56.290 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-13T23:59:00.362 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T23:59:11.368 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-13T23:59:15.431 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T23:59:26.450 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-13T23:59:30.506 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T23:59:41.528 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-13T23:59:45.578 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-13T23:59:56.613 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-14T00:00:00.651 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-14T00:00:11.685 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-14T00:00:15.726 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-14T00:00:26.762 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-09-14T00:00:26.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:00:30.800 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-14T00:00:30.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:00:45.210 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-09-14T00:00:49.306 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:00:51.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:00:54.270 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-09-14T00:00:55.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:00:58.362 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:01:00.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:01:03.354 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-09-14T00:01:04.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:01:07.418 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:01:09.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:01:12.410 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-09-14T00:01:13.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:01:16.478 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:01:18.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:01:22.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:01:25.566 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:01:31.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:01:34.650 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:01:40.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:02:18.454 WARNING:teuthology.provision.fog.smithi134:timed out 2023-09-14T00:02:24.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:02:24.710 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-14T00:02:24.711 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-14T00:02:24.995 INFO:teuthology.provision.fog.smithi134:Node is ready 2023-09-14T00:02:24.996 DEBUG:teuthology.orchestra.run.smithi134:> hostname 2023-09-14T00:02:25.013 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2023-09-14T00:02:25.013 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts 2023-09-14T00:02:25.074 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2023-09-14T00:02:25.075 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-09-14T00:02:25.180 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts 2023-09-14T00:02:25.208 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts 2023-09-14T00:02:25.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname 2023-09-14T00:02:25.348 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-09-14T00:02:25.417 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-09-14T00:02:25.476 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux" 2023-09-14T00:02:25.477 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.6 (Ootpa)" 2023-09-14T00:02:25.477 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2023-09-14T00:02:25.477 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2023-09-14T00:02:25.477 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.6" 2023-09-14T00:02:25.478 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-09-14T00:02:25.478 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-14T00:02:25.478 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-09-14T00:02:25.478 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-14T00:02:25.478 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2023-09-14T00:02:25.479 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-14T00:02:25.479 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-14T00:02:25.479 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-14T00:02:25.479 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-14T00:02:25.479 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-14T00:02:25.480 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-14T00:02:25.480 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-14T00:02:25.481 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2023-09-14T00:02:25.482 DEBUG:teuthology.parallel:result is None 2023-09-14T00:02:40.673 WARNING:teuthology.provision.fog.smithi140:timed out 2023-09-14T00:02:46.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:03:05.242 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:03:11.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:03:14.330 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:03:20.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:03:23.386 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:03:29.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:03:32.477 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:03:38.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:03:41.562 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:03:47.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:03:50.618 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:03:56.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:03:59.674 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:04:05.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:04:08.730 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:04:14.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:04:17.790 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:04:23.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:04:26.874 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:04:32.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:04:35.930 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:04:41.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:04:44.990 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:04:50.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:04:54.074 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:05:00.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:05:03.162 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:05:09.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:05:12.222 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:05:18.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:05:21.306 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:05:27.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:05:30.362 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:05:36.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:05:39.418 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:05:45.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:05:48.474 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:05:54.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:05:57.530 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:06:03.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:06:06.589 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:06:12.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:06:15.674 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:06:21.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:06:24.734 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:06:30.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:06:33.822 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:06:39.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:06:42.906 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:06:48.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:06:51.994 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:06:57.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:07:01.050 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:07:07.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:07:10.110 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:07:16.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:07:19.194 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:07:25.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:07:28.250 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:07:34.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:07:37.308 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:07:43.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:07:46.394 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:07:52.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:07:55.450 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:08:01.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:08:04.506 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:08:10.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:08:13.562 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:08:19.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:08:22.618 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:08:28.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:08:31.674 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:08:37.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:08:40.730 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:08:46.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:08:49.786 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:08:55.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:08:58.842 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:09:04.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:09:07.934 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:09:13.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:09:17.022 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:09:23.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:09:26.106 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:09:32.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:09:35.162 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:09:41.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:09:44.254 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:09:50.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:09:53.338 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:09:59.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:10:02.398 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:10:08.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:10:11.482 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:10:17.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:10:20.542 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:10:26.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:10:29.626 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:10:35.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:10:38.682 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:10:44.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:10:47.742 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:10:53.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:10:56.922 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:11:02.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:11:05.978 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:11:11.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:11:15.037 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:11:21.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:11:24.126 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:11:30.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:11:33.210 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:11:39.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:11:42.270 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:11:48.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:11:51.354 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:11:57.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:12:00.446 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:12:06.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:12:09.530 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:12:15.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:12:18.586 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:12:24.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:12:27.674 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:12:33.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:12:36.730 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:12:42.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:12:45.786 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:12:51.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:12:54.846 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:13:00.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:13:03.930 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:13:09.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:13:12.990 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:13:18.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:13:22.074 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:13:28.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:13:31.130 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:13:37.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:13:40.218 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:13:46.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:13:49.274 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:13:55.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:13:58.362 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:14:04.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:14:07.454 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:14:13.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:14:16.538 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:14:22.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:14:25.594 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:14:31.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:14:34.650 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:14:40.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:14:43.706 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:14:49.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:14:52.794 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:14:58.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:15:01.850 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:15:07.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:15:10.909 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:15:16.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:15:19.994 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:15:25.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:15:29.050 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:15:35.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:15:38.106 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:15:44.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:15:47.194 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:15:53.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:15:56.282 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:16:02.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:16:05.342 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:16:11.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:16:14.430 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:16:20.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:16:23.514 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:16:29.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:16:32.570 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:16:38.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:16:41.626 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:16:47.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:16:50.682 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:16:56.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-14T00:16:59.774 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-14T00:16:59.776 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-09-14T00:16:59.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-14T00:16:59.925 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2e7efb37622d47d083f9369b38e6aaaf Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-09-14T00:16:59.928 INFO:teuthology.nuke:Checking targets against current locks 2023-09-14T00:16:59.987 DEBUG:teuthology.nuke:shortname: smithi134 2023-09-14T00:16:59.988 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-14T00:17:00.013 DEBUG:teuthology.nuke:shortname: smithi140 2023-09-14T00:17:00.013 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-14T00:17:00.016 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2023-09-13_01:58:24-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi/7395912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 23:57:34.736485', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-14T00:17:00.039 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2023-09-13_01:58:24-rgw:verify-wip-rgw-perf-counters-cache-distro-default-smithi/7395912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 23:57:34.734484', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-09-14T00:17:00.069 INFO:teuthology.orchestra.console.smithi134:Power off 2023-09-14T00:17:00.070 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-14T00:17:00.092 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-09-14T00:17:00.093 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T00:17:00.107 INFO:teuthology.orchestra.console.smithi140:Power off 2023-09-14T00:17:00.108 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-14T00:17:00.117 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-09-14T00:17:00.129 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-09-14T00:17:00.129 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T00:17:00.154 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-14T00:17:04.122 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T00:17:04.155 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T00:17:04.232 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-09-14T00:17:04.265 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-14T00:17:08.237 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T00:17:08.266 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-14T00:17:08.347 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-09-14T00:17:08.377 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-14T00:17:08.448 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-09-14T00:17:08.479 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-09-14T00:17:08.609 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com 2023-09-14T00:17:08.634 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-09-14T00:17:08.872 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds