2023-11-29T21:04:18.634 INFO:root:teuthology version: 0.0.1.dev212+g735a43c
2023-11-29T21:04:18.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T21:04:18.810 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa98b10c430>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa98c02d550>, signals=[15])
2023-11-29T21:04:18.811 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging
2023-11-29T21:04:18.811 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server
2023-11-29T21:04:18.812 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2023-11-29T21:04:18.835 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging
2023-11-29T21:04:18.835 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server
2023-11-29T21:04:18.836 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2023-11-29T21:04:18.861 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging
2023-11-29T21:04:18.861 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server
2023-11-29T21:04:18.861 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2023-11-29T21:04:18.997 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-29T21:04:19.001 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-29T21:04:19.015 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-29T21:04:19.045 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of rhel 8.6
2023-11-29T21:04:19.053 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.6
2023-11-29T21:04:19.056 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6
2023-11-29T21:04:19.277 INFO:teuthology.orchestra.console.smithi140:Power off
2023-11-29T21:04:19.277 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-29T21:04:19.298 INFO:teuthology.orchestra.console.smithi078:Power off
2023-11-29T21:04:19.298 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-29T21:04:19.312 INFO:teuthology.orchestra.console.smithi179:Power off
2023-11-29T21:04:19.313 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-29T21:04:19.322 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off
2023-11-29T21:04:19.323 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:19.330 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off
2023-11-29T21:04:19.331 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:19.340 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off
2023-11-29T21:04:19.341 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:19.351 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2023-11-29T21:04:19.354 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2023-11-29T21:04:19.367 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2023-11-29T21:04:23.356 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:23.363 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:23.369 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:23.465 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2023-11-29T21:04:23.471 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2023-11-29T21:04:23.477 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2023-11-29T21:04:27.470 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:27.478 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:27.485 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:27.580 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2023-11-29T21:04:27.586 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2023-11-29T21:04:27.594 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2023-11-29T21:04:27.681 INFO:teuthology.orchestra.console.smithi140:Power off completed
2023-11-29T21:04:27.687 INFO:teuthology.orchestra.console.smithi078:Power off completed
2023-11-29T21:04:27.783 INFO:teuthology.orchestra.console.smithi140:Power on
2023-11-29T21:04:27.784 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-29T21:04:27.794 INFO:teuthology.orchestra.console.smithi078:Power on
2023-11-29T21:04:27.794 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-29T21:04:27.811 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On
2023-11-29T21:04:27.811 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:27.822 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On
2023-11-29T21:04:27.823 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:27.839 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2023-11-29T21:04:27.844 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2023-11-29T21:04:31.599 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:31.708 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2023-11-29T21:04:31.809 INFO:teuthology.orchestra.console.smithi179:Power off completed
2023-11-29T21:04:31.840 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:31.847 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:31.909 INFO:teuthology.orchestra.console.smithi179:Power on
2023-11-29T21:04:31.910 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-29T21:04:31.931 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On
2023-11-29T21:04:31.932 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:31.949 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2023-11-29T21:04:31.954 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2023-11-29T21:04:31.955 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2023-11-29T21:04:35.950 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:35.959 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:35.966 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:04:36.061 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2023-11-29T21:04:36.068 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2023-11-29T21:04:36.073 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2023-11-29T21:04:36.162 INFO:teuthology.orchestra.console.smithi140:Power on completed
2023-11-29T21:04:36.168 INFO:teuthology.orchestra.console.smithi078:Power on completed
2023-11-29T21:04:36.175 INFO:teuthology.orchestra.console.smithi179:Power on completed
2023-11-29T21:04:36.263 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish
2023-11-29T21:04:36.270 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish
2023-11-29T21:04:36.275 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish
2023-11-29T21:07:22.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:22.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:22.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:25.222 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:07:25.254 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2023-11-29T21:07:25.254 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2023-11-29T21:07:31.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:31.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:31.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:34.306 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:07:34.306 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2023-11-29T21:07:34.338 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2023-11-29T21:07:40.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:40.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:40.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:43.398 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2023-11-29T21:07:43.398 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2023-11-29T21:07:43.399 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:07:49.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:49.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:49.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:52.482 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2023-11-29T21:07:52.482 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:07:52.483 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2023-11-29T21:07:58.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:58.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:07:58.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:08:01.538 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2023-11-29T21:08:01.539 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:08:01.574 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2023-11-29T21:08:07.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:08:07.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:08:07.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:08:10.626 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:08:10.627 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2023-11-29T21:08:16.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:08:16.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:08:19.686 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:08:25.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:09:07.590 WARNING:teuthology.provision.fog.smithi078:timed out
2023-11-29T21:09:13.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:09:13.948 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-29T21:09:13.949 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-29T21:09:14.253 INFO:teuthology.provision.fog.smithi078:Node is ready
2023-11-29T21:09:14.253 DEBUG:teuthology.orchestra.run.smithi078:> hostname
2023-11-29T21:09:14.273 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com
2023-11-29T21:09:14.274 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078.front.sepia.ceph.com /etc/hosts
2023-11-29T21:09:14.333 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078
2023-11-29T21:09:14.334 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078
2023-11-29T21:09:14.449 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hosts
2023-11-29T21:09:14.482 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts
2023-11-29T21:09:14.555 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hostname
2023-11-29T21:09:14.628 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078
2023-11-29T21:09:14.700 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release
2023-11-29T21:09:14.760 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux"
2023-11-29T21:09:14.761 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)"
2023-11-29T21:09:14.761 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel"
2023-11-29T21:09:14.761 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora"
2023-11-29T21:09:14.761 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6"
2023-11-29T21:09:14.761 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8"
2023-11-29T21:09:14.761 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-29T21:09:14.761 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2023-11-29T21:09:14.761 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-29T21:09:14.761 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/"
2023-11-29T21:09:14.762 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-29T21:09:14.762 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-29T21:09:14.762 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-11-29T21:09:14.762 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-29T21:09:14.762 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-29T21:09:14.762 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-29T21:09:14.762 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-29T21:09:14.763 INFO:teuthology.provision.fog.smithi078:Deploy complete!
2023-11-29T21:09:14.764 DEBUG:teuthology.parallel:result is None
2023-11-29T21:09:16.636 WARNING:teuthology.provision.fog.smithi179:timed out
2023-11-29T21:09:22.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:09:22.983 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-29T21:09:22.983 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-29T21:09:23.281 INFO:teuthology.provision.fog.smithi179:Node is ready
2023-11-29T21:09:23.281 DEBUG:teuthology.orchestra.run.smithi179:> hostname
2023-11-29T21:09:23.299 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com
2023-11-29T21:09:23.299 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts
2023-11-29T21:09:23.358 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179
2023-11-29T21:09:23.358 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179
2023-11-29T21:09:23.496 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts
2023-11-29T21:09:23.524 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts
2023-11-29T21:09:23.591 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname
2023-11-29T21:09:23.658 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179
2023-11-29T21:09:23.724 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release
2023-11-29T21:09:23.780 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux"
2023-11-29T21:09:23.781 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)"
2023-11-29T21:09:23.781 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel"
2023-11-29T21:09:23.781 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora"
2023-11-29T21:09:23.781 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6"
2023-11-29T21:09:23.781 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8"
2023-11-29T21:09:23.781 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-29T21:09:23.781 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31"
2023-11-29T21:09:23.781 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-29T21:09:23.781 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/"
2023-11-29T21:09:23.781 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-29T21:09:23.781 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-29T21:09:23.782 INFO:teuthology.orchestra.run.smithi179.stdout:
2023-11-29T21:09:23.782 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-29T21:09:23.782 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-29T21:09:23.782 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-29T21:09:23.782 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-29T21:09:23.782 INFO:teuthology.provision.fog.smithi179:Deploy complete!
2023-11-29T21:09:23.783 DEBUG:teuthology.parallel:result is None
2023-11-29T21:09:25.694 WARNING:teuthology.provision.fog.smithi140:timed out
2023-11-29T21:09:31.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:09:50.054 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:09:56.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:09:59.138 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:10:05.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:10:08.194 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:10:14.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:10:17.282 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:10:23.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:10:26.338 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:10:32.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:10:35.394 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:10:41.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:10:44.450 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:10:50.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:10:53.506 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:10:59.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:11:02.562 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:11:08.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:11:11.650 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:11:17.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:11:20.706 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:11:26.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:11:29.762 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:11:35.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:11:38.818 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:11:44.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:11:47.906 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:11:53.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:11:56.966 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:12:02.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:12:06.050 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:12:12.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:12:15.138 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:12:21.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:12:24.194 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:12:30.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:12:33.250 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:12:39.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:12:42.306 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:12:48.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:12:51.398 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:12:57.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:13:00.482 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:13:06.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:13:09.570 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:13:15.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:13:18.626 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:13:24.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:13:27.714 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:13:33.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:13:36.770 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:13:42.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:13:45.826 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:13:51.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:13:54.882 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:14:00.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:14:03.942 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:14:09.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:14:13.026 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:14:19.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:14:22.082 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:14:28.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:14:31.138 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:14:37.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:14:40.322 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:14:46.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:14:49.378 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:14:55.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:14:58.434 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:15:04.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:15:07.522 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:15:13.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:15:16.578 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:15:22.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:15:25.666 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:15:31.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:15:34.722 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:15:40.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:15:43.782 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:15:49.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:15:52.866 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:15:58.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:16:01.922 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:16:07.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:16:10.982 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:16:16.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:16:20.070 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:16:26.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:16:29.154 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:16:35.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:16:38.310 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:16:44.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:16:47.394 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:16:53.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:16:56.454 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:17:02.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:17:05.538 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:17:11.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:17:14.594 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:17:20.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:17:23.650 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:17:29.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:17:32.706 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:17:38.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:17:41.794 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:17:47.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:17:50.850 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:17:56.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:17:59.906 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:18:05.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:18:08.994 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:18:15.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:18:18.082 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:18:24.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:18:27.138 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:18:33.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:18:36.226 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:18:42.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:18:45.286 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:18:51.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:18:54.370 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:19:00.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:19:03.426 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:19:09.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:19:12.482 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:19:18.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:19:21.574 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:19:27.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:19:30.658 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:19:36.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:19:39.718 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:19:45.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:19:48.802 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:19:54.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:19:57.858 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:20:03.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:20:06.914 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:20:12.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:20:15.974 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:20:21.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:20:25.062 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:20:31.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:20:34.150 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:20:40.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:20:43.234 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:20:49.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:20:52.290 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:20:58.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:21:01.346 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:21:07.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:21:10.402 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:21:16.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:21:19.458 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:21:25.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:21:28.546 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:21:34.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:21:37.602 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:21:43.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:21:46.658 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:21:52.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:21:55.714 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:22:01.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:22:04.774 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:22:10.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:22:13.858 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:22:19.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:22:22.918 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:22:28.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:22:32.002 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:22:38.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:22:41.058 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:22:47.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:22:50.114 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:22:56.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:22:59.170 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:23:05.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:23:08.230 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:23:14.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:23:17.314 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:23:23.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:23:26.373 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:23:32.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T21:23:35.458 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-11-29T21:23:35.460 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/provision/fog.py", line 275, in _wait_for_ready
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds
2023-11-29T21:23:35.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T21:23:35.609 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b4145d79374c4c54968e0812880b9793
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/provision/fog.py", line 275, in _wait_for_ready
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds
2023-11-29T21:23:35.611 INFO:teuthology.nuke:Checking targets against current locks
2023-11-29T21:23:35.677 DEBUG:teuthology.nuke:shortname: smithi078
2023-11-29T21:23:35.677 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-29T21:23:35.698 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-29_17:06:36-smoke-wip-yuri11-testing-2023-11-21-0932-reef-distro-default-smithi/7471083', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 21:04:17.770154', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNopiEx4eBTdVuZNKr0kOdXyldGHtdczx0w4hpBLlxEaPNhFKdAW/8CnJtQf6NJO+4eij8vh4biLCIRhlFeF/M4='}
2023-11-29T21:23:35.701 DEBUG:teuthology.nuke:shortname: smithi140
2023-11-29T21:23:35.701 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-29T21:23:35.716 DEBUG:teuthology.nuke:shortname: smithi179
2023-11-29T21:23:35.716 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-29T21:23:35.721 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-29_17:06:36-smoke-wip-yuri11-testing-2023-11-21-0932-reef-distro-default-smithi/7471083', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 21:04:17.767970', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAN4MCWJfiJkd16QE0tEbO+csY6mDtXIf7b/HQhh6x8cLaiacTx4waDjfkVA63WVK+2wIYNH35HwtP3/2opMOzU='}
2023-11-29T21:23:35.735 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-29_17:06:36-smoke-wip-yuri11-testing-2023-11-21-0932-reef-distro-default-smithi/7471083', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 21:04:17.769168', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPoprV2m46JaPLFc77B2xtGFtOZ9wct2SFt6fvTMSUi0GSKlVk7xM52oXa1g5oZ4rwFAEMB7nP5QZWcqNr7z9GE='}
2023-11-29T21:23:35.750 INFO:teuthology.orchestra.console.smithi078:Power off
2023-11-29T21:23:35.751 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-29T21:23:35.774 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off
2023-11-29T21:23:35.774 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:23:35.791 INFO:teuthology.orchestra.console.smithi179:Power off
2023-11-29T21:23:35.792 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-29T21:23:35.804 INFO:teuthology.orchestra.console.smithi140:Power off
2023-11-29T21:23:35.804 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-29T21:23:35.813 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2023-11-29T21:23:35.814 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off
2023-11-29T21:23:35.814 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:23:35.826 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off
2023-11-29T21:23:35.826 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:23:35.837 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2023-11-29T21:23:35.848 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2023-11-29T21:23:39.814 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:23:39.838 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:23:39.849 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:23:39.924 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2023-11-29T21:23:39.948 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2023-11-29T21:23:39.958 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2023-11-29T21:23:43.929 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:23:43.949 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:23:43.958 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:23:44.039 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2023-11-29T21:23:44.058 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2023-11-29T21:23:44.067 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2023-11-29T21:23:44.140 INFO:teuthology.orchestra.console.smithi078:Power off completed
2023-11-29T21:23:44.159 INFO:teuthology.orchestra.console.smithi179:Power off completed
2023-11-29T21:23:44.295 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com
2023-11-29T21:23:44.303 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com
2023-11-29T21:23:48.070 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T21:23:48.180 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2023-11-29T21:23:48.281 INFO:teuthology.orchestra.console.smithi140:Power off completed
2023-11-29T21:23:48.437 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com
2023-11-29T21:23:48.763 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/provision/fog.py", line 275, in _wait_for_ready
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds