2023-09-19T20:36:35.352 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-19T20:36:35.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-19T20:36:35.488 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f29854acd60>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2985158c10>, signals=[15])
2023-09-19T20:36:35.490 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging
2023-09-19T20:36:35.490 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server
2023-09-19T20:36:35.490 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2023-09-19T20:36:35.512 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2023-09-19T20:36:35.512 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2023-09-19T20:36:35.512 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-09-19T20:36:35.514 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /host {"name": "smithi100"}
2023-09-19T20:36:35.537 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"}
2023-09-19T20:36:35.587 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-09-19T20:36:35.602 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-09-19T20:36:35.629 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_rhel_8.6 (ID 5)
2023-09-19T20:36:35.629 DEBUG:teuthology.provision.fog.smithi100:FOG request: PUT /host/205 {"imageID": 5}
2023-09-19T20:36:35.640 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_rhel_8.6 (ID 5)
2023-09-19T20:36:35.641 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 5}
2023-09-19T20:36:35.678 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of rhel 8.6
2023-09-19T20:36:35.679 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:36:35.690 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of rhel 8.6
2023-09-19T20:36:35.690 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:36:35.770 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"}
2023-09-19T20:36:35.777 DEBUG:teuthology.provision.fog.smithi100:Canceling deploy task with ID 496902
2023-09-19T20:36:35.777 DEBUG:teuthology.provision.fog.smithi100:FOG request: DELETE /task/cancel {"id": 496902}
2023-09-19T20:36:35.817 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1}
2023-09-19T20:36:35.848 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /tasktype {"name": "deploy"}
2023-09-19T20:36:35.887 DEBUG:teuthology.provision.fog.smithi100:FOG request: POST /host/205/task {"taskTypeID": 1}
2023-09-19T20:36:35.914 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:36:36.171 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:36:36.275 INFO:teuthology.orchestra.console.smithi161:Power off
2023-09-19T20:36:36.276 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-19T20:36:36.288 INFO:teuthology.orchestra.console.smithi100:Power off
2023-09-19T20:36:36.289 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-19T20:36:36.298 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2023-09-19T20:36:36.299 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:36:36.309 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2023-09-19T20:36:36.310 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:36:36.320 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-09-19T20:36:36.330 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2023-09-19T20:36:36.430 INFO:teuthology.orchestra.console.smithi100:Power off completed
2023-09-19T20:36:36.531 INFO:teuthology.orchestra.console.smithi100:Power on
2023-09-19T20:36:36.531 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-19T20:36:36.551 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On
2023-09-19T20:36:36.552 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:36:36.577 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2023-09-19T20:36:40.322 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:36:40.430 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-09-19T20:36:40.578 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:36:40.686 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2023-09-19T20:36:44.434 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:36:44.543 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-09-19T20:36:44.688 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:36:44.796 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2023-09-19T20:36:44.897 INFO:teuthology.orchestra.console.smithi100:Power on completed
2023-09-19T20:36:44.998 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2023-09-19T20:36:44.999 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:36:48.547 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:36:48.656 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-09-19T20:36:48.757 INFO:teuthology.orchestra.console.smithi161:Power off completed
2023-09-19T20:36:48.858 INFO:teuthology.orchestra.console.smithi161:Power on
2023-09-19T20:36:48.858 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-19T20:36:48.883 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2023-09-19T20:36:48.884 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:36:48.905 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-09-19T20:36:52.910 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:36:53.019 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-09-19T20:36:57.023 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:36:57.132 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-09-19T20:36:57.233 INFO:teuthology.orchestra.console.smithi161:Power on completed
2023-09-19T20:36:57.334 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2023-09-19T20:36:57.334 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:37:00.078 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:37:12.440 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:37:15.159 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:37:27.541 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:37:30.239 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:37:42.642 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:37:45.334 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:37:57.730 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:38:00.417 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:38:12.842 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:38:15.517 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:38:27.936 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:38:30.602 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:38:43.026 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:38:45.695 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:38:58.118 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:39:00.786 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:39:13.210 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:39:15.873 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:39:28.310 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:39:30.956 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-09-19T20:39:31.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T20:39:43.432 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-09-19T20:39:43.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T20:40:01.946 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-09-19T20:40:07.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T20:40:11.002 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-09-19T20:40:17.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T20:40:20.058 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-09-19T20:40:26.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T20:40:29.114 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-09-19T20:40:31.048 WARNING:teuthology.provision.fog.smithi100:timed out
2023-09-19T20:40:35.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T20:40:37.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T20:40:38.174 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-09-19T20:40:44.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T20:40:47.258 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-09-19T20:40:53.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T20:40:55.454 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-09-19T20:41:01.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T20:41:04.180 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-19T20:41:04.181 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-19T20:41:04.479 INFO:teuthology.provision.fog.smithi100:Node is ready
2023-09-19T20:41:04.479 DEBUG:teuthology.orchestra.run.smithi100:> hostname
2023-09-19T20:41:04.495 INFO:teuthology.orchestra.run.smithi100.stdout:smithi022
2023-09-19T20:41:04.496 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi022 /etc/hosts
2023-09-19T20:41:04.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-09-19T20:41:04.553 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2023-09-19T20:41:04.683 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi022/smithi100/g' /etc/hosts
2023-09-19T20:41:04.710 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.22/172.21.15.100/g' /etc/hosts
2023-09-19T20:41:04.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi022/smithi100/g' /etc/hostname
2023-09-19T20:41:04.843 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2023-09-19T20:41:04.908 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2023-09-19T20:41:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Red Hat Enterprise Linux"
2023-09-19T20:41:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8.6 (Ootpa)"
2023-09-19T20:41:04.964 INFO:teuthology.orchestra.run.smithi100.stdout:ID="rhel"
2023-09-19T20:41:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="fedora"
2023-09-19T20:41:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8.6"
2023-09-19T20:41:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8"
2023-09-19T20:41:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-19T20:41:04.965 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31"
2023-09-19T20:41:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-19T20:41:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.redhat.com/"
2023-09-19T20:41:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-19T20:41:04.966 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-19T20:41:04.967 INFO:teuthology.orchestra.run.smithi100.stdout:
2023-09-19T20:41:04.967 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-19T20:41:04.967 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-19T20:41:04.967 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-19T20:41:04.968 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-19T20:41:04.968 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2023-09-19T20:41:04.969 DEBUG:teuthology.parallel:result is None
2023-09-19T20:41:53.310 WARNING:teuthology.provision.fog.smithi161:timed out
2023-09-19T20:41:59.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T20:41:59.654 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-19T20:41:59.654 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-19T20:41:59.973 INFO:teuthology.provision.fog.smithi161:Node is ready
2023-09-19T20:41:59.974 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2023-09-19T20:41:59.991 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2023-09-19T20:41:59.992 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2023-09-19T20:42:00.050 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2023-09-19T20:42:00.050 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-09-19T20:42:00.168 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2023-09-19T20:42:00.197 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2023-09-19T20:42:00.265 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2023-09-19T20:42:00.336 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-09-19T20:42:00.403 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-09-19T20:42:00.461 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux"
2023-09-19T20:42:00.461 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)"
2023-09-19T20:42:00.461 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel"
2023-09-19T20:42:00.461 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora"
2023-09-19T20:42:00.461 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6"
2023-09-19T20:42:00.462 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-09-19T20:42:00.462 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-19T20:42:00.462 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-09-19T20:42:00.462 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-19T20:42:00.463 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/"
2023-09-19T20:42:00.463 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-19T20:42:00.463 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-19T20:42:00.463 INFO:teuthology.orchestra.run.smithi161.stdout:
2023-09-19T20:42:00.463 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-19T20:42:00.464 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-19T20:42:00.464 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-19T20:42:00.464 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-19T20:42:00.464 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2023-09-19T20:42:00.465 DEBUG:teuthology.parallel:result is None
2023-09-19T20:42:01.552 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2023-09-19T20:42:01.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-19T20:42:01.694 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bf2522bd76894a7daf824aa10ca60620
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2023-09-19T20:42:01.697 INFO:teuthology.nuke:Checking targets against current locks
2023-09-19T20:42:01.759 DEBUG:teuthology.nuke:shortname: smithi100
2023-09-19T20:42:01.759 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-19T20:42:01.779 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-19_20:06:27-rgw-wip-cmake-uring-distro-default-smithi/7398415', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-19 20:41:37.887985', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOd+24784ahdagrHv0Hicnrq0ydDhHZ5abGWnjOcRcA8hz+mTwcM2yYDZFCYl/5yM3gxILJaVtu7ocYF7ULMPfI='}
2023-09-19T20:42:01.782 DEBUG:teuthology.nuke:shortname: smithi161
2023-09-19T20:42:01.783 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-19T20:42:01.807 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-19_20:06:27-rgw-wip-cmake-uring-distro-default-smithi/7398399', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-19 20:36:34.568946', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/uAqYk+C9hb86ZDW5AXnVVPz9HZCwHjx/1TPipyPun+KN1ciGxvSlaQNvYsXxUEO7ISk4vcD2AcQPhtisp3sc='}
2023-09-19T20:42:01.835 INFO:teuthology.orchestra.console.smithi100:Power off
2023-09-19T20:42:01.836 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-19T20:42:01.858 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2023-09-19T20:42:01.859 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:42:01.879 INFO:teuthology.orchestra.console.smithi161:Power off
2023-09-19T20:42:01.880 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-19T20:42:01.891 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2023-09-19T20:42:01.907 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2023-09-19T20:42:01.907 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:42:01.930 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-09-19T20:42:05.894 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:42:05.931 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:42:06.004 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2023-09-19T20:42:06.040 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-09-19T20:42:10.007 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:42:10.042 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:42:10.117 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2023-09-19T20:42:10.152 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-09-19T20:42:10.219 INFO:teuthology.orchestra.console.smithi100:Power off completed
2023-09-19T20:42:10.378 INFO:teuthology.lock.ops:unlocked: smithi100.front.sepia.ceph.com
2023-09-19T20:42:14.154 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T20:42:14.263 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-09-19T20:42:14.364 INFO:teuthology.orchestra.console.smithi161:Power off completed
2023-09-19T20:42:14.510 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com
2023-09-19T20:42:14.727 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range