2023-09-04T18:51:08.496 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-04T18:51:08.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-04T18:51:08.628 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc49eb78ca0>, signals=[15]) 2023-09-04T18:51:08.629 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging 2023-09-04T18:51:08.630 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server 2023-09-04T18:51:08.630 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-09-04T18:51:08.653 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-09-04T18:51:08.654 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-09-04T18:51:08.654 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-09-04T18:51:08.655 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /host {"name": "smithi114"} 2023-09-04T18:51:08.678 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-09-04T18:51:08.737 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-04T18:51:08.750 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-04T18:51:08.778 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-04T18:51:08.778 DEBUG:teuthology.provision.fog.smithi114:FOG request: PUT /host/219 {"imageID": 5} 2023-09-04T18:51:08.788 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-04T18:51:08.788 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 5} 2023-09-04T18:51:08.825 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of rhel 8.6 2023-09-04T18:51:08.825 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:51:08.835 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of rhel 8.6 2023-09-04T18:51:08.835 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:51:08.880 DEBUG:teuthology.provision.fog.smithi114:Canceling deploy task with ID 477707 2023-09-04T18:51:08.880 DEBUG:teuthology.provision.fog.smithi114:FOG request: DELETE /task/cancel {"id": 477707} 2023-09-04T18:51:08.892 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-09-04T18:51:08.928 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-09-04T18:51:08.934 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /tasktype {"name": "deploy"} 2023-09-04T18:51:08.970 DEBUG:teuthology.provision.fog.smithi114:FOG request: POST /host/219/task {"taskTypeID": 1} 2023-09-04T18:51:08.987 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:51:09.030 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:51:09.074 INFO:teuthology.orchestra.console.smithi139:Power off 2023-09-04T18:51:09.075 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-04T18:51:09.097 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-09-04T18:51:09.098 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:51:09.112 INFO:teuthology.orchestra.console.smithi114:Power off 2023-09-04T18:51:09.112 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-04T18:51:09.120 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-09-04T18:51:09.132 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-09-04T18:51:09.132 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:51:09.154 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-09-04T18:51:13.124 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:51:13.155 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:51:13.235 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-09-04T18:51:13.264 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-09-04T18:51:17.241 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:51:17.265 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:51:17.350 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-09-04T18:51:17.373 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-09-04T18:51:21.356 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:51:21.374 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:51:21.466 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-09-04T18:51:21.483 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-09-04T18:51:21.568 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-09-04T18:51:21.583 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-09-04T18:51:21.669 INFO:teuthology.orchestra.console.smithi139:Power on 2023-09-04T18:51:21.670 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-04T18:51:21.685 INFO:teuthology.orchestra.console.smithi114:Power on 2023-09-04T18:51:21.685 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-04T18:51:21.693 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On 2023-09-04T18:51:21.693 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:51:21.705 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On 2023-09-04T18:51:21.705 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:51:21.713 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-09-04T18:51:21.725 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-09-04T18:51:25.718 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:51:25.726 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:51:25.828 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-09-04T18:51:25.834 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-09-04T18:51:25.935 INFO:teuthology.orchestra.console.smithi114:Power on completed 2023-09-04T18:51:26.036 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2023-09-04T18:51:26.036 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:51:29.833 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:51:29.942 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-09-04T18:51:30.043 INFO:teuthology.orchestra.console.smithi139:Power on completed 2023-09-04T18:51:30.144 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-09-04T18:51:30.144 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:51:41.115 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:51:45.216 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:51:56.196 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:52:00.290 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:52:11.269 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:52:15.366 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:52:26.354 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:52:30.450 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:52:41.422 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:52:45.530 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:52:56.498 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:53:00.610 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:53:11.579 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:53:15.686 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:53:26.664 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:53:30.770 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:53:41.746 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:53:45.875 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:53:56.830 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:54:00.974 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:54:11.922 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-09-04T18:54:11.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-04T18:54:16.072 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-09-04T18:54:16.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-04T18:54:34.650 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-09-04T18:54:40.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-04T18:54:43.709 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-09-04T18:54:49.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-04T18:54:52.794 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-09-04T18:54:58.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-04T18:55:01.850 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-09-04T18:55:07.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-04T18:55:11.993 WARNING:teuthology.provision.fog.smithi114:timed out 2023-09-04T18:55:17.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-04T18:55:34.298 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-09-04T18:55:40.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-04T18:55:43.354 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-09-04T18:55:49.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-04T18:55:49.587 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-04T18:55:49.588 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-04T18:55:49.852 INFO:teuthology.provision.fog.smithi114:Node is ready 2023-09-04T18:55:49.852 DEBUG:teuthology.orchestra.run.smithi114:> hostname 2023-09-04T18:55:49.868 INFO:teuthology.orchestra.run.smithi114.stdout:smithi022 2023-09-04T18:55:49.868 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi022 /etc/hosts 2023-09-04T18:55:49.924 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-09-04T18:55:49.924 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-09-04T18:55:50.030 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi022/smithi114/g' /etc/hosts 2023-09-04T18:55:50.056 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.22/172.21.15.114/g' /etc/hosts 2023-09-04T18:55:50.122 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi022/smithi114/g' /etc/hostname 2023-09-04T18:55:50.189 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-09-04T18:55:50.256 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-09-04T18:55:50.312 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux" 2023-09-04T18:55:50.312 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)" 2023-09-04T18:55:50.312 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel" 2023-09-04T18:55:50.313 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora" 2023-09-04T18:55:50.313 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6" 2023-09-04T18:55:50.313 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-09-04T18:55:50.313 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-04T18:55:50.313 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-09-04T18:55:50.314 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-04T18:55:50.314 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/" 2023-09-04T18:55:50.314 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-04T18:55:50.314 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-04T18:55:50.315 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-09-04T18:55:50.315 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-04T18:55:50.315 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-04T18:55:50.315 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-04T18:55:50.315 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-04T18:55:50.316 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2023-09-04T18:55:50.317 DEBUG:teuthology.parallel:result is None 2023-09-04T18:56:07.877 WARNING:teuthology.provision.fog.smithi139:timed out 2023-09-04T18:56:13.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-04T18:56:14.221 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-04T18:56:14.222 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-04T18:56:14.526 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-09-04T18:56:14.526 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-09-04T18:56:14.544 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-09-04T18:56:14.544 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-09-04T18:56:14.602 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-09-04T18:56:14.602 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-09-04T18:56:14.731 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-09-04T18:56:14.760 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-09-04T18:56:14.827 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-09-04T18:56:14.895 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-09-04T18:56:14.961 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-09-04T18:56:15.017 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-09-04T18:56:15.018 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)" 2023-09-04T18:56:15.018 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-09-04T18:56:15.018 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-09-04T18:56:15.018 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6" 2023-09-04T18:56:15.018 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-09-04T18:56:15.019 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-04T18:56:15.019 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-09-04T18:56:15.019 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-04T18:56:15.019 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-09-04T18:56:15.019 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-04T18:56:15.019 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-04T18:56:15.020 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-09-04T18:56:15.020 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-04T18:56:15.020 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-04T18:56:15.020 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-04T18:56:15.020 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-04T18:56:15.021 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-09-04T18:56:15.021 DEBUG:teuthology.parallel:result is None 2023-09-04T18:58:29.351 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 326, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 290, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/misc.py", line 1107, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi114.front.sepia.ceph.com' reached maximum tries (16) after waiting for 120 seconds 2023-09-04T18:58:29.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-04T18:58:29.494 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c97753a9994642d69de51e7023f4aa56 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 326, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 290, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/misc.py", line 1107, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi114.front.sepia.ceph.com' reached maximum tries (16) after waiting for 120 seconds 2023-09-04T18:58:29.496 INFO:teuthology.nuke:Checking targets against current locks 2023-09-04T18:58:29.531 INFO:teuthology.nuke:Not nuking smithi114.front.sepia.ceph.com because description doesn't match: rishabh-2023-09-04_18:50:30-fs-wip-rishabh-2023aug3-b5-testing-default-smithi != None 2023-09-04T18:58:29.574 DEBUG:teuthology.nuke:shortname: smithi139 2023-09-04T18:58:29.574 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-04T18:58:29.599 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-04_18:50:30-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7388081', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-04 18:51:07.711251', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-09-04T18:58:29.645 INFO:teuthology.orchestra.console.smithi139:Power off 2023-09-04T18:58:29.646 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-04T18:58:29.671 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-09-04T18:58:29.671 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:58:29.694 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-09-04T18:58:33.697 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:58:33.806 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-09-04T18:58:37.810 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:58:37.918 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-09-04T18:58:41.923 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-04T18:58:42.032 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-09-04T18:58:42.133 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-09-04T18:58:42.292 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com 2023-09-04T18:58:42.294 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi114.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-09-04T18:58:42.545 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 326, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 290, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/misc.py", line 1107, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi114.front.sepia.ceph.com' reached maximum tries (16) after waiting for 120 seconds