2023-10-21T19:32:24.985 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-21T19:32:24.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:32:25.116 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe733362e50>, signals=[15]) 2023-10-21T19:32:25.118 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-10-21T19:32:25.118 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T19:32:25.119 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-10-21T19:32:25.142 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2023-10-21T19:32:25.142 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T19:32:25.143 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-10-21T19:32:25.144 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"} 2023-10-21T19:32:25.166 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /host {"name": "smithi148"} 2023-10-21T19:32:25.221 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-21T19:32:25.237 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-21T19:32:25.270 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-21T19:32:25.271 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 5} 2023-10-21T19:32:25.277 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-21T19:32:25.277 DEBUG:teuthology.provision.fog.smithi148:FOG request: PUT /host/253 {"imageID": 5} 2023-10-21T19:32:25.312 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of rhel 8.6 2023-10-21T19:32:25.313 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:32:25.325 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of rhel 8.6 2023-10-21T19:32:25.325 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:32:25.386 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T19:32:25.390 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T19:32:25.427 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1} 2023-10-21T19:32:25.430 DEBUG:teuthology.provision.fog.smithi148:FOG request: POST /host/253/task {"taskTypeID": 1} 2023-10-21T19:32:25.482 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:32:25.593 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:32:25.655 INFO:teuthology.orchestra.console.smithi148:Power off 2023-10-21T19:32:25.657 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T19:32:25.677 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-10-21T19:32:25.678 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:32:25.699 INFO:teuthology.orchestra.console.smithi107:Power off 2023-10-21T19:32:25.700 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T19:32:25.709 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-21T19:32:25.723 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-10-21T19:32:25.724 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:32:25.744 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-10-21T19:32:25.810 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-10-21T19:32:25.846 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-10-21T19:32:25.912 INFO:teuthology.orchestra.console.smithi148:Power on 2023-10-21T19:32:25.912 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T19:32:25.935 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2023-10-21T19:32:25.936 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:32:25.948 INFO:teuthology.orchestra.console.smithi107:Power on 2023-10-21T19:32:25.948 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T19:32:25.959 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-21T19:32:25.967 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2023-10-21T19:32:25.968 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:32:25.987 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-10-21T19:32:29.962 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:32:29.989 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:32:30.073 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-10-21T19:32:30.101 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-10-21T19:32:30.175 INFO:teuthology.orchestra.console.smithi148:Power on completed 2023-10-21T19:32:30.275 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2023-10-21T19:32:30.276 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:32:34.106 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:32:34.316 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-10-21T19:32:34.417 INFO:teuthology.orchestra.console.smithi107:Power on completed 2023-10-21T19:32:34.517 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-10-21T19:32:34.518 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:32:45.361 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:32:49.594 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:33:00.443 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:33:04.665 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:33:15.518 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:33:19.730 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:33:30.586 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:33:34.790 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:33:45.654 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:33:49.846 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:34:00.726 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:34:04.914 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:34:15.794 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:34:19.986 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:34:30.862 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:34:35.054 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:34:45.930 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:34:50.131 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:35:01.002 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:35:05.198 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:35:16.066 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-21T19:35:16.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:35:20.272 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-10-21T19:35:20.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:35:34.526 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-21T19:35:38.877 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-21T19:35:40.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:35:43.610 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-21T19:35:44.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:35:47.930 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-21T19:35:49.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:35:52.666 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-21T19:35:53.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:35:56.986 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-21T19:35:58.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:36:01.722 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-21T19:36:02.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:36:06.042 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-21T19:36:07.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:36:10.778 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-21T19:36:12.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:36:15.102 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-21T19:36:16.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:36:19.838 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-21T19:36:21.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:36:25.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:36:27.226 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-21T19:36:33.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:36:36.282 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-21T19:36:42.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:36:45.338 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-10-21T19:36:51.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:36:52.295 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T19:36:52.296 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T19:36:52.611 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-10-21T19:36:52.612 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-10-21T19:36:52.628 INFO:teuthology.orchestra.run.smithi107.stdout:smithi022 2023-10-21T19:36:52.628 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi022 /etc/hosts 2023-10-21T19:36:52.684 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-10-21T19:36:52.684 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-10-21T19:36:52.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi022/smithi107/g' /etc/hosts 2023-10-21T19:36:52.845 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.22/172.21.15.107/g' /etc/hosts 2023-10-21T19:36:52.911 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi022/smithi107/g' /etc/hostname 2023-10-21T19:36:52.978 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-10-21T19:36:53.044 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-10-21T19:36:53.100 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2023-10-21T19:36:53.100 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)" 2023-10-21T19:36:53.101 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2023-10-21T19:36:53.101 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2023-10-21T19:36:53.101 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6" 2023-10-21T19:36:53.101 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-10-21T19:36:53.101 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-21T19:36:53.102 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-10-21T19:36:53.102 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-21T19:36:53.102 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2023-10-21T19:36:53.102 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-21T19:36:53.103 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T19:36:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-10-21T19:36:53.103 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T19:36:53.103 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-21T19:36:53.103 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-21T19:36:53.103 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-21T19:36:53.104 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-10-21T19:36:53.106 DEBUG:teuthology.parallel:result is None 2023-10-21T19:37:25.877 WARNING:teuthology.provision.fog.smithi148:timed out 2023-10-21T19:37:31.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:37:32.116 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T19:37:32.116 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T19:37:32.410 INFO:teuthology.provision.fog.smithi148:Node is ready 2023-10-21T19:37:32.411 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2023-10-21T19:37:32.430 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2023-10-21T19:37:32.430 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2023-10-21T19:37:32.490 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2023-10-21T19:37:32.490 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-10-21T19:37:32.609 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2023-10-21T19:37:32.638 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2023-10-21T19:37:32.706 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2023-10-21T19:37:32.774 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-10-21T19:37:32.841 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-10-21T19:37:32.898 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2023-10-21T19:37:32.898 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)" 2023-10-21T19:37:32.898 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2023-10-21T19:37:32.899 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2023-10-21T19:37:32.899 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6" 2023-10-21T19:37:32.899 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-10-21T19:37:32.899 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-21T19:37:32.900 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-10-21T19:37:32.900 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-21T19:37:32.900 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2023-10-21T19:37:32.900 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-21T19:37:32.900 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T19:37:32.901 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-21T19:37:32.901 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T19:37:32.901 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-21T19:37:32.901 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-21T19:37:32.901 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-21T19:37:32.902 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2023-10-21T19:37:32.902 DEBUG:teuthology.parallel:result is None 2023-10-21T19:37:33.055 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-10-21T19:37:33.056 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T19:37:33.081 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2023-10-21T19:37:33.081 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T19:37:33.106 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-10-21T19:37:33.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-10-21T19:37:33.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:37:33.176 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-10-21T19:37:33.264 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-10-21T19:37:33.264 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-10-21T19:37:33.320 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-10-21T19:37:33.321 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-10-21T19:37:33.382 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2023-10-21T19:37:33.382 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)" 2023-10-21T19:37:33.383 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2023-10-21T19:37:33.383 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2023-10-21T19:37:33.383 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6" 2023-10-21T19:37:33.383 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-10-21T19:37:33.384 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-21T19:37:33.384 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-10-21T19:37:33.384 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-21T19:37:33.384 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2023-10-21T19:37:33.385 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-21T19:37:33.385 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T19:37:33.385 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-10-21T19:37:33.385 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T19:37:33.385 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-21T19:37:33.386 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-21T19:37:33.386 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-21T19:37:33.387 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-10-21T19:37:33.413 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2023-10-21T19:37:33.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-21T19:37:33.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T19:37:33.486 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-10-21T19:37:33.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-21T19:37:33.552 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-10-21T19:37:33.610 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-10-21T19:37:33.611 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-10-21T19:37:33.669 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2023-10-21T19:37:33.670 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)" 2023-10-21T19:37:33.670 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2023-10-21T19:37:33.670 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2023-10-21T19:37:33.671 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6" 2023-10-21T19:37:33.671 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-10-21T19:37:33.671 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-21T19:37:33.672 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-10-21T19:37:33.672 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-21T19:37:33.673 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2023-10-21T19:37:33.673 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-21T19:37:33.673 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T19:37:33.674 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-21T19:37:33.674 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T19:37:33.675 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-21T19:37:33.675 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-21T19:37:33.675 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-21T19:37:33.676 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-10-21T19:37:33.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:37:33.817 INFO:teuthology.dispatcher.supervisor:Running job 7427770 2023-10-21T19:37:33.818 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427770 --name teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427770/orig.config.yaml 2023-10-21T19:37:33.821 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427770 2023-10-21T19:37:33.822 INFO:teuthology.dispatcher.supervisor:Job PID: 625046 2023-10-21T19:37:33.822 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T19:39:33.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:41:34.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:43:34.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:45:34.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:47:34.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:49:34.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:51:34.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:53:35.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:55:35.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:57:35.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:59:35.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:01:35.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:03:35.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:05:36.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:07:36.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:09:36.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:11:36.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:13:36.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:15:36.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:17:37.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:19:37.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:21:37.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:23:37.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:25:37.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:27:37.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:29:38.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:31:38.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:33:38.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:35:38.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:37:38.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:39:38.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:41:39.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:43:39.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:45:39.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:47:39.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:49:39.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:51:39.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:53:40.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:55:40.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:57:40.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T20:59:40.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T21:01:40.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T21:03:40.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T21:05:41.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T21:05:41.227 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T21:05:41.425 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T21:05:41.425 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T21:05:41.475 DEBUG:teuthology.nuke:shortname: smithi107 2023-10-21T21:05:41.476 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T21:05:41.495 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 19:32:24.145770', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-21T21:05:41.499 DEBUG:teuthology.nuke:shortname: smithi148 2023-10-21T21:05:41.499 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T21:05:41.523 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 19:32:24.144351', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-21T21:05:41.552 INFO:teuthology.orchestra.console.smithi107:Power off 2023-10-21T21:05:41.553 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T21:05:41.573 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-10-21T21:05:41.574 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T21:05:41.586 INFO:teuthology.orchestra.console.smithi148:Power off 2023-10-21T21:05:41.587 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T21:05:41.595 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-10-21T21:05:41.606 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-10-21T21:05:41.606 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T21:05:41.627 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-21T21:05:41.696 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-10-21T21:05:41.729 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-10-21T21:05:41.847 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2023-10-21T21:05:41.880 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com