2023-10-21T10:27:03.757 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T10:27:03.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:27:03.910 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff8c0ec1670>, signals=[15]) 2023-10-21T10:27:03.912 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2023-10-21T10:27:03.912 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T10:27:03.912 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-10-21T10:27:04.071 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-10-21T10:27:04.071 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T10:27:04.071 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-10-21T10:27:04.073 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /host {"name": "smithi163"} 2023-10-21T10:27:04.097 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-10-21T10:27:04.153 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-21T10:27:04.162 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-21T10:27:04.202 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_9.stream (ID 10) 2023-10-21T10:27:04.203 DEBUG:teuthology.provision.fog.smithi163:FOG request: PUT /host/268 {"imageID": 10} 2023-10-21T10:27:04.206 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_9.stream (ID 10) 2023-10-21T10:27:04.206 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 10} 2023-10-21T10:27:04.248 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 9.stream 2023-10-21T10:27:04.248 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:27:04.252 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 9.stream 2023-10-21T10:27:04.253 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:27:04.311 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T10:27:04.315 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T10:27:04.353 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-10-21T10:27:04.357 DEBUG:teuthology.provision.fog.smithi163:FOG request: POST /host/268/task {"taskTypeID": 1} 2023-10-21T10:27:04.417 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:27:04.434 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:27:04.515 INFO:teuthology.orchestra.console.smithi163:Power off 2023-10-21T10:27:04.516 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:27:04.530 INFO:teuthology.orchestra.console.smithi169:Power off 2023-10-21T10:27:04.531 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:27:04.541 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-10-21T10:27:04.542 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:27:04.553 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-10-21T10:27:04.554 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:27:04.565 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-21T10:27:04.579 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-21T10:27:04.667 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-10-21T10:27:04.680 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-10-21T10:27:04.768 INFO:teuthology.orchestra.console.smithi163:Power on 2023-10-21T10:27:04.769 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T10:27:04.782 INFO:teuthology.orchestra.console.smithi169:Power on 2023-10-21T10:27:04.783 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T10:27:04.791 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On 2023-10-21T10:27:04.792 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:27:04.805 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2023-10-21T10:27:04.806 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:27:04.815 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-21T10:27:04.827 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-21T10:27:08.818 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:27:08.828 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:27:08.927 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-21T10:27:08.936 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-21T10:27:12.930 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:27:12.938 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:27:13.041 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-21T10:27:13.047 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-10-21T10:27:13.142 INFO:teuthology.orchestra.console.smithi163:Power on completed 2023-10-21T10:27:13.148 INFO:teuthology.orchestra.console.smithi169:Power on completed 2023-10-21T10:27:13.244 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2023-10-21T10:27:13.244 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:27:13.249 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-10-21T10:27:13.249 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:27:28.342 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:27:28.344 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:27:43.450 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:27:43.452 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:27:58.538 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:27:58.540 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:28:13.618 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:28:13.620 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:28:28.700 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:28:28.701 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:28:43.787 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:28:43.788 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:28:58.858 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:28:58.860 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:29:13.938 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:29:13.940 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:29:29.018 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:29:29.020 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:29:44.094 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:29:44.096 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:29:59.174 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-10-21T10:29:59.176 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-21T10:29:59.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:29:59.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:29:59.343 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-21T10:30:13.626 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-21T10:30:17.722 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-21T10:30:19.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:30:22.682 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-21T10:30:23.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:30:26.782 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-21T10:30:28.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:30:31.738 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-21T10:30:32.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:30:35.834 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-21T10:30:37.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:30:40.794 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-21T10:30:41.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:30:44.890 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-21T10:30:46.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:30:49.850 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-21T10:30:50.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:30:53.947 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-21T10:30:55.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:30:58.910 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-21T10:30:59.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:31:03.002 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-10-21T10:31:04.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:31:07.962 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-21T10:31:09.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:31:13.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:31:17.022 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-21T10:31:23.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:31:41.434 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-21T10:31:47.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:31:50.494 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-21T10:31:56.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:31:59.578 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-21T10:32:05.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:32:05.836 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T10:32:05.837 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T10:32:09.007 WARNING:teuthology.provision.fog.smithi169:timed out 2023-10-21T10:32:15.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:32:15.229 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T10:32:15.230 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T10:32:15.560 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-10-21T10:32:15.560 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-10-21T10:32:15.574 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-10-21T10:32:15.575 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-10-21T10:32:15.631 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-10-21T10:32:15.631 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-10-21T10:32:15.739 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-10-21T10:32:15.767 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-10-21T10:32:15.835 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-10-21T10:32:15.903 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-10-21T10:32:15.970 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-10-21T10:32:16.025 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-10-21T10:32:16.025 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2023-10-21T10:32:16.025 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-10-21T10:32:16.025 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:32:16.026 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2023-10-21T10:32:16.026 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:32:16.026 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:32:16.026 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-10-21T10:32:16.027 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:32:16.027 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:32:16.027 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:32:16.027 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:32:16.027 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:32:16.028 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:32:16.028 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-10-21T10:32:16.030 DEBUG:teuthology.parallel:result is None 2023-10-21T10:32:25.861 INFO:teuthology.provision.fog.smithi163:Node is ready 2023-10-21T10:32:25.862 DEBUG:teuthology.orchestra.run.smithi163:> hostname 2023-10-21T10:32:25.881 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2023-10-21T10:32:25.881 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts 2023-10-21T10:32:25.939 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2023-10-21T10:32:25.939 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-10-21T10:32:26.061 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts 2023-10-21T10:32:26.092 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts 2023-10-21T10:32:26.161 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname 2023-10-21T10:32:26.230 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-10-21T10:32:26.297 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-10-21T10:32:26.355 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2023-10-21T10:32:26.355 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2023-10-21T10:32:26.355 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2023-10-21T10:32:26.355 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:32:26.356 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2023-10-21T10:32:26.356 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:32:26.356 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:32:26.356 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-10-21T10:32:26.356 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:32:26.358 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2023-10-21T10:32:26.359 DEBUG:teuthology.parallel:result is None 2023-10-21T10:32:26.527 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2023-10-21T10:32:26.528 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T10:32:26.552 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-10-21T10:32:26.552 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T10:32:26.579 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2023-10-21T10:32:26.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-10-21T10:32:26.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:32:26.665 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-10-21T10:32:26.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-10-21T10:32:26.737 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2023-10-21T10:32:26.790 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2023-10-21T10:32:26.791 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-10-21T10:32:26.844 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2023-10-21T10:32:26.844 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2023-10-21T10:32:26.845 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2023-10-21T10:32:26.845 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:32:26.845 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2023-10-21T10:32:26.845 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:32:26.845 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:32:26.846 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-10-21T10:32:26.846 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:32:26.846 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:32:26.846 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:32:26.846 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:32:26.847 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:32:26.847 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:32:26.848 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-10-21T10:32:26.869 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-10-21T10:32:26.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-10-21T10:32:26.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T10:32:26.955 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-10-21T10:32:27.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-10-21T10:32:27.125 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-10-21T10:32:27.180 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-10-21T10:32:27.181 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-10-21T10:32:27.235 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-10-21T10:32:27.236 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2023-10-21T10:32:27.236 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-10-21T10:32:27.236 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-10-21T10:32:27.237 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2023-10-21T10:32:27.237 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2023-10-21T10:32:27.237 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T10:32:27.238 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-10-21T10:32:27.238 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2023-10-21T10:32:27.238 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T10:32:27.238 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-10-21T10:32:27.239 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T10:32:27.239 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T10:32:27.239 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T10:32:27.240 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-10-21T10:32:27.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:32:27.360 INFO:teuthology.dispatcher.supervisor:Running job 7433927 2023-10-21T10:32:27.360 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433927 --name yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} -- /home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433927/orig.config.yaml 2023-10-21T10:32:27.365 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433927 2023-10-21T10:32:27.365 INFO:teuthology.dispatcher.supervisor:Job PID: 3366305 2023-10-21T10:32:27.366 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T10:34:27.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:36:27.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:38:27.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:40:27.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:42:27.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:44:27.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:46:27.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T10:46:27.862 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T10:46:27.967 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T10:46:27.967 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T10:46:28.012 DEBUG:teuthology.nuke:shortname: smithi163 2023-10-21T10:46:28.012 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T10:46:28.037 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433927', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 10:27:02.921064', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCyIIqfXOQg6XOfE6VLqiQAr9WlS9ZK9mf1F0eL8vSxNq5mSslUSUed5YigBDW8TdfS2UxICJy2VFP5/64kwumg='} 2023-10-21T10:46:28.041 DEBUG:teuthology.nuke:shortname: smithi169 2023-10-21T10:46:28.041 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T10:46:28.061 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433927', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 10:27:02.922831', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCEzg1SN8/5dXZj+SGWF7TTX0ZARxm76WxmZ0NCpIvTTmzqwoaFU1RGLJfYMdgrNGG0NGiOc7zMf1cw7Pt7LiEA='} 2023-10-21T10:46:28.091 INFO:teuthology.orchestra.console.smithi163:Power off 2023-10-21T10:46:28.092 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:46:28.114 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-10-21T10:46:28.114 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:46:28.132 INFO:teuthology.orchestra.console.smithi169:Power off 2023-10-21T10:46:28.132 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T10:46:28.141 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-21T10:46:28.157 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-10-21T10:46:28.157 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T10:46:28.183 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-10-21T10:46:28.242 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-10-21T10:46:28.284 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-10-21T10:46:28.397 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2023-10-21T10:46:28.428 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com