2023-10-18T17:07:36.338 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-18T17:07:36.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:07:36.483 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f780c2b9670>, signals=[15]) 2023-10-18T17:07:36.484 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2023-10-18T17:07:36.484 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T17:07:36.485 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-10-18T17:07:36.511 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-10-18T17:07:36.511 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T17:07:36.512 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-10-18T17:07:36.513 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /host {"name": "smithi170"} 2023-10-18T17:07:36.536 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"} 2023-10-18T17:07:36.586 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-18T17:07:36.594 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-18T17:07:36.630 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_centos_8.stream (ID 3) 2023-10-18T17:07:36.631 DEBUG:teuthology.provision.fog.smithi170:FOG request: PUT /host/275 {"imageID": 3} 2023-10-18T17:07:36.636 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_centos_8.stream (ID 3) 2023-10-18T17:07:36.637 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 3} 2023-10-18T17:07:36.673 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 8.stream 2023-10-18T17:07:36.674 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-18T17:07:36.679 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 8.stream 2023-10-18T17:07:36.679 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:07:36.734 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T17:07:36.744 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T17:07:36.768 DEBUG:teuthology.provision.fog.smithi170:FOG request: POST /host/275/task {"taskTypeID": 1} 2023-10-18T17:07:36.784 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1} 2023-10-18T17:07:36.829 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-18T17:07:36.835 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:07:36.919 INFO:teuthology.orchestra.console.smithi170:Power off 2023-10-18T17:07:36.920 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T17:07:36.932 INFO:teuthology.orchestra.console.smithi186:Power off 2023-10-18T17:07:36.933 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T17:07:36.941 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-10-18T17:07:36.942 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:07:36.954 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-10-18T17:07:36.955 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:07:36.963 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-10-18T17:07:36.974 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-18T17:07:37.064 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-10-18T17:07:37.075 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-10-18T17:07:37.166 INFO:teuthology.orchestra.console.smithi170:Power on 2023-10-18T17:07:37.166 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T17:07:37.177 INFO:teuthology.orchestra.console.smithi186:Power on 2023-10-18T17:07:37.177 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T17:07:37.190 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On 2023-10-18T17:07:37.191 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:07:37.199 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-10-18T17:07:37.199 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:07:37.211 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-10-18T17:07:37.219 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-18T17:07:41.214 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:07:41.220 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:07:41.323 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-10-18T17:07:41.329 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-10-18T17:07:41.430 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-10-18T17:07:41.531 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-10-18T17:07:41.531 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:07:45.326 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:07:45.434 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-10-18T17:07:45.535 INFO:teuthology.orchestra.console.smithi170:Power on completed 2023-10-18T17:07:45.636 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2023-10-18T17:07:45.637 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-18T17:07:56.606 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:08:00.698 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-18T17:08:11.689 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:08:15.758 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-18T17:08:26.762 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:08:30.822 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-18T17:08:41.830 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:08:45.887 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-18T17:08:56.898 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:09:00.950 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-18T17:09:11.966 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:09:16.016 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-18T17:09:27.034 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:09:31.083 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-18T17:09:42.108 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:09:46.150 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-18T17:09:57.190 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:10:01.227 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-18T17:10:12.259 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:10:16.298 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-18T17:10:16.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:10:16.651 ERROR:teuthology.orchestra.connection:Error authenticating with smithi170.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-18T17:10:27.322 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-10-18T17:10:27.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:10:45.886 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-18T17:10:51.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:10:54.970 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-18T17:11:00.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:11:04.026 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-18T17:11:10.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:11:13.082 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-18T17:11:19.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:11:20.656 WARNING:teuthology.provision.fog.smithi170:timed out 2023-10-18T17:11:22.138 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-10-18T17:11:26.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:11:28.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:11:45.018 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-10-18T17:11:51.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:11:51.923 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T17:11:51.924 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T17:12:17.285 INFO:teuthology.provision.fog.smithi170:Node is ready 2023-10-18T17:12:17.286 DEBUG:teuthology.orchestra.run.smithi170:> hostname 2023-10-18T17:12:17.350 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2023-10-18T17:12:17.355 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170.front.sepia.ceph.com /etc/hosts 2023-10-18T17:12:17.411 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2023-10-18T17:12:17.412 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-10-18T17:12:17.532 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hosts 2023-10-18T17:12:17.565 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts 2023-10-18T17:12:17.635 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hostname 2023-10-18T17:12:17.704 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-10-18T17:12:17.772 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-10-18T17:12:17.830 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2023-10-18T17:12:17.831 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8" 2023-10-18T17:12:17.831 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2023-10-18T17:12:17.831 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2023-10-18T17:12:17.831 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8" 2023-10-18T17:12:17.832 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2023-10-18T17:12:17.832 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-18T17:12:17.832 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-10-18T17:12:17.832 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-18T17:12:17.832 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2023-10-18T17:12:17.833 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T17:12:17.833 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T17:12:17.833 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T17:12:17.834 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2023-10-18T17:12:17.835 DEBUG:teuthology.parallel:result is None 2023-10-18T17:12:28.142 WARNING:teuthology.provision.fog.smithi186:timed out 2023-10-18T17:12:34.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:12:34.369 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T17:12:34.370 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T17:12:34.644 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-10-18T17:12:34.645 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-10-18T17:12:34.665 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com 2023-10-18T17:12:34.666 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts 2023-10-18T17:12:34.726 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2023-10-18T17:12:34.727 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-10-18T17:12:34.840 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts 2023-10-18T17:12:34.872 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2023-10-18T17:12:34.942 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname 2023-10-18T17:12:35.013 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-10-18T17:12:35.081 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-10-18T17:12:35.140 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-10-18T17:12:35.140 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-10-18T17:12:35.140 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-10-18T17:12:35.141 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-10-18T17:12:35.141 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-10-18T17:12:35.141 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-10-18T17:12:35.141 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-18T17:12:35.141 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-10-18T17:12:35.141 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-18T17:12:35.142 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-10-18T17:12:35.142 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T17:12:35.142 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T17:12:35.142 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T17:12:35.143 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-10-18T17:12:35.144 DEBUG:teuthology.parallel:result is None 2023-10-18T17:12:35.292 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2023-10-18T17:12:35.293 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T17:12:35.316 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-10-18T17:12:35.316 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T17:12:35.341 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2023-10-18T17:12:35.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-10-18T17:12:35.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:12:35.412 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-10-18T17:12:35.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-10-18T17:12:35.554 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2023-10-18T17:12:35.613 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2023-10-18T17:12:35.614 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-10-18T17:12:35.672 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2023-10-18T17:12:35.673 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8" 2023-10-18T17:12:35.673 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2023-10-18T17:12:35.673 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2023-10-18T17:12:35.673 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8" 2023-10-18T17:12:35.673 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2023-10-18T17:12:35.674 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-18T17:12:35.674 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-10-18T17:12:35.674 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-18T17:12:35.674 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2023-10-18T17:12:35.674 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T17:12:35.675 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T17:12:35.675 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T17:12:35.675 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-10-18T17:12:35.699 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-10-18T17:12:35.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-10-18T17:12:35.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T17:12:35.768 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-10-18T17:12:35.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-10-18T17:12:35.837 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-10-18T17:12:35.894 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-10-18T17:12:35.894 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-10-18T17:12:35.952 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-10-18T17:12:35.952 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-10-18T17:12:35.952 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-10-18T17:12:35.953 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-10-18T17:12:35.953 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-10-18T17:12:35.953 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-10-18T17:12:35.953 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-18T17:12:35.954 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-10-18T17:12:35.954 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-18T17:12:35.954 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-10-18T17:12:35.954 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T17:12:35.954 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T17:12:35.955 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T17:12:35.955 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-10-18T17:12:35.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:12:36.079 INFO:teuthology.dispatcher.supervisor:Running job 7429139 2023-10-18T17:12:36.079 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429139 --name vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} -- /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429139/orig.config.yaml 2023-10-18T17:12:36.082 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429139 2023-10-18T17:12:36.083 INFO:teuthology.dispatcher.supervisor:Job PID: 1348540 2023-10-18T17:12:36.083 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-18T17:14:36.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:16:36.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:18:36.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:20:36.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:22:36.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:24:36.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:26:36.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:28:36.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:30:36.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:32:36.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:34:36.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:36:36.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T17:36:36.986 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-18T17:36:37.091 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-18T17:36:37.091 INFO:teuthology.nuke:Checking targets against current locks 2023-10-18T17:36:37.143 DEBUG:teuthology.nuke:shortname: smithi170 2023-10-18T17:36:37.144 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T17:36:37.165 DEBUG:teuthology.nuke:shortname: smithi186 2023-10-18T17:36:37.166 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T17:36:37.169 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429139', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 17:07:35.487657', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAyzBAlsCpA01Kjrq3tvpNRAdUX1wp00lJ+MLgPhaS3doD0a3yOYslgembx2jNIvodkJUsk9C0a6pri1kTYkkqk='} 2023-10-18T17:36:37.191 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429139', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 17:07:35.489527', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI67+Q+KXZthuj06M3rgm6ctZUiS7hZa/LUmQRXMjTfl1f7WdWdBGNJT6Sxz4vuy7CoQl8/6x9xP8BA0v1f2b80='} 2023-10-18T17:36:37.221 INFO:teuthology.orchestra.console.smithi170:Power off 2023-10-18T17:36:37.221 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T17:36:37.243 INFO:teuthology.orchestra.console.smithi186:Power off 2023-10-18T17:36:37.243 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T17:36:37.251 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-10-18T17:36:37.251 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:36:37.265 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-10-18T17:36:37.265 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T17:36:37.273 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-10-18T17:36:37.287 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-10-18T17:36:37.374 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-10-18T17:36:37.388 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-10-18T17:36:37.519 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com 2023-10-18T17:36:37.536 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com