2023-11-28T04:17:00.307 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-28T04:17:00.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:17:00.449 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fca7cbec670>, signals=[15]) 2023-11-28T04:17:00.449 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-11-28T04:17:00.450 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T04:17:00.450 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-11-28T04:17:00.477 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-11-28T04:17:00.477 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T04:17:00.477 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-11-28T04:17:00.602 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_8.stream (ID 3) 2023-11-28T04:17:00.623 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_8.stream (ID 3) 2023-11-28T04:17:00.650 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 8.stream 2023-11-28T04:17:00.665 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 8.stream 2023-11-28T04:17:00.924 INFO:teuthology.orchestra.console.smithi203:Power off 2023-11-28T04:17:00.924 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T04:17:00.939 INFO:teuthology.orchestra.console.smithi026:Power off 2023-11-28T04:17:00.940 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T04:17:00.948 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-11-28T04:17:00.949 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:17:00.963 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-11-28T04:17:00.964 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:17:00.972 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-11-28T04:17:00.985 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-11-28T04:17:04.975 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:17:04.987 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:17:05.085 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-11-28T04:17:05.095 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-11-28T04:17:09.090 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:17:09.097 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:17:09.199 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-11-28T04:17:09.204 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-11-28T04:17:09.300 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-11-28T04:17:09.305 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-11-28T04:17:09.401 INFO:teuthology.orchestra.console.smithi203:Power on 2023-11-28T04:17:09.401 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T04:17:09.409 INFO:teuthology.orchestra.console.smithi026:Power on 2023-11-28T04:17:09.409 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T04:17:09.428 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On 2023-11-28T04:17:09.429 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:17:09.442 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On 2023-11-28T04:17:09.442 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:17:09.451 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-11-28T04:17:09.464 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-11-28T04:17:13.454 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:17:13.465 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:17:13.563 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-11-28T04:17:13.573 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-11-28T04:17:17.566 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:17:17.574 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:17:17.683 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-11-28T04:17:17.784 INFO:teuthology.orchestra.console.smithi026:Power on completed 2023-11-28T04:17:17.811 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-11-28T04:17:17.885 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-11-28T04:17:17.913 INFO:teuthology.orchestra.console.smithi203:Power on completed 2023-11-28T04:17:18.014 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-11-28T04:19:33.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:19:33.989 ERROR:teuthology.orchestra.connection:Error authenticating with smithi026.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-28T04:20:03.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:20:06.950 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-28T04:20:12.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:20:16.002 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-28T04:20:22.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:20:25.058 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-28T04:20:31.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:20:34.114 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-28T04:20:37.992 WARNING:teuthology.provision.fog.smithi026:timed out 2023-11-28T04:20:40.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:20:43.174 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-28T04:20:43.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:20:49.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:20:52.226 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-28T04:20:58.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:21:01.282 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-28T04:21:09.257 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T04:21:09.257 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T04:21:14.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:21:19.937 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-11-28T04:21:19.938 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-11-28T04:21:19.963 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2023-11-28T04:21:19.963 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2023-11-28T04:21:20.025 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2023-11-28T04:21:20.026 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-11-28T04:21:20.151 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2023-11-28T04:21:20.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2023-11-28T04:21:20.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2023-11-28T04:21:20.326 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-11-28T04:21:20.395 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-11-28T04:21:20.454 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-11-28T04:21:20.454 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2023-11-28T04:21:20.455 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-11-28T04:21:20.455 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-11-28T04:21:20.455 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2023-11-28T04:21:20.455 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-11-28T04:21:20.455 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-28T04:21:20.455 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-11-28T04:21:20.455 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-28T04:21:20.455 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-11-28T04:21:20.455 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T04:21:20.455 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T04:21:20.455 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T04:21:20.456 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-11-28T04:21:20.457 DEBUG:teuthology.parallel:result is None 2023-11-28T04:21:33.154 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-28T04:21:39.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:21:42.210 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-28T04:21:48.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:21:51.161 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T04:21:51.161 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T04:22:16.185 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-11-28T04:22:16.185 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-11-28T04:22:16.210 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-11-28T04:22:16.210 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-11-28T04:22:16.271 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-11-28T04:22:16.272 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-11-28T04:22:16.403 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-11-28T04:22:16.435 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-11-28T04:22:16.506 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-11-28T04:22:16.576 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-11-28T04:22:16.645 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-11-28T04:22:16.703 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-11-28T04:22:16.703 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-11-28T04:22:16.703 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-11-28T04:22:16.704 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-11-28T04:22:16.704 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-11-28T04:22:16.704 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-11-28T04:22:16.704 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-28T04:22:16.704 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-11-28T04:22:16.704 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-28T04:22:16.704 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-11-28T04:22:16.704 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T04:22:16.704 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T04:22:16.705 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T04:22:16.705 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-11-28T04:22:16.705 DEBUG:teuthology.parallel:result is None 2023-11-28T04:22:16.875 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-11-28T04:22:16.875 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T04:22:16.898 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-11-28T04:22:16.898 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T04:22:16.923 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-11-28T04:22:16.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-11-28T04:22:16.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:22:16.992 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-11-28T04:22:17.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-11-28T04:22:17.135 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-11-28T04:22:17.195 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-11-28T04:22:17.195 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-11-28T04:22:17.255 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-11-28T04:22:17.255 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2023-11-28T04:22:17.256 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-11-28T04:22:17.256 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-11-28T04:22:17.256 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2023-11-28T04:22:17.256 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-11-28T04:22:17.256 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-28T04:22:17.256 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-11-28T04:22:17.256 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-28T04:22:17.256 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-11-28T04:22:17.256 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T04:22:17.256 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T04:22:17.256 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T04:22:17.257 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-11-28T04:22:17.281 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-11-28T04:22:17.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-11-28T04:22:17.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T04:22:17.352 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-11-28T04:22:17.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-11-28T04:22:17.422 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-11-28T04:22:17.481 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-11-28T04:22:17.482 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-11-28T04:22:17.540 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-11-28T04:22:17.540 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-11-28T04:22:17.540 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-11-28T04:22:17.540 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-11-28T04:22:17.541 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-11-28T04:22:17.541 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-11-28T04:22:17.541 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-28T04:22:17.541 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-11-28T04:22:17.541 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-28T04:22:17.541 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-11-28T04:22:17.541 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T04:22:17.541 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T04:22:17.541 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T04:22:17.542 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-11-28T04:22:17.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:22:17.665 INFO:teuthology.dispatcher.supervisor:Running job 7468847 2023-11-28T04:22:17.665 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468847 --name yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} -- /home/teuthworker/archive/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468847/orig.config.yaml 2023-11-28T04:22:17.683 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468847 2023-11-28T04:22:17.684 INFO:teuthology.dispatcher.supervisor:Job PID: 694094 2023-11-28T04:22:17.685 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T04:24:17.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:26:17.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:28:17.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:30:17.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:32:17.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:34:18.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:36:18.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:38:18.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:40:18.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:42:18.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:44:18.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:46:18.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:48:18.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:50:18.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:52:18.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:54:18.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:56:18.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:58:19.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T04:58:19.134 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-28T04:58:19.300 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-28T04:58:19.300 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T04:58:19.351 DEBUG:teuthology.nuke:shortname: smithi026 2023-11-28T04:58:19.353 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T04:58:19.367 DEBUG:teuthology.nuke:shortname: smithi203 2023-11-28T04:58:19.367 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T04:58:19.372 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468847', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 04:16:59.461185', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHTdQPlOXlhzVi05/IUU7Vycsig8hMgo5rVkXyhpJAaO6llJmBGUxkyzLbXKVJO2Lt8HEEk2k9M+5XgR4pzObWw='} 2023-11-28T04:58:19.388 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468847', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 04:16:59.463108', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK03xQC32f+Rd+bTthQuyh7EAG0j/fsihzGNe6O7Su4bsk0ZmtdO9oGlGulTkEc1DUKewUq3p31CYe0AfDd7IQc='} 2023-11-28T04:58:19.421 INFO:teuthology.orchestra.console.smithi026:Power off 2023-11-28T04:58:19.421 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T04:58:19.435 INFO:teuthology.orchestra.console.smithi203:Power off 2023-11-28T04:58:19.435 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T04:58:19.443 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-11-28T04:58:19.444 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:58:19.456 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-11-28T04:58:19.456 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T04:58:19.465 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-11-28T04:58:19.478 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-11-28T04:58:19.566 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-11-28T04:58:19.579 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-11-28T04:58:19.715 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2023-11-28T04:58:19.724 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com