2024-01-26T21:16:55.177 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-26T21:16:55.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:16:55.329 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f114041bc10>, signals=[15]) 2024-01-26T21:16:55.329 INFO:teuthology.lock.ops:Start node 'smithi076.front.sepia.ceph.com' reimaging 2024-01-26T21:16:55.330 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: reset os type and version on server 2024-01-26T21:16:55.330 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-01-26T21:16:55.359 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2024-01-26T21:16:55.359 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2024-01-26T21:16:55.359 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-01-26T21:16:55.486 DEBUG:teuthology.provision.fog.smithi076:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-26T21:16:55.491 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-26T21:16:55.539 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of rhel 8.6 2024-01-26T21:16:55.543 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of rhel 8.6 2024-01-26T21:16:55.900 INFO:teuthology.orchestra.console.smithi152:Power off 2024-01-26T21:16:55.901 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-26T21:16:55.914 INFO:teuthology.orchestra.console.smithi076:Power off 2024-01-26T21:16:55.915 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-26T21:16:55.927 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2024-01-26T21:16:55.928 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:16:55.942 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2024-01-26T21:16:55.943 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:16:55.957 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-01-26T21:16:55.965 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-01-26T21:16:59.960 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:16:59.967 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:17:00.070 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-01-26T21:17:00.076 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-01-26T21:17:04.072 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:17:04.079 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:17:04.182 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-01-26T21:17:04.188 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-01-26T21:17:04.283 INFO:teuthology.orchestra.console.smithi152:Power off completed 2024-01-26T21:17:04.288 INFO:teuthology.orchestra.console.smithi076:Power off completed 2024-01-26T21:17:04.384 INFO:teuthology.orchestra.console.smithi152:Power on 2024-01-26T21:17:04.384 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-26T21:17:04.392 INFO:teuthology.orchestra.console.smithi076:Power on 2024-01-26T21:17:04.392 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-26T21:17:04.406 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On 2024-01-26T21:17:04.406 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:17:04.418 DEBUG:teuthology.orchestra.console.smithi076:power on output: Chassis Power Control: Up/On 2024-01-26T21:17:04.418 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:17:04.431 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-01-26T21:17:04.439 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-01-26T21:17:08.439 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:17:08.450 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:17:08.551 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-01-26T21:17:08.559 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-01-26T21:17:12.556 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:17:12.564 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:17:12.667 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-01-26T21:17:12.673 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-01-26T21:17:12.768 INFO:teuthology.orchestra.console.smithi152:Power on completed 2024-01-26T21:17:12.774 INFO:teuthology.orchestra.console.smithi076:Power on completed 2024-01-26T21:17:12.869 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2024-01-26T21:17:12.874 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish 2024-01-26T21:19:58.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:19:58.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:19:59.199 ERROR:teuthology.orchestra.connection:Error authenticating with smithi076.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-26T21:20:17.468 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-26T21:20:23.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:20:26.524 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-26T21:20:32.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:20:35.580 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-26T21:20:37.692 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-26T21:20:41.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:20:43.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:20:44.636 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-26T21:20:46.748 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-26T21:20:50.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:20:52.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:20:53.696 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-26T21:20:55.804 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-26T21:20:59.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:21:01.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:21:04.860 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-26T21:21:10.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:21:59.700 WARNING:teuthology.provision.fog.smithi152:timed out 2024-01-26T21:22:05.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:22:05.922 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-26T21:22:05.922 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-26T21:22:06.192 INFO:teuthology.provision.fog.smithi152:Node is ready 2024-01-26T21:22:06.193 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2024-01-26T21:22:06.210 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2024-01-26T21:22:06.211 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2024-01-26T21:22:06.268 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2024-01-26T21:22:06.268 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2024-01-26T21:22:06.375 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2024-01-26T21:22:06.404 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2024-01-26T21:22:06.471 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2024-01-26T21:22:06.539 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2024-01-26T21:22:06.606 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-01-26T21:22:06.662 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2024-01-26T21:22:06.662 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)" 2024-01-26T21:22:06.662 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2024-01-26T21:22:06.662 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2024-01-26T21:22:06.663 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6" 2024-01-26T21:22:06.663 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2024-01-26T21:22:06.663 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-26T21:22:06.663 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-01-26T21:22:06.663 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-26T21:22:06.663 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2024-01-26T21:22:06.663 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-26T21:22:06.663 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-26T21:22:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-01-26T21:22:06.663 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-26T21:22:06.663 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-26T21:22:06.663 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-26T21:22:06.663 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-26T21:22:06.664 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2024-01-26T21:22:06.666 DEBUG:teuthology.parallel:result is None 2024-01-26T21:22:10.863 WARNING:teuthology.provision.fog.smithi076:timed out 2024-01-26T21:22:16.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:22:17.136 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-26T21:22:17.136 DEBUG:teuthology.orchestra.run.smithi076:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-26T21:22:17.393 INFO:teuthology.provision.fog.smithi076:Node is ready 2024-01-26T21:22:17.394 DEBUG:teuthology.orchestra.run.smithi076:> hostname 2024-01-26T21:22:17.410 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076 2024-01-26T21:22:17.410 DEBUG:teuthology.orchestra.run.smithi076:> grep smithi076 /etc/hosts 2024-01-26T21:22:17.469 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076 2024-01-26T21:22:17.469 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2024-01-26T21:22:17.581 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076/smithi076/g' /etc/hosts 2024-01-26T21:22:17.608 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/172.21.15.76/172.21.15.76/g' /etc/hosts 2024-01-26T21:22:17.675 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076/smithi076/g' /etc/hostname 2024-01-26T21:22:17.743 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2024-01-26T21:22:17.809 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-01-26T21:22:17.866 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Red Hat Enterprise Linux" 2024-01-26T21:22:17.867 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8.6 (Ootpa)" 2024-01-26T21:22:17.867 INFO:teuthology.orchestra.run.smithi076.stdout:ID="rhel" 2024-01-26T21:22:17.867 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="fedora" 2024-01-26T21:22:17.867 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8.6" 2024-01-26T21:22:17.867 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8" 2024-01-26T21:22:17.867 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-26T21:22:17.868 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-01-26T21:22:17.868 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-26T21:22:17.868 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.redhat.com/" 2024-01-26T21:22:17.868 INFO:teuthology.orchestra.run.smithi076.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-26T21:22:17.868 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-26T21:22:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-01-26T21:22:17.868 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-26T21:22:17.869 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-26T21:22:17.869 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-26T21:22:17.869 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-26T21:22:17.869 INFO:teuthology.provision.fog.smithi076:Deploy complete! 2024-01-26T21:22:17.870 DEBUG:teuthology.parallel:result is None 2024-01-26T21:22:18.025 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com 2024-01-26T21:22:18.026 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-26T21:22:18.051 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2024-01-26T21:22:18.051 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-26T21:22:18.076 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server 2024-01-26T21:22:18.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-01-26T21:22:18.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:22:18.153 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-01-26T21:22:18.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-01-26T21:22:18.220 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2024-01-26T21:22:18.276 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2024-01-26T21:22:18.276 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-01-26T21:22:18.332 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Red Hat Enterprise Linux" 2024-01-26T21:22:18.332 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8.6 (Ootpa)" 2024-01-26T21:22:18.332 INFO:teuthology.orchestra.run.smithi076.stdout:ID="rhel" 2024-01-26T21:22:18.332 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="fedora" 2024-01-26T21:22:18.332 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8.6" 2024-01-26T21:22:18.332 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8" 2024-01-26T21:22:18.332 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-26T21:22:18.332 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-01-26T21:22:18.332 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-26T21:22:18.333 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.redhat.com/" 2024-01-26T21:22:18.333 INFO:teuthology.orchestra.run.smithi076.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-26T21:22:18.333 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-26T21:22:18.333 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-01-26T21:22:18.333 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-26T21:22:18.333 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-26T21:22:18.333 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-26T21:22:18.333 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-26T21:22:18.334 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-01-26T21:22:18.352 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2024-01-26T21:22:18.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-01-26T21:22:18.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:22:18.425 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-01-26T21:22:18.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-01-26T21:22:18.566 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-01-26T21:22:18.623 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-01-26T21:22:18.623 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-01-26T21:22:18.679 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2024-01-26T21:22:18.679 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)" 2024-01-26T21:22:18.679 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6" 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-26T21:22:18.680 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-26T21:22:18.681 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-01-26T21:22:18.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:22:18.783 INFO:teuthology.dispatcher.supervisor:Running job 7533231 2024-01-26T21:22:18.783 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-26_01:05:00-fs-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533231 --name yuriw-2024-01-26_01:05:00-fs-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} -- /home/teuthworker/archive/yuriw-2024-01-26_01:05:00-fs-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533231/orig.config.yaml 2024-01-26T21:22:18.787 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-26_01:05:00-fs-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533231 2024-01-26T21:22:18.787 INFO:teuthology.dispatcher.supervisor:Job PID: 3966386 2024-01-26T21:22:18.787 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-26T21:24:18.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:26:18.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:28:18.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:30:19.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:32:19.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:34:19.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:34:19.234 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-26T21:34:19.339 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-26T21:34:19.339 INFO:teuthology.nuke:Checking targets against current locks 2024-01-26T21:34:19.388 DEBUG:teuthology.nuke:shortname: smithi076 2024-01-26T21:34:19.389 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-26T21:34:19.409 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_01:05:00-fs-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533231', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-26 21:16:54.114790', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIZZAN/zRh5JWVxSRiiNYL/Y9dGWocGWUHqa1sWuPPWHlnIF4jvELX72YcAngV2UA2Upn878jTKk+eIUEzpZGFI='} 2024-01-26T21:34:19.420 DEBUG:teuthology.nuke:shortname: smithi152 2024-01-26T21:34:19.420 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-26T21:34:19.442 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_01:05:00-fs-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533231', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-26 21:16:54.116382', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDu4v4Ht9xFM3qzmOiNVNzImEA9CK5A8BrWIMq52vc51K5R2CghM7M6MhVhrofY9TzlWnyZIIuf8uOIKlaGhJ+w='} 2024-01-26T21:34:19.462 INFO:teuthology.orchestra.console.smithi076:Power off 2024-01-26T21:34:19.462 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-26T21:34:19.488 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2024-01-26T21:34:19.488 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:34:19.502 INFO:teuthology.orchestra.console.smithi152:Power off 2024-01-26T21:34:19.502 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-26T21:34:19.511 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-01-26T21:34:19.522 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2024-01-26T21:34:19.522 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:34:19.544 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-01-26T21:34:19.612 INFO:teuthology.orchestra.console.smithi076:Power off completed 2024-01-26T21:34:19.645 INFO:teuthology.orchestra.console.smithi152:Power off completed 2024-01-26T21:34:19.760 INFO:teuthology.lock.ops:unlocked: smithi076.front.sepia.ceph.com 2024-01-26T21:34:19.792 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com