2024-01-13T03:03:28.545 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-13T03:03:28.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T03:03:28.691 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1f53282c10>, signals=[15]) 2024-01-13T03:03:28.692 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2024-01-13T03:03:28.692 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T03:03:28.692 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-01-13T03:03:28.713 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2024-01-13T03:03:28.713 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T03:03:28.714 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-01-13T03:03:28.845 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-13T03:03:28.853 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-13T03:03:28.906 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of rhel 8.6 2024-01-13T03:03:28.911 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of rhel 8.6 2024-01-13T03:03:29.190 INFO:teuthology.orchestra.console.smithi115:Power off 2024-01-13T03:03:29.190 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T03:03:29.203 INFO:teuthology.orchestra.console.smithi181:Power off 2024-01-13T03:03:29.203 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T03:03:29.212 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-01-13T03:03:29.212 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:03:29.228 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2024-01-13T03:03:29.228 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:03:29.237 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-01-13T03:03:29.252 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-01-13T03:03:29.338 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-01-13T03:03:29.353 INFO:teuthology.orchestra.console.smithi181:Power off completed 2024-01-13T03:03:29.439 INFO:teuthology.orchestra.console.smithi115:Power on 2024-01-13T03:03:29.439 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T03:03:29.453 INFO:teuthology.orchestra.console.smithi181:Power on 2024-01-13T03:03:29.454 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T03:03:29.461 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2024-01-13T03:03:29.462 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:03:29.474 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2024-01-13T03:03:29.475 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:03:29.482 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-01-13T03:03:29.498 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-01-13T03:03:33.484 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:03:33.499 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:03:33.594 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-01-13T03:03:33.611 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-01-13T03:03:33.695 INFO:teuthology.orchestra.console.smithi115:Power on completed 2024-01-13T03:03:33.712 INFO:teuthology.orchestra.console.smithi181:Power on completed 2024-01-13T03:03:33.796 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2024-01-13T03:03:33.812 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2024-01-13T03:06:19.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:06:19.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:06:23.008 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-01-13T03:06:23.036 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-13T03:06:29.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:06:29.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:06:32.092 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-01-13T03:06:32.092 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-13T03:06:38.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:06:38.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:06:41.184 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-01-13T03:06:41.184 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-13T03:06:47.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:06:47.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:06:50.268 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-13T03:06:50.268 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-01-13T03:06:56.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:06:56.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:06:59.360 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-13T03:06:59.360 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-01-13T03:07:05.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:07:05.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:07:08.444 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-13T03:07:08.444 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-01-13T03:07:14.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:07:14.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:07:17.536 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-13T03:07:23.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:08:14.504 WARNING:teuthology.provision.fog.smithi181:timed out 2024-01-13T03:08:20.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:08:20.751 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T03:08:20.752 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T03:08:21.007 INFO:teuthology.provision.fog.smithi181:Node is ready 2024-01-13T03:08:21.008 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2024-01-13T03:08:21.066 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2024-01-13T03:08:21.067 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts 2024-01-13T03:08:21.125 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2024-01-13T03:08:21.125 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2024-01-13T03:08:21.241 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts 2024-01-13T03:08:21.271 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2024-01-13T03:08:21.339 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname 2024-01-13T03:08:21.407 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2024-01-13T03:08:21.473 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-01-13T03:08:21.530 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T03:08:21.531 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T03:08:21.531 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel" 2024-01-13T03:08:21.531 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora" 2024-01-13T03:08:21.531 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6" 2024-01-13T03:08:21.531 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2024-01-13T03:08:21.531 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T03:08:21.531 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-01-13T03:08:21.531 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T03:08:21.531 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T03:08:21.531 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T03:08:21.531 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T03:08:21.532 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-13T03:08:21.532 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T03:08:21.532 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T03:08:21.532 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T03:08:21.532 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T03:08:21.533 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2024-01-13T03:08:21.534 DEBUG:teuthology.parallel:result is None 2024-01-13T03:08:23.544 WARNING:teuthology.provision.fog.smithi115:timed out 2024-01-13T03:08:29.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:08:29.769 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T03:08:29.769 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T03:08:30.037 INFO:teuthology.provision.fog.smithi115:Node is ready 2024-01-13T03:08:30.038 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2024-01-13T03:08:30.098 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115 2024-01-13T03:08:30.099 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115 /etc/hosts 2024-01-13T03:08:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2024-01-13T03:08:30.160 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-01-13T03:08:30.267 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115/smithi115/g' /etc/hosts 2024-01-13T03:08:30.294 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2024-01-13T03:08:30.364 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115/smithi115/g' /etc/hostname 2024-01-13T03:08:30.434 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-01-13T03:08:30.503 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-01-13T03:08:30.562 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T03:08:30.563 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T03:08:30.563 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel" 2024-01-13T03:08:30.563 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora" 2024-01-13T03:08:30.563 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.6" 2024-01-13T03:08:30.563 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2024-01-13T03:08:30.563 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T03:08:30.563 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-01-13T03:08:30.563 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T03:08:30.563 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T03:08:30.563 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T03:08:30.563 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T03:08:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-01-13T03:08:30.564 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T03:08:30.564 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T03:08:30.564 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T03:08:30.564 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T03:08:30.564 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2024-01-13T03:08:30.565 DEBUG:teuthology.parallel:result is None 2024-01-13T03:08:30.745 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2024-01-13T03:08:30.745 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T03:08:30.772 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2024-01-13T03:08:30.772 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T03:08:30.798 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2024-01-13T03:08:30.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-01-13T03:08:30.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:08:30.870 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-01-13T03:08:30.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-01-13T03:08:30.893 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-01-13T03:08:30.954 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-01-13T03:08:30.955 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-01-13T03:08:31.015 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T03:08:31.015 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T03:08:31.015 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel" 2024-01-13T03:08:31.015 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora" 2024-01-13T03:08:31.015 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.6" 2024-01-13T03:08:31.015 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2024-01-13T03:08:31.015 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T03:08:31.016 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-01-13T03:08:31.016 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T03:08:31.016 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T03:08:31.016 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T03:08:31.016 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T03:08:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-01-13T03:08:31.016 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T03:08:31.016 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T03:08:31.016 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T03:08:31.016 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T03:08:31.017 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-01-13T03:08:31.039 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2024-01-13T03:08:31.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-01-13T03:08:31.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:08:31.114 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-01-13T03:08:31.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-01-13T03:08:31.184 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-01-13T03:08:31.244 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-01-13T03:08:31.244 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-01-13T03:08:31.304 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T03:08:31.304 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T03:08:31.304 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel" 2024-01-13T03:08:31.304 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora" 2024-01-13T03:08:31.304 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6" 2024-01-13T03:08:31.304 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2024-01-13T03:08:31.304 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T03:08:31.304 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-01-13T03:08:31.305 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T03:08:31.305 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T03:08:31.305 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T03:08:31.305 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T03:08:31.305 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-13T03:08:31.305 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T03:08:31.305 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T03:08:31.306 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T03:08:31.306 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T03:08:31.306 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-01-13T03:08:31.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T03:08:31.446 INFO:teuthology.dispatcher.supervisor:Running job 7515020 2024-01-13T03:08:31.447 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515020 --name yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} -- /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515020/orig.config.yaml 2024-01-13T03:08:31.450 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515020 2024-01-13T03:08:31.450 INFO:teuthology.dispatcher.supervisor:Job PID: 1705336 2024-01-13T03:08:31.450 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-13T03:10:31.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T03:12:31.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T03:14:31.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T03:16:32.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T03:18:32.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T03:20:32.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T03:22:32.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T03:22:32.629 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-13T03:22:32.744 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-13T03:22:32.745 INFO:teuthology.nuke:Checking targets against current locks 2024-01-13T03:22:32.793 DEBUG:teuthology.nuke:shortname: smithi115 2024-01-13T03:22:32.793 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T03:22:32.817 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515020', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 03:03:27.468358', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEA5cmyGFeetJWGXef9FxhvvnZTZ1nPrGzPlwtEor9+FpBceLOR+tjDfjiLaCI9LsHqXb0gJpc3mgyg+hMl3Kn8='} 2024-01-13T03:22:32.820 DEBUG:teuthology.nuke:shortname: smithi181 2024-01-13T03:22:32.820 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T03:22:32.843 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515020', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 03:03:27.466475', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBF9WiqrXXHzXsOjf+hup08WJkeNPLgZarUIGOBnyHPzsaVxJmnvLwwkVcjZb9T/gi/MDZFD8QWniDR8RbbwXGc='} 2024-01-13T03:22:32.873 INFO:teuthology.orchestra.console.smithi115:Power off 2024-01-13T03:22:32.873 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T03:22:32.895 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-01-13T03:22:32.895 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:22:32.910 INFO:teuthology.orchestra.console.smithi181:Power off 2024-01-13T03:22:32.910 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T03:22:32.920 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-01-13T03:22:32.931 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2024-01-13T03:22:32.932 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:22:32.952 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-01-13T03:22:33.021 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-01-13T03:22:33.053 INFO:teuthology.orchestra.console.smithi181:Power off completed 2024-01-13T03:22:33.170 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2024-01-13T03:22:33.194 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com