2024-01-23T00:35:11.289 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-23T00:35:11.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:35:11.434 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd999cdbc10>, signals=[15]) 2024-01-23T00:35:11.435 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2024-01-23T00:35:11.435 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2024-01-23T00:35:11.435 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-01-23T00:35:11.456 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2024-01-23T00:35:11.457 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2024-01-23T00:35:11.457 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-01-23T00:35:11.579 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_9.stream (ID 10) 2024-01-23T00:35:11.600 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_9.stream (ID 10) 2024-01-23T00:35:11.631 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 9.stream 2024-01-23T00:35:11.654 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 9.stream 2024-01-23T00:35:11.937 INFO:teuthology.orchestra.console.smithi115:Power off 2024-01-23T00:35:11.937 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T00:35:11.960 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-01-23T00:35:11.960 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:35:11.974 INFO:teuthology.orchestra.console.smithi012:Power off 2024-01-23T00:35:11.975 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T00:35:11.992 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-01-23T00:35:11.995 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2024-01-23T00:35:11.996 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:35:12.020 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-01-23T00:35:15.997 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:35:16.022 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:35:16.108 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-01-23T00:35:16.130 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-01-23T00:35:20.113 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:35:20.131 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:35:20.222 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-01-23T00:35:20.240 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-01-23T00:35:20.323 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-01-23T00:35:20.341 INFO:teuthology.orchestra.console.smithi012:Power off completed 2024-01-23T00:35:20.424 INFO:teuthology.orchestra.console.smithi115:Power on 2024-01-23T00:35:20.424 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-23T00:35:20.441 INFO:teuthology.orchestra.console.smithi012:Power on 2024-01-23T00:35:20.442 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-23T00:35:20.449 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2024-01-23T00:35:20.450 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:35:20.462 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On 2024-01-23T00:35:20.462 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:35:20.471 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-01-23T00:35:20.481 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-01-23T00:35:24.472 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:35:24.482 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:35:24.581 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-01-23T00:35:24.590 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-01-23T00:35:28.586 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:35:28.593 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:35:28.702 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-01-23T00:35:28.803 INFO:teuthology.orchestra.console.smithi012:Power on completed 2024-01-23T00:35:28.803 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-01-23T00:35:28.904 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2024-01-23T00:35:28.905 INFO:teuthology.orchestra.console.smithi115:Power on completed 2024-01-23T00:35:29.006 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2024-01-23T00:37:44.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:38:03.068 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-01-23T00:38:09.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:38:12.124 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-01-23T00:38:14.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:38:17.884 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-23T00:38:18.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:38:21.180 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-01-23T00:38:23.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:38:26.940 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-23T00:38:27.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:38:32.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:38:35.996 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-23T00:38:42.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:38:45.052 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-23T00:38:51.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:38:54.108 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-23T00:39:00.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:39:03.164 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-01-23T00:39:09.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:39:27.199 WARNING:teuthology.provision.fog.smithi012:timed out 2024-01-23T00:39:33.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:39:33.444 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-23T00:39:33.444 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-23T00:39:33.799 INFO:teuthology.provision.fog.smithi012:Node is ready 2024-01-23T00:39:33.799 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2024-01-23T00:39:33.813 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2024-01-23T00:39:33.814 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2024-01-23T00:39:33.869 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2024-01-23T00:39:33.869 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2024-01-23T00:39:33.974 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2024-01-23T00:39:34.006 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2024-01-23T00:39:34.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2024-01-23T00:39:34.149 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2024-01-23T00:39:34.219 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-01-23T00:39:34.274 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-01-23T00:39:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-01-23T00:39:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-01-23T00:39:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-01-23T00:39:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-01-23T00:39:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-01-23T00:39:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T00:39:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-01-23T00:39:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-01-23T00:39:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T00:39:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-01-23T00:39:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T00:39:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T00:39:34.276 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T00:39:34.276 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2024-01-23T00:39:34.278 DEBUG:teuthology.parallel:result is None 2024-01-23T00:40:09.207 WARNING:teuthology.provision.fog.smithi115:timed out 2024-01-23T00:40:15.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:40:15.721 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-23T00:40:15.721 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-23T00:40:16.028 INFO:teuthology.provision.fog.smithi115:Node is ready 2024-01-23T00:40:16.028 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2024-01-23T00:40:16.043 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2024-01-23T00:40:16.043 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2024-01-23T00:40:16.098 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2024-01-23T00:40:16.099 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-01-23T00:40:16.206 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2024-01-23T00:40:16.234 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2024-01-23T00:40:16.301 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2024-01-23T00:40:16.368 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-01-23T00:40:16.435 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-01-23T00:40:16.489 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-01-23T00:40:16.489 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-01-23T00:40:16.489 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-01-23T00:40:16.489 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-01-23T00:40:16.489 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-01-23T00:40:16.489 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-01-23T00:40:16.489 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T00:40:16.490 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-01-23T00:40:16.490 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-01-23T00:40:16.490 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T00:40:16.490 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-01-23T00:40:16.490 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T00:40:16.490 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T00:40:16.490 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T00:40:16.490 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2024-01-23T00:40:16.491 DEBUG:teuthology.parallel:result is None 2024-01-23T00:40:16.663 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2024-01-23T00:40:16.664 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-23T00:40:16.692 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2024-01-23T00:40:16.692 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-23T00:40:16.717 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2024-01-23T00:40:16.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-01-23T00:40:16.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:40:16.822 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-01-23T00:40:17.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-01-23T00:40:17.006 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-01-23T00:40:17.061 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-01-23T00:40:17.061 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-01-23T00:40:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-01-23T00:40:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-01-23T00:40:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-01-23T00:40:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-01-23T00:40:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-01-23T00:40:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-01-23T00:40:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T00:40:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-01-23T00:40:17.117 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-01-23T00:40:17.117 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T00:40:17.117 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-01-23T00:40:17.117 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T00:40:17.117 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T00:40:17.117 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T00:40:17.117 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-01-23T00:40:17.217 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2024-01-23T00:40:17.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-01-23T00:40:17.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T00:40:17.342 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-01-23T00:40:17.367 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-01-23T00:40:17.367 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-01-23T00:40:17.422 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-01-23T00:40:17.422 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-01-23T00:40:17.477 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-01-23T00:40:17.478 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-01-23T00:40:17.478 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-01-23T00:40:17.478 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-01-23T00:40:17.478 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-01-23T00:40:17.478 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-01-23T00:40:17.478 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T00:40:17.478 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-01-23T00:40:17.478 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-01-23T00:40:17.478 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T00:40:17.478 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-01-23T00:40:17.478 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T00:40:17.479 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T00:40:17.479 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T00:40:17.479 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-01-23T00:40:17.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:40:17.605 INFO:teuthology.dispatcher.supervisor:Running job 7527487 2024-01-23T00:40:17.606 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_sjust@teuthology --archive /home/teuthworker/archive/sjust-2024-01-23_00:22:51-crimson-rados-wip-sjust-crimson-testing-2024-01-22-distro-default-smithi/7527487 --name sjust-2024-01-23_00:22:51-crimson-rados-wip-sjust-crimson-testing-2024-01-22-distro-default-smithi --description crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} -- /home/teuthworker/archive/sjust-2024-01-23_00:22:51-crimson-rados-wip-sjust-crimson-testing-2024-01-22-distro-default-smithi/7527487/orig.config.yaml 2024-01-23T00:40:17.609 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sjust-2024-01-23_00:22:51-crimson-rados-wip-sjust-crimson-testing-2024-01-22-distro-default-smithi/7527487 2024-01-23T00:40:17.609 INFO:teuthology.dispatcher.supervisor:Job PID: 136661 2024-01-23T00:40:17.609 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-23T00:42:17.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:44:17.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:46:18.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:48:18.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:50:18.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:52:18.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T00:52:18.712 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-23T00:52:18.886 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-23T00:52:18.887 INFO:teuthology.nuke:Checking targets against current locks 2024-01-23T00:52:18.933 DEBUG:teuthology.nuke:shortname: smithi012 2024-01-23T00:52:18.934 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T00:52:18.960 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2024-01-23_00:22:51-crimson-rados-wip-sjust-crimson-testing-2024-01-22-distro-default-smithi/7527487', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 00:35:10.190488', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCDRWWzj4EKakC0dfjxPkG3xthE3CVT+dqvZQYUsYXQ9eDhNWCHAd6I5qni9EyMdsC4ylstxnECKqD3pV+qesDg='} 2024-01-23T00:52:18.963 DEBUG:teuthology.nuke:shortname: smithi115 2024-01-23T00:52:18.963 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T00:52:18.989 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sjust-2024-01-23_00:22:51-crimson-rados-wip-sjust-crimson-testing-2024-01-22-distro-default-smithi/7527487', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 00:35:10.191992', 'locked_by': 'scheduled_sjust@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGjkgSVKAuy8z4o5GFrDz4v49caLknS07OQyUdH6K2frQxMafR5ZDfO8fwFVKL8+2elqEtuZOfPSbUEA5O1ziz4='} 2024-01-23T00:52:19.015 INFO:teuthology.orchestra.console.smithi012:Power off 2024-01-23T00:52:19.015 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T00:52:19.039 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2024-01-23T00:52:19.040 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:52:19.054 INFO:teuthology.orchestra.console.smithi115:Power off 2024-01-23T00:52:19.055 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T00:52:19.064 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-01-23T00:52:19.076 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-01-23T00:52:19.077 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T00:52:19.097 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-01-23T00:52:19.165 INFO:teuthology.orchestra.console.smithi012:Power off completed 2024-01-23T00:52:19.199 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-01-23T00:52:19.310 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2024-01-23T00:52:19.343 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com