2024-01-23T06:54:05.236 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-23T06:54:05.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T06:54:05.393 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffb7bdf0c10>, signals=[15]) 2024-01-23T06:54:05.394 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2024-01-23T06:54:05.394 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2024-01-23T06:54:05.394 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-01-23T06:54:05.417 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2024-01-23T06:54:05.417 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2024-01-23T06:54:05.417 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-01-23T06:54:05.533 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_centos_9.stream (ID 10) 2024-01-23T06:54:05.566 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_centos_9.stream (ID 10) 2024-01-23T06:54:05.581 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 9.stream 2024-01-23T06:54:05.612 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of centos 9.stream 2024-01-23T06:54:05.864 INFO:teuthology.orchestra.console.smithi049:Power off 2024-01-23T06:54:05.864 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T06:54:05.878 INFO:teuthology.orchestra.console.smithi148:Power off 2024-01-23T06:54:05.878 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T06:54:05.888 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-01-23T06:54:05.888 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:54:05.900 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2024-01-23T06:54:05.900 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:54:05.910 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-01-23T06:54:05.922 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-01-23T06:54:09.912 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:54:09.923 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:54:10.022 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-01-23T06:54:10.031 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-01-23T06:54:14.024 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:54:14.032 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:54:14.132 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-01-23T06:54:14.140 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-01-23T06:54:14.234 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-01-23T06:54:14.241 INFO:teuthology.orchestra.console.smithi148:Power off completed 2024-01-23T06:54:14.334 INFO:teuthology.orchestra.console.smithi049:Power on 2024-01-23T06:54:14.335 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-23T06:54:14.342 INFO:teuthology.orchestra.console.smithi148:Power on 2024-01-23T06:54:14.343 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-23T06:54:14.357 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2024-01-23T06:54:14.357 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:54:14.365 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2024-01-23T06:54:14.366 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:54:14.378 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-01-23T06:54:14.388 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-01-23T06:54:18.380 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:54:18.389 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:54:18.489 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-01-23T06:54:18.497 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-01-23T06:54:22.492 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:54:22.499 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:54:22.601 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-01-23T06:54:22.607 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-01-23T06:54:22.702 INFO:teuthology.orchestra.console.smithi049:Power on completed 2024-01-23T06:54:22.708 INFO:teuthology.orchestra.console.smithi148:Power on completed 2024-01-23T06:54:22.804 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2024-01-23T06:54:22.809 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2024-01-23T06:57:08.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:57:11.932 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-23T06:57:17.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:57:20.988 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-23T06:57:26.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:57:30.044 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-23T06:57:36.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:57:38.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:57:39.100 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-23T06:57:42.044 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-23T06:57:45.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:57:48.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:57:48.192 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-23T06:57:51.100 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-23T06:57:54.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:57:57.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:57:57.280 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-23T06:58:00.160 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-23T06:58:03.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:06.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:06.364 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-23T06:58:09.244 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-23T06:58:12.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:15.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:18.300 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-23T06:58:24.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:27.388 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-23T06:58:30.844 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-23T06:58:33.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:36.448 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-23T06:58:36.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:39.900 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-23T06:58:42.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:45.532 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-23T06:58:45.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:48.956 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-01-23T06:58:51.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:54.588 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-23T06:58:54.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:55.314 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-23T06:58:55.314 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-23T06:59:00.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:59:10.750 INFO:teuthology.provision.fog.smithi148:Node is ready 2024-01-23T06:59:10.751 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2024-01-23T06:59:10.768 INFO:teuthology.orchestra.run.smithi148.stdout:smithi046 2024-01-23T06:59:10.769 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi046 /etc/hosts 2024-01-23T06:59:10.826 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-01-23T06:59:10.826 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-01-23T06:59:10.982 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi046/smithi148/g' /etc/hosts 2024-01-23T06:59:11.013 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.46/172.21.15.148/g' /etc/hosts 2024-01-23T06:59:11.084 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi046/smithi148/g' /etc/hostname 2024-01-23T06:59:11.155 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-01-23T06:59:11.224 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-01-23T06:59:11.279 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-01-23T06:59:11.280 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-01-23T06:59:11.280 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-01-23T06:59:11.280 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-01-23T06:59:11.280 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-01-23T06:59:11.280 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-01-23T06:59:11.280 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T06:59:11.280 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-01-23T06:59:11.280 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-01-23T06:59:11.280 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T06:59:11.280 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-01-23T06:59:11.280 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T06:59:11.281 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T06:59:11.281 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T06:59:11.281 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2024-01-23T06:59:11.283 DEBUG:teuthology.parallel:result is None 2024-01-23T07:00:00.641 WARNING:teuthology.provision.fog.smithi049:timed out 2024-01-23T07:00:06.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T07:00:06.920 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-23T07:00:06.920 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-23T07:00:07.274 INFO:teuthology.provision.fog.smithi049:Node is ready 2024-01-23T07:00:07.274 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2024-01-23T07:00:07.290 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2024-01-23T07:00:07.290 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2024-01-23T07:00:07.346 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2024-01-23T07:00:07.346 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2024-01-23T07:00:07.470 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2024-01-23T07:00:07.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2024-01-23T07:00:07.576 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2024-01-23T07:00:07.648 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2024-01-23T07:00:07.719 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-01-23T07:00:07.775 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-01-23T07:00:07.775 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2024-01-23T07:00:07.775 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-01-23T07:00:07.775 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-01-23T07:00:07.776 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2024-01-23T07:00:07.776 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2024-01-23T07:00:07.776 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T07:00:07.776 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-01-23T07:00:07.776 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2024-01-23T07:00:07.776 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T07:00:07.776 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-01-23T07:00:07.776 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T07:00:07.777 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T07:00:07.777 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T07:00:07.778 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2024-01-23T07:00:07.779 DEBUG:teuthology.parallel:result is None 2024-01-23T07:00:07.951 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2024-01-23T07:00:07.952 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-23T07:00:07.984 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2024-01-23T07:00:07.984 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-23T07:00:08.019 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2024-01-23T07:00:08.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-23T07:00:08.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T07:00:08.119 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-01-23T07:00:08.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-23T07:00:08.186 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-01-23T07:00:08.241 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-01-23T07:00:08.241 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-01-23T07:00:08.295 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-01-23T07:00:08.296 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2024-01-23T07:00:08.296 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-01-23T07:00:08.296 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-01-23T07:00:08.296 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2024-01-23T07:00:08.296 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2024-01-23T07:00:08.296 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T07:00:08.296 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-01-23T07:00:08.296 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2024-01-23T07:00:08.296 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T07:00:08.296 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-01-23T07:00:08.296 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T07:00:08.296 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T07:00:08.297 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T07:00:08.297 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-01-23T07:00:08.376 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2024-01-23T07:00:08.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-01-23T07:00:08.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T07:00:08.462 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-01-23T07:00:08.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-01-23T07:00:08.634 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-01-23T07:00:08.689 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-01-23T07:00:08.689 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-01-23T07:00:08.744 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-01-23T07:00:08.744 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-01-23T07:00:08.744 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-01-23T07:00:08.744 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-01-23T07:00:08.745 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-01-23T07:00:08.745 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-01-23T07:00:08.745 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T07:00:08.745 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-01-23T07:00:08.745 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-01-23T07:00:08.745 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T07:00:08.745 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-01-23T07:00:08.745 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T07:00:08.745 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T07:00:08.745 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T07:00:08.746 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-01-23T07:00:08.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:00:08.874 INFO:teuthology.dispatcher.supervisor:Running job 7527443 2024-01-23T07:00:08.874 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527443 --name lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527443/orig.config.yaml 2024-01-23T07:00:08.877 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527443 2024-01-23T07:00:08.877 INFO:teuthology.dispatcher.supervisor:Job PID: 1947772 2024-01-23T07:00:08.877 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-23T07:02:08.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:04:09.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:06:09.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:08:09.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:10:09.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:12:09.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:14:10.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:16:10.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:18:10.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:20:10.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:22:10.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:24:10.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:26:10.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:28:11.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:30:11.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:32:11.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:34:11.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:36:11.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:38:11.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:40:12.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:42:12.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:44:12.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:46:12.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:48:12.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:50:12.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:52:13.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:54:13.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:56:13.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T07:58:13.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:00:13.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:02:13.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:04:14.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:06:14.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:08:14.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:10:14.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:12:14.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:14:14.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:16:15.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:18:15.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:20:15.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:22:15.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:24:15.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:26:15.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:28:16.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:30:16.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:32:16.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:34:16.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:36:16.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:38:16.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:40:17.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:42:17.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:44:17.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:46:17.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:48:17.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:50:17.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:52:17.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:54:18.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:56:18.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:58:18.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T09:00:18.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T09:02:18.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T09:04:18.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T09:06:19.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T09:06:19.186 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-23T09:06:19.372 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-23T09:06:19.373 INFO:teuthology.nuke:Checking targets against current locks 2024-01-23T09:06:19.413 DEBUG:teuthology.nuke:shortname: smithi049 2024-01-23T09:06:19.413 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T09:06:19.435 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527443', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 06:54:04.207128', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH8Med2Aa0o0GXVsCYZENvYXE7Vpy0qxKwA9MZuHd9ZnjaxvJ7BBmQF+vT4qP6yfcJ5evxabnWeeO/usFfLZ3yw='} 2024-01-23T09:06:19.439 DEBUG:teuthology.nuke:shortname: smithi148 2024-01-23T09:06:19.439 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T09:06:19.458 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527443', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 06:54:04.205623', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJnt0RaWbwHsKckC1UNi39IskeOU6d8Nq8vjXfwOhkAeFA3dL9Xn2hNFGMcjn1WBUWdKufKNZFjn+SDx1cU/Idk='} 2024-01-23T09:06:19.486 INFO:teuthology.orchestra.console.smithi049:Power off 2024-01-23T09:06:19.487 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T09:06:19.512 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-01-23T09:06:19.513 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T09:06:19.526 INFO:teuthology.orchestra.console.smithi148:Power off 2024-01-23T09:06:19.527 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T09:06:19.534 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-01-23T09:06:19.548 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2024-01-23T09:06:19.549 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T09:06:19.571 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-01-23T09:06:19.635 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-01-23T09:06:19.672 INFO:teuthology.orchestra.console.smithi148:Power off completed 2024-01-23T09:06:19.785 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com 2024-01-23T09:06:19.817 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com