2023-11-27T16:27:11.049 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-27T16:27:11.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:27:11.190 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f89a6d66ca0>, signals=[15]) 2023-11-27T16:27:11.191 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-11-27T16:27:11.191 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-11-27T16:27:11.191 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-11-27T16:27:11.216 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-11-27T16:27:11.216 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-11-27T16:27:11.217 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-11-27T16:27:11.332 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_centos_9.stream (ID 10) 2023-11-27T16:27:11.343 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_9.stream (ID 10) 2023-11-27T16:27:11.379 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 9.stream 2023-11-27T16:27:11.391 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 9.stream 2023-11-27T16:27:11.597 INFO:teuthology.orchestra.console.smithi143:Power off 2023-11-27T16:27:11.597 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T16:27:11.610 INFO:teuthology.orchestra.console.smithi192:Power off 2023-11-27T16:27:11.610 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T16:27:11.620 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-11-27T16:27:11.620 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T16:27:11.633 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-11-27T16:27:11.633 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T16:27:11.640 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-11-27T16:27:11.654 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-11-27T16:27:11.741 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-11-27T16:27:11.755 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-11-27T16:27:11.842 INFO:teuthology.orchestra.console.smithi143:Power on 2023-11-27T16:27:11.843 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-27T16:27:11.856 INFO:teuthology.orchestra.console.smithi192:Power on 2023-11-27T16:27:11.857 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-27T16:27:11.865 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2023-11-27T16:27:11.866 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T16:27:11.879 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2023-11-27T16:27:11.879 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T16:27:11.889 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-11-27T16:27:11.903 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-11-27T16:27:15.894 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T16:27:15.904 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T16:27:16.003 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-11-27T16:27:16.011 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-11-27T16:27:20.006 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T16:27:20.013 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T16:27:20.115 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-11-27T16:27:20.121 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-11-27T16:27:20.216 INFO:teuthology.orchestra.console.smithi143:Power on completed 2023-11-27T16:27:20.222 INFO:teuthology.orchestra.console.smithi192:Power on completed 2023-11-27T16:27:20.317 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-11-27T16:27:20.323 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-11-27T16:29:51.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T16:29:51.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T16:29:51.426 ERROR:teuthology.orchestra.connection:Error authenticating with smithi192.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-27T16:30:09.506 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-27T16:30:15.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T16:30:18.562 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-27T16:30:24.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T16:30:27.618 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-27T16:30:33.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T16:30:36.674 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-27T16:30:42.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T16:30:45.730 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-27T16:30:51.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T16:30:55.429 WARNING:teuthology.provision.fog.smithi192:timed out 2023-11-27T16:31:01.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T16:31:19.906 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-27T16:31:25.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T16:31:28.963 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-27T16:31:34.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T16:31:36.868 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-27T16:31:36.869 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-27T16:31:51.734 WARNING:teuthology.provision.fog.smithi143:timed out 2023-11-27T16:31:57.212 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-11-27T16:31:57.212 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-11-27T16:31:57.229 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2023-11-27T16:31:57.229 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2023-11-27T16:31:57.284 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2023-11-27T16:31:57.284 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-11-27T16:31:57.397 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2023-11-27T16:31:57.425 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2023-11-27T16:31:57.492 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2023-11-27T16:31:57.559 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-11-27T16:31:57.625 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-11-27T16:31:57.680 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-11-27T16:31:57.680 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2023-11-27T16:31:57.680 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-11-27T16:31:57.680 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-11-27T16:31:57.680 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2023-11-27T16:31:57.680 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2023-11-27T16:31:57.680 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-27T16:31:57.680 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-11-27T16:31:57.680 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2023-11-27T16:31:57.680 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-27T16:31:57.681 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-11-27T16:31:57.681 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T16:31:57.681 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-27T16:31:57.681 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-27T16:31:57.681 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2023-11-27T16:31:57.682 DEBUG:teuthology.parallel:result is None 2023-11-27T16:31:57.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T16:31:58.035 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-27T16:31:58.035 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-27T16:31:58.377 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-11-27T16:31:58.378 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2023-11-27T16:31:58.392 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2023-11-27T16:31:58.392 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2023-11-27T16:31:58.447 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2023-11-27T16:31:58.447 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-11-27T16:31:58.547 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2023-11-27T16:31:58.574 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2023-11-27T16:31:58.641 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2023-11-27T16:31:58.708 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-11-27T16:31:58.774 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-11-27T16:31:58.830 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2023-11-27T16:31:58.830 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2023-11-27T16:31:58.830 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2023-11-27T16:31:58.830 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2023-11-27T16:31:58.830 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2023-11-27T16:31:58.830 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2023-11-27T16:31:58.830 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-27T16:31:58.830 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-11-27T16:31:58.830 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2023-11-27T16:31:58.830 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-27T16:31:58.831 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2023-11-27T16:31:58.831 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T16:31:58.831 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-27T16:31:58.831 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-27T16:31:58.831 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-11-27T16:31:58.831 DEBUG:teuthology.parallel:result is None 2023-11-27T16:31:58.991 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2023-11-27T16:31:58.992 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-27T16:31:59.012 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2023-11-27T16:31:59.012 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-27T16:31:59.029 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2023-11-27T16:31:59.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-11-27T16:31:59.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T16:31:59.109 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-11-27T16:31:59.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-11-27T16:31:59.176 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-11-27T16:31:59.230 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-11-27T16:31:59.230 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-11-27T16:31:59.284 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2023-11-27T16:31:59.284 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2023-11-27T16:31:59.284 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2023-11-27T16:31:59.284 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2023-11-27T16:31:59.284 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2023-11-27T16:31:59.284 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2023-11-27T16:31:59.284 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-27T16:31:59.284 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-11-27T16:31:59.284 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2023-11-27T16:31:59.285 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-27T16:31:59.285 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2023-11-27T16:31:59.285 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T16:31:59.285 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-27T16:31:59.285 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-27T16:31:59.285 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-11-27T16:31:59.312 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2023-11-27T16:31:59.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-11-27T16:31:59.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T16:31:59.395 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-11-27T16:31:59.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-11-27T16:31:59.467 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-11-27T16:31:59.523 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-11-27T16:31:59.523 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-11-27T16:31:59.579 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-11-27T16:31:59.579 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2023-11-27T16:31:59.580 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-11-27T16:31:59.580 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-11-27T16:31:59.580 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2023-11-27T16:31:59.580 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2023-11-27T16:31:59.580 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-27T16:31:59.580 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-11-27T16:31:59.580 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2023-11-27T16:31:59.580 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-27T16:31:59.580 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-11-27T16:31:59.580 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T16:31:59.580 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-27T16:31:59.580 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-27T16:31:59.581 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-11-27T16:31:59.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:31:59.693 INFO:teuthology.dispatcher.supervisor:Running job 7467869 2023-11-27T16:31:59.693 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_rraja@teuthology --archive /home/teuthworker/archive/rraja-2023-11-27_16:27:05-rbd:mirror-wip-ajarr-61617-distro-default-smithi/7467869 --name rraja-2023-11-27_16:27:05-rbd:mirror-wip-ajarr-61617-distro-default-smithi --description rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_latest} workloads/rbd-mirror-snapshot-workunit-mirror-compare-nbd} -- /home/teuthworker/archive/rraja-2023-11-27_16:27:05-rbd:mirror-wip-ajarr-61617-distro-default-smithi/7467869/orig.config.yaml 2023-11-27T16:31:59.696 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rraja-2023-11-27_16:27:05-rbd:mirror-wip-ajarr-61617-distro-default-smithi/7467869 2023-11-27T16:31:59.697 INFO:teuthology.dispatcher.supervisor:Job PID: 4024485 2023-11-27T16:31:59.697 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-27T16:33:59.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:35:59.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:37:59.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:39:59.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:41:59.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:44:00.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:46:00.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:48:00.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:50:00.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:52:00.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:54:00.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:56:00.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T16:56:00.727 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-27T16:56:00.881 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-27T16:56:00.881 INFO:teuthology.nuke:Checking targets against current locks 2023-11-27T16:56:00.927 DEBUG:teuthology.nuke:shortname: smithi143 2023-11-27T16:56:00.927 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T16:56:00.945 DEBUG:teuthology.nuke:shortname: smithi192 2023-11-27T16:56:00.946 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T16:56:00.949 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rraja-2023-11-27_16:27:05-rbd:mirror-wip-ajarr-61617-distro-default-smithi/7467869', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 16:27:10.208760', 'locked_by': 'scheduled_rraja@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOsxB98gWdl/5wZRo+9L1z74wj9NABzZCqHQCMjO2nYkm+8UoXFvNx7nhNZ9NJpBbtEXTVDNMUjk7SxKjoCDHUQ='} 2023-11-27T16:56:00.972 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rraja-2023-11-27_16:27:05-rbd:mirror-wip-ajarr-61617-distro-default-smithi/7467869', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 16:27:10.210526', 'locked_by': 'scheduled_rraja@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/txZoqw44g5RT3OI6zG68jc1WoQeokZHuqIAISzaVt3o372u7ouWP2KIa5/tUkvFXPe97BNJKvN8v+8847OjM='} 2023-11-27T16:56:00.996 INFO:teuthology.orchestra.console.smithi143:Power off 2023-11-27T16:56:00.996 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T16:56:01.018 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-11-27T16:56:01.018 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T16:56:01.033 INFO:teuthology.orchestra.console.smithi192:Power off 2023-11-27T16:56:01.033 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T16:56:01.041 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-11-27T16:56:01.053 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-11-27T16:56:01.053 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T16:56:01.071 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-11-27T16:56:01.143 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-11-27T16:56:01.171 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-11-27T16:56:01.300 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com 2023-11-27T16:56:01.316 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com