2023-11-19T14:52:30.644 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-19T14:52:30.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T14:52:30.783 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6c7b85d670>, signals=[15]) 2023-11-19T14:52:30.784 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging 2023-11-19T14:52:30.784 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server 2023-11-19T14:52:30.784 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-11-19T14:52:30.810 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2023-11-19T14:52:30.810 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2023-11-19T14:52:30.810 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-11-19T14:52:30.938 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_centos_9.stream (ID 10) 2023-11-19T14:52:30.943 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_centos_9.stream (ID 10) 2023-11-19T14:52:30.994 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 9.stream 2023-11-19T14:52:30.998 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of centos 9.stream 2023-11-19T14:52:31.217 INFO:teuthology.orchestra.console.smithi170:Power off 2023-11-19T14:52:31.217 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-19T14:52:31.229 INFO:teuthology.orchestra.console.smithi144:Power off 2023-11-19T14:52:31.230 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-19T14:52:31.240 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-11-19T14:52:31.240 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T14:52:31.250 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-11-19T14:52:31.251 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T14:52:31.271 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-11-19T14:52:31.282 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-11-19T14:52:35.276 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T14:52:35.282 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T14:52:35.384 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-11-19T14:52:35.389 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-11-19T14:52:39.389 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T14:52:39.395 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T14:52:39.498 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-11-19T14:52:39.503 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-11-19T14:52:39.599 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-11-19T14:52:39.603 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-11-19T14:52:39.700 INFO:teuthology.orchestra.console.smithi144:Power on 2023-11-19T14:52:39.700 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-19T14:52:39.707 INFO:teuthology.orchestra.console.smithi170:Power on 2023-11-19T14:52:39.707 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-19T14:52:39.721 DEBUG:teuthology.orchestra.console.smithi144:power on output: Chassis Power Control: Up/On 2023-11-19T14:52:39.721 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T14:52:39.728 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On 2023-11-19T14:52:39.728 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T14:52:39.740 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-11-19T14:52:39.747 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-11-19T14:52:43.742 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T14:52:43.748 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T14:52:43.850 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-11-19T14:52:43.856 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-11-19T14:52:47.856 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T14:52:47.862 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T14:52:47.970 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-11-19T14:52:48.070 INFO:teuthology.orchestra.console.smithi170:Power on completed 2023-11-19T14:52:48.082 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-11-19T14:52:48.172 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2023-11-19T14:52:48.183 INFO:teuthology.orchestra.console.smithi144:Power on completed 2023-11-19T14:52:48.284 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2023-11-19T14:55:18.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:55:18.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:55:37.314 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-11-19T14:55:37.318 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-11-19T14:55:43.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:55:43.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:55:46.402 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-11-19T14:55:46.402 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-11-19T14:55:52.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:55:52.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:55:55.458 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-11-19T14:55:55.459 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-11-19T14:56:01.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:56:01.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:56:04.550 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-11-19T14:56:04.551 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-11-19T14:56:10.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:56:10.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:56:13.634 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-11-19T14:56:19.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:57:10.579 WARNING:teuthology.provision.fog.smithi170:timed out 2023-11-19T14:57:16.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:57:16.817 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-19T14:57:16.818 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-19T14:57:17.122 INFO:teuthology.provision.fog.smithi170:Node is ready 2023-11-19T14:57:17.123 DEBUG:teuthology.orchestra.run.smithi170:> hostname 2023-11-19T14:57:17.136 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2023-11-19T14:57:17.137 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170.front.sepia.ceph.com /etc/hosts 2023-11-19T14:57:17.191 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2023-11-19T14:57:17.191 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-11-19T14:57:17.297 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hosts 2023-11-19T14:57:17.325 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts 2023-11-19T14:57:17.390 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hostname 2023-11-19T14:57:17.456 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-11-19T14:57:17.522 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-11-19T14:57:17.576 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2023-11-19T14:57:17.576 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2023-11-19T14:57:17.577 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2023-11-19T14:57:17.577 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2023-11-19T14:57:17.577 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2023-11-19T14:57:17.577 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2023-11-19T14:57:17.577 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-19T14:57:17.577 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-11-19T14:57:17.577 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2023-11-19T14:57:17.577 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-19T14:57:17.578 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2023-11-19T14:57:17.578 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-19T14:57:17.578 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-19T14:57:17.578 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-19T14:57:17.578 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2023-11-19T14:57:17.579 DEBUG:teuthology.parallel:result is None 2023-11-19T14:57:19.643 WARNING:teuthology.provision.fog.smithi144:timed out 2023-11-19T14:57:25.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:57:25.878 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-19T14:57:25.878 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-19T14:57:26.202 INFO:teuthology.provision.fog.smithi144:Node is ready 2023-11-19T14:57:26.202 DEBUG:teuthology.orchestra.run.smithi144:> hostname 2023-11-19T14:57:26.217 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com 2023-11-19T14:57:26.217 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts 2023-11-19T14:57:26.273 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2023-11-19T14:57:26.273 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-11-19T14:57:26.371 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts 2023-11-19T14:57:26.399 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts 2023-11-19T14:57:26.467 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname 2023-11-19T14:57:26.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-11-19T14:57:26.600 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-11-19T14:57:26.654 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-11-19T14:57:26.654 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2023-11-19T14:57:26.654 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-11-19T14:57:26.654 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-11-19T14:57:26.654 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2023-11-19T14:57:26.654 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2023-11-19T14:57:26.654 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-19T14:57:26.654 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-11-19T14:57:26.655 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2023-11-19T14:57:26.655 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-19T14:57:26.655 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-11-19T14:57:26.655 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-19T14:57:26.655 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-19T14:57:26.655 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-19T14:57:26.655 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2023-11-19T14:57:26.656 DEBUG:teuthology.parallel:result is None 2023-11-19T14:57:26.815 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2023-11-19T14:57:26.816 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-19T14:57:26.845 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2023-11-19T14:57:26.845 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-19T14:57:26.870 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2023-11-19T14:57:26.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-11-19T14:57:26.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:57:26.950 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-11-19T14:57:27.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-11-19T14:57:27.021 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-11-19T14:57:27.074 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-11-19T14:57:27.075 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-11-19T14:57:27.128 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-11-19T14:57:27.128 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2023-11-19T14:57:27.128 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-11-19T14:57:27.128 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-11-19T14:57:27.128 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2023-11-19T14:57:27.128 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2023-11-19T14:57:27.128 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-19T14:57:27.129 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-11-19T14:57:27.129 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2023-11-19T14:57:27.129 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-19T14:57:27.129 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-11-19T14:57:27.129 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-19T14:57:27.129 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-19T14:57:27.129 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-19T14:57:27.130 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-11-19T14:57:27.153 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2023-11-19T14:57:27.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-11-19T14:57:27.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-19T14:57:27.236 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-11-19T14:57:27.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-11-19T14:57:27.310 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2023-11-19T14:57:27.366 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2023-11-19T14:57:27.367 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-11-19T14:57:27.422 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2023-11-19T14:57:27.422 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2023-11-19T14:57:27.422 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2023-11-19T14:57:27.423 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2023-11-19T14:57:27.423 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2023-11-19T14:57:27.423 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2023-11-19T14:57:27.423 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-19T14:57:27.423 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-11-19T14:57:27.423 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2023-11-19T14:57:27.423 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-19T14:57:27.423 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2023-11-19T14:57:27.423 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-19T14:57:27.423 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-19T14:57:27.423 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-19T14:57:27.424 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-11-19T14:57:27.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T14:57:27.534 INFO:teuthology.dispatcher.supervisor:Running job 7462220 2023-11-19T14:57:27.534 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-18_13:55:06-rbd-main-distro-default-smithi/7462220 --name yuriw-2023-11-18_13:55:06-rbd-main-distro-default-smithi --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_latest} workloads/rbd-mirror-journal-workunit} -- /home/teuthworker/archive/yuriw-2023-11-18_13:55:06-rbd-main-distro-default-smithi/7462220/orig.config.yaml 2023-11-19T14:57:27.536 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-18_13:55:06-rbd-main-distro-default-smithi/7462220 2023-11-19T14:57:27.537 INFO:teuthology.dispatcher.supervisor:Job PID: 285995 2023-11-19T14:57:27.537 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-19T14:59:27.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T15:01:27.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T15:03:27.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T15:05:28.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T15:07:28.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T15:09:28.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T15:11:28.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T15:13:28.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T15:15:28.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T15:17:28.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T15:19:29.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T15:21:29.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T15:23:29.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-19T15:23:29.549 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-19T15:23:29.654 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-19T15:23:29.654 INFO:teuthology.nuke:Checking targets against current locks 2023-11-19T15:23:29.702 DEBUG:teuthology.nuke:shortname: smithi144 2023-11-19T15:23:29.703 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-19T15:23:29.723 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:55:06-rbd-main-distro-default-smithi/7462220', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-19 14:52:29.857835', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNr8eDqxKdtOfhbgkOeBvDtINiecfMF2o+JABdX7TePkYe97PpXs6cIfTCmqEXc6Tw2r1Vf8RWZTWSdRI2R1zEs='} 2023-11-19T15:23:29.725 DEBUG:teuthology.nuke:shortname: smithi170 2023-11-19T15:23:29.726 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-19T15:23:29.745 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-18_13:55:06-rbd-main-distro-default-smithi/7462220', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-19 14:52:29.859325', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFV0s2tits/KJp2SzKKJab799J4ENBKsiZh2yVdYG+iTqlge/j4uuOiyJYip4z3nQqZ8tH7dPm75FITs339UXzI='} 2023-11-19T15:23:29.773 INFO:teuthology.orchestra.console.smithi144:Power off 2023-11-19T15:23:29.774 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-19T15:23:29.800 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-11-19T15:23:29.800 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T15:23:29.812 INFO:teuthology.orchestra.console.smithi170:Power off 2023-11-19T15:23:29.813 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-19T15:23:29.820 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-11-19T15:23:29.832 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-11-19T15:23:29.832 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-19T15:23:29.852 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-11-19T15:23:29.921 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-11-19T15:23:29.953 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-11-19T15:23:30.205 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com 2023-11-19T15:23:30.215 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com