2023-11-30T22:12:00.890 INFO:root:teuthology version: 0.0.1.dev212+g595fad1 2023-11-30T22:12:00.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:12:01.039 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6ce9e72550>, signals=[15]) 2023-11-30T22:12:01.040 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2023-11-30T22:12:01.040 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2023-11-30T22:12:01.040 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-11-30T22:12:01.059 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-11-30T22:12:01.059 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-11-30T22:12:01.059 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-11-30T22:12:01.176 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_8.stream (ID 3) 2023-11-30T22:12:01.194 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_8.stream (ID 3) 2023-11-30T22:12:01.222 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 8.stream 2023-11-30T22:12:01.244 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 8.stream 2023-11-30T22:12:01.519 INFO:teuthology.orchestra.console.smithi040:Power off 2023-11-30T22:12:01.520 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T22:12:01.534 INFO:teuthology.orchestra.console.smithi159:Power off 2023-11-30T22:12:01.534 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T22:12:01.543 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-11-30T22:12:01.543 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:12:01.554 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-11-30T22:12:01.554 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:12:01.565 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-11-30T22:12:01.574 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-11-30T22:12:01.667 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-11-30T22:12:01.675 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-11-30T22:12:01.768 INFO:teuthology.orchestra.console.smithi040:Power on 2023-11-30T22:12:01.769 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-30T22:12:01.777 INFO:teuthology.orchestra.console.smithi159:Power on 2023-11-30T22:12:01.777 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-30T22:12:01.797 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On 2023-11-30T22:12:01.797 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:12:01.806 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On 2023-11-30T22:12:01.806 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:12:01.818 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-11-30T22:12:01.829 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-11-30T22:12:05.823 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:12:05.831 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:12:05.933 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-11-30T22:12:05.942 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-11-30T22:12:06.033 INFO:teuthology.orchestra.console.smithi040:Power on completed 2023-11-30T22:12:06.043 INFO:teuthology.orchestra.console.smithi159:Power on completed 2023-11-30T22:12:06.134 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2023-11-30T22:12:06.144 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-11-30T22:14:37.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:14:37.194 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-30T22:15:07.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:15:10.307 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T22:15:16.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:15:19.366 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T22:15:25.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:15:28.422 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T22:15:34.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:15:37.474 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T22:15:41.196 WARNING:teuthology.provision.fog.smithi040:timed out 2023-11-30T22:15:43.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:15:46.530 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T22:15:47.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:15:52.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:15:55.586 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T22:16:01.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:16:04.642 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T22:16:05.734 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-11-30T22:16:10.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:16:11.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:16:14.822 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-11-30T22:16:20.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:16:21.075 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-30T22:16:21.075 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-30T22:16:37.151 INFO:teuthology.provision.fog.smithi040:Node is ready 2023-11-30T22:16:37.151 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2023-11-30T22:16:37.177 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2023-11-30T22:16:37.177 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2023-11-30T22:16:37.241 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2023-11-30T22:16:37.241 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-11-30T22:16:37.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2023-11-30T22:16:37.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2023-11-30T22:16:37.481 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2023-11-30T22:16:37.552 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-11-30T22:16:37.621 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-11-30T22:16:37.680 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-11-30T22:16:37.680 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2023-11-30T22:16:37.680 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-11-30T22:16:37.680 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-11-30T22:16:37.680 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2023-11-30T22:16:37.680 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-11-30T22:16:37.680 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-30T22:16:37.681 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-11-30T22:16:37.681 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-30T22:16:37.681 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-11-30T22:16:37.681 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T22:16:37.681 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T22:16:37.681 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-30T22:16:37.682 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2023-11-30T22:16:37.683 DEBUG:teuthology.parallel:result is None 2023-11-30T22:17:10.647 WARNING:teuthology.provision.fog.smithi159:timed out 2023-11-30T22:17:16.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:17:16.843 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-30T22:17:16.844 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-30T22:17:17.119 INFO:teuthology.provision.fog.smithi159:Node is ready 2023-11-30T22:17:17.119 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2023-11-30T22:17:17.141 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2023-11-30T22:17:17.141 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2023-11-30T22:17:17.198 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2023-11-30T22:17:17.198 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-11-30T22:17:17.289 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2023-11-30T22:17:17.319 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2023-11-30T22:17:17.388 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2023-11-30T22:17:17.457 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-11-30T22:17:17.523 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-11-30T22:17:17.581 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-11-30T22:17:17.582 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-11-30T22:17:17.582 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-11-30T22:17:17.582 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-11-30T22:17:17.582 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-11-30T22:17:17.582 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-11-30T22:17:17.582 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-30T22:17:17.582 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-11-30T22:17:17.582 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-30T22:17:17.582 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-11-30T22:17:17.582 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T22:17:17.582 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T22:17:17.583 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-30T22:17:17.583 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2023-11-30T22:17:17.584 DEBUG:teuthology.parallel:result is None 2023-11-30T22:17:17.738 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2023-11-30T22:17:17.739 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-30T22:17:17.763 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2023-11-30T22:17:17.763 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-30T22:17:17.788 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2023-11-30T22:17:17.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-11-30T22:17:17.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:17:17.861 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-11-30T22:17:18.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-11-30T22:17:18.002 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-11-30T22:17:18.062 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-11-30T22:17:18.062 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-11-30T22:17:18.121 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-11-30T22:17:18.121 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2023-11-30T22:17:18.121 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-11-30T22:17:18.121 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-11-30T22:17:18.121 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2023-11-30T22:17:18.121 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-11-30T22:17:18.122 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-30T22:17:18.122 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-11-30T22:17:18.122 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-30T22:17:18.122 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-11-30T22:17:18.122 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T22:17:18.122 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T22:17:18.122 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-30T22:17:18.123 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-11-30T22:17:18.146 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2023-11-30T22:17:18.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-11-30T22:17:18.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:17:18.212 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-11-30T22:17:18.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-11-30T22:17:18.277 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-11-30T22:17:18.336 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-11-30T22:17:18.336 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-11-30T22:17:18.395 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-11-30T22:17:18.396 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-11-30T22:17:18.396 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-11-30T22:17:18.396 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-11-30T22:17:18.396 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-11-30T22:17:18.396 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-11-30T22:17:18.396 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-30T22:17:18.396 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-11-30T22:17:18.396 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-30T22:17:18.397 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-11-30T22:17:18.397 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T22:17:18.397 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T22:17:18.397 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-30T22:17:18.397 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-11-30T22:17:18.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:17:18.523 INFO:teuthology.dispatcher.supervisor:Running job 7472648 2023-11-30T22:17:18.523 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472648 --name yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472648/orig.config.yaml 2023-11-30T22:17:18.533 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472648 2023-11-30T22:17:18.534 INFO:teuthology.dispatcher.supervisor:Job PID: 2646331 2023-11-30T22:17:18.534 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-30T22:19:18.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:21:18.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:23:18.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:25:18.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:27:18.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:29:18.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:31:18.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:33:19.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:35:19.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:37:19.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:39:19.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:41:19.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:43:19.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:45:19.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:47:19.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:49:19.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:51:19.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:53:20.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:55:20.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:57:20.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:59:20.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T23:01:20.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T23:03:20.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T23:05:20.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T23:07:20.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T23:07:20.699 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-30T23:07:20.894 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-30T23:07:20.894 INFO:teuthology.nuke:Checking targets against current locks 2023-11-30T23:07:20.939 DEBUG:teuthology.nuke:shortname: smithi040 2023-11-30T23:07:20.940 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-30T23:07:20.963 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472648', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 22:12:00.038521', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMGAujlbUO+tp90AQ2+wS/1co4WWnHyvfX2wzEe0YfEX8GsU829kVoiAbb5EP0YX53OVmdk+M9BZ4usPsCVeNIs='} 2023-11-30T23:07:20.966 DEBUG:teuthology.nuke:shortname: smithi159 2023-11-30T23:07:20.966 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-30T23:07:20.987 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472648', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 22:12:00.039915', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2O8czmYsds4tJQVgYFqim6uidMxvP+ggYsnDeAnzZ80q05t6zFR5O1AFJU4758Mg+1YoOJ1vubrg6siWQC2IM='} 2023-11-30T23:07:21.020 INFO:teuthology.orchestra.console.smithi040:Power off 2023-11-30T23:07:21.020 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T23:07:21.047 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-11-30T23:07:21.048 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T23:07:21.068 INFO:teuthology.orchestra.console.smithi159:Power off 2023-11-30T23:07:21.069 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T23:07:21.081 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-11-30T23:07:21.103 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-11-30T23:07:21.103 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T23:07:21.132 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-11-30T23:07:21.182 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-11-30T23:07:21.234 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-11-30T23:07:21.332 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2023-11-30T23:07:21.399 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com