2023-11-30T21:36:24.488 INFO:root:teuthology version: 0.0.1.dev212+g595fad1 2023-11-30T21:36:24.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T21:36:24.628 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8fb6cd1550>, signals=[15]) 2023-11-30T21:36:24.628 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2023-11-30T21:36:24.629 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2023-11-30T21:36:24.629 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-11-30T21:36:24.659 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-11-30T21:36:24.659 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-11-30T21:36:24.660 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-11-30T21:36:24.809 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_8.stream (ID 3) 2023-11-30T21:36:24.821 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_8.stream (ID 3) 2023-11-30T21:36:24.863 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 8.stream 2023-11-30T21:36:24.871 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 8.stream 2023-11-30T21:36:25.241 INFO:teuthology.orchestra.console.smithi040:Power off 2023-11-30T21:36:25.242 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T21:36:25.255 INFO:teuthology.orchestra.console.smithi159:Power off 2023-11-30T21:36:25.255 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T21:36:25.265 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-11-30T21:36:25.265 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T21:36:25.278 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-11-30T21:36:25.278 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T21:36:25.291 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-11-30T21:36:25.297 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-11-30T21:36:29.296 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T21:36:29.303 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T21:36:29.405 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-11-30T21:36:29.410 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-11-30T21:36:33.410 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T21:36:33.417 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T21:36:33.519 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-11-30T21:36:33.524 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-11-30T21:36:33.620 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-11-30T21:36:33.721 INFO:teuthology.orchestra.console.smithi040:Power on 2023-11-30T21:36:33.722 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-30T21:36:33.743 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On 2023-11-30T21:36:33.743 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T21:36:33.764 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-11-30T21:36:37.526 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T21:36:37.635 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-11-30T21:36:37.736 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-11-30T21:36:37.765 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T21:36:37.838 INFO:teuthology.orchestra.console.smithi159:Power on 2023-11-30T21:36:37.838 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-30T21:36:37.859 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On 2023-11-30T21:36:37.860 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T21:36:37.873 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-11-30T21:36:37.880 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-11-30T21:36:41.878 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T21:36:41.885 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T21:36:41.987 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-11-30T21:36:41.994 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-11-30T21:36:42.088 INFO:teuthology.orchestra.console.smithi040:Power on completed 2023-11-30T21:36:42.095 INFO:teuthology.orchestra.console.smithi159:Power on completed 2023-11-30T21:36:42.189 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2023-11-30T21:36:42.197 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-11-30T21:39:13.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:39:13.385 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-30T21:39:28.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:39:31.394 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T21:39:37.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:39:40.450 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T21:39:46.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:39:49.506 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T21:39:55.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:39:58.566 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T21:40:04.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:40:07.618 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T21:40:13.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:40:16.678 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T21:40:17.388 WARNING:teuthology.provision.fog.smithi040:timed out 2023-11-30T21:40:22.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:40:23.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:40:25.734 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T21:40:26.466 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-11-30T21:40:31.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:40:32.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:40:34.786 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-11-30T21:40:35.522 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-11-30T21:40:40.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:40:41.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:40:44.578 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-11-30T21:40:50.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:40:53.379 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-30T21:40:53.380 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-30T21:41:08.627 INFO:teuthology.provision.fog.smithi040:Node is ready 2023-11-30T21:41:08.627 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2023-11-30T21:41:08.652 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2023-11-30T21:41:08.653 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2023-11-30T21:41:08.714 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2023-11-30T21:41:08.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-11-30T21:41:08.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2023-11-30T21:41:08.884 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2023-11-30T21:41:08.955 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2023-11-30T21:41:09.026 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-11-30T21:41:09.094 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-11-30T21:41:09.153 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-11-30T21:41:09.153 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2023-11-30T21:41:09.153 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-11-30T21:41:09.154 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-11-30T21:41:09.154 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2023-11-30T21:41:09.154 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-11-30T21:41:09.154 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-30T21:41:09.154 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-11-30T21:41:09.154 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-30T21:41:09.154 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-11-30T21:41:09.154 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T21:41:09.154 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T21:41:09.154 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-30T21:41:09.155 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2023-11-30T21:41:09.156 DEBUG:teuthology.parallel:result is None 2023-11-30T21:41:40.789 WARNING:teuthology.provision.fog.smithi159:timed out 2023-11-30T21:41:46.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:41:47.030 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-30T21:41:47.030 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-30T21:41:47.281 INFO:teuthology.provision.fog.smithi159:Node is ready 2023-11-30T21:41:47.281 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2023-11-30T21:41:47.300 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2023-11-30T21:41:47.301 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2023-11-30T21:41:47.359 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2023-11-30T21:41:47.360 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-11-30T21:41:47.451 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2023-11-30T21:41:47.481 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2023-11-30T21:41:47.550 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2023-11-30T21:41:47.618 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-11-30T21:41:47.685 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-11-30T21:41:47.743 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-11-30T21:41:47.743 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-11-30T21:41:47.743 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-11-30T21:41:47.743 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-11-30T21:41:47.743 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-11-30T21:41:47.743 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-11-30T21:41:47.744 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-30T21:41:47.744 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-11-30T21:41:47.744 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-30T21:41:47.744 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-11-30T21:41:47.744 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T21:41:47.744 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T21:41:47.744 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-30T21:41:47.744 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2023-11-30T21:41:47.745 DEBUG:teuthology.parallel:result is None 2023-11-30T21:41:47.893 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2023-11-30T21:41:47.894 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-30T21:41:47.919 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2023-11-30T21:41:47.920 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-30T21:41:47.937 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2023-11-30T21:41:47.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-11-30T21:41:47.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:41:48.006 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-11-30T21:41:48.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-11-30T21:41:48.148 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-11-30T21:41:48.207 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-11-30T21:41:48.207 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-11-30T21:41:48.265 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-11-30T21:41:48.266 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2023-11-30T21:41:48.266 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-11-30T21:41:48.266 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-11-30T21:41:48.266 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2023-11-30T21:41:48.266 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-11-30T21:41:48.266 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-30T21:41:48.266 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-11-30T21:41:48.266 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-30T21:41:48.266 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-11-30T21:41:48.266 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T21:41:48.266 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T21:41:48.267 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-30T21:41:48.267 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-11-30T21:41:48.334 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2023-11-30T21:41:48.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-11-30T21:41:48.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T21:41:48.402 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-11-30T21:41:48.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-11-30T21:41:48.472 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-11-30T21:41:48.531 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-11-30T21:41:48.532 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-11-30T21:41:48.590 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-11-30T21:41:48.591 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-11-30T21:41:48.591 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-11-30T21:41:48.591 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-11-30T21:41:48.591 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-11-30T21:41:48.591 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-11-30T21:41:48.591 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-30T21:41:48.591 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-11-30T21:41:48.591 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-30T21:41:48.591 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-11-30T21:41:48.591 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T21:41:48.591 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T21:41:48.591 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-30T21:41:48.592 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-11-30T21:41:48.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T21:41:48.725 INFO:teuthology.dispatcher.supervisor:Running job 7472568 2023-11-30T21:41:48.725 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472568 --name yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472568/orig.config.yaml 2023-11-30T21:41:48.732 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472568 2023-11-30T21:41:48.735 INFO:teuthology.dispatcher.supervisor:Job PID: 2075583 2023-11-30T21:41:48.736 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-30T21:43:48.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T21:45:48.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T21:47:48.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T21:49:48.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T21:51:49.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T21:53:49.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T21:55:49.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T21:57:49.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T21:59:49.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:01:49.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:03:49.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:05:49.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:07:49.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:09:49.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:11:49.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:11:49.840 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-30T22:11:50.077 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-30T22:11:50.078 INFO:teuthology.nuke:Checking targets against current locks 2023-11-30T22:11:50.132 DEBUG:teuthology.nuke:shortname: smithi040 2023-11-30T22:11:50.133 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-30T22:11:50.156 DEBUG:teuthology.nuke:shortname: smithi159 2023-11-30T22:11:50.156 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-30T22:11:50.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472568', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 21:36:23.641224', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGkwgQfMEaRlqVRotir1l0cpx5n2p/OljH9wOQm+7QOX6vY6OJp6nsD/RM96pQvKNtmr2JwICuFTpmFsZs6n+jc='} 2023-11-30T22:11:50.186 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472568', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 21:36:23.642560', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN04N2m/tkK+zKidgCXI/mWMqXQTgyH/Hizz8TrkuiN1CkSYxhCdq98gUbFCkqIAJ13ZdKJHFJuXpqjvoDHsiF8='} 2023-11-30T22:11:50.211 INFO:teuthology.orchestra.console.smithi040:Power off 2023-11-30T22:11:50.211 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T22:11:50.238 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-11-30T22:11:50.238 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:11:50.252 INFO:teuthology.orchestra.console.smithi159:Power off 2023-11-30T22:11:50.253 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T22:11:50.263 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-11-30T22:11:50.275 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-11-30T22:11:50.275 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:11:50.296 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-11-30T22:11:50.364 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-11-30T22:11:50.398 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-11-30T22:11:50.511 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2023-11-30T22:11:50.546 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com