2024-01-11T08:24:40.379 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-11T08:24:40.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T08:24:40.529 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb7db14cc10>, signals=[15]) 2024-01-11T08:24:40.530 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2024-01-11T08:24:40.530 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2024-01-11T08:24:40.530 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-01-11T08:24:40.554 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2024-01-11T08:24:40.554 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2024-01-11T08:24:40.554 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2024-01-11T08:24:40.662 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_centos_8.stream (ID 3) 2024-01-11T08:24:40.699 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_centos_8.stream (ID 3) 2024-01-11T08:24:40.718 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 8.stream 2024-01-11T08:24:40.756 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 8.stream 2024-01-11T08:24:40.989 INFO:teuthology.orchestra.console.smithi055:Power off 2024-01-11T08:24:40.990 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T08:24:41.012 INFO:teuthology.orchestra.console.smithi125:Power off 2024-01-11T08:24:41.012 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T08:24:41.021 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2024-01-11T08:24:41.021 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:24:41.035 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2024-01-11T08:24:41.036 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:24:41.045 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-01-11T08:24:41.058 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2024-01-11T08:24:45.048 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:24:45.059 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:24:45.157 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-01-11T08:24:45.168 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2024-01-11T08:24:49.160 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:24:49.169 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:24:49.270 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-01-11T08:24:49.277 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2024-01-11T08:24:53.272 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:24:53.279 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:24:53.381 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-01-11T08:24:53.388 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-01-11T08:24:53.482 INFO:teuthology.orchestra.console.smithi055:Power off completed 2024-01-11T08:24:53.489 INFO:teuthology.orchestra.console.smithi125:Power off completed 2024-01-11T08:24:53.583 INFO:teuthology.orchestra.console.smithi055:Power on 2024-01-11T08:24:53.583 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-11T08:24:53.592 INFO:teuthology.orchestra.console.smithi125:Power on 2024-01-11T08:24:53.592 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-11T08:24:53.606 DEBUG:teuthology.orchestra.console.smithi055:power on output: Chassis Power Control: Up/On 2024-01-11T08:24:53.607 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:24:53.615 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On 2024-01-11T08:24:53.616 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:24:53.628 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-01-11T08:24:53.639 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-01-11T08:24:57.632 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:24:57.640 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:24:57.741 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-01-11T08:24:57.749 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2024-01-11T08:24:57.849 INFO:teuthology.orchestra.console.smithi125:Power on completed 2024-01-11T08:24:57.950 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2024-01-11T08:25:01.744 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:25:01.853 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-01-11T08:25:01.954 INFO:teuthology.orchestra.console.smithi055:Power on completed 2024-01-11T08:25:02.055 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2024-01-11T08:27:17.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T08:27:18.042 ERROR:teuthology.orchestra.connection:Error authenticating with smithi055.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-11T08:27:43.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T08:27:47.004 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-11T08:27:53.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T08:27:56.060 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-11T08:28:02.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T08:28:05.116 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-11T08:28:11.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T08:28:14.172 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-11T08:28:20.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T08:28:22.045 WARNING:teuthology.provision.fog.smithi055:timed out 2024-01-11T08:28:23.232 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-11T08:28:28.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T08:28:29.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T08:28:32.288 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-11T08:28:38.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T08:28:41.344 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-11T08:28:46.524 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-01-11T08:28:47.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T08:28:52.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T08:28:52.785 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-11T08:28:52.786 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-11T08:29:08.006 INFO:teuthology.provision.fog.smithi055:Node is ready 2024-01-11T08:29:08.006 DEBUG:teuthology.orchestra.run.smithi055:> hostname 2024-01-11T08:29:08.031 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2024-01-11T08:29:08.031 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts 2024-01-11T08:29:08.095 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2024-01-11T08:29:08.095 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2024-01-11T08:29:08.223 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts 2024-01-11T08:29:08.255 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts 2024-01-11T08:29:08.330 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname 2024-01-11T08:29:08.404 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2024-01-11T08:29:08.477 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-01-11T08:29:08.540 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-01-11T08:29:08.540 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8" 2024-01-11T08:29:08.540 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-01-11T08:29:08.540 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-01-11T08:29:08.540 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8" 2024-01-11T08:29:08.540 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2024-01-11T08:29:08.540 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-11T08:29:08.540 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-01-11T08:29:08.540 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-11T08:29:08.540 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-01-11T08:29:08.541 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T08:29:08.541 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T08:29:08.541 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-11T08:29:08.541 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2024-01-11T08:29:08.553 DEBUG:teuthology.parallel:result is None 2024-01-11T08:29:19.026 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-11T08:29:19.026 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-11T08:29:44.300 INFO:teuthology.provision.fog.smithi125:Node is ready 2024-01-11T08:29:44.301 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2024-01-11T08:29:44.325 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2024-01-11T08:29:44.325 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts 2024-01-11T08:29:44.387 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2024-01-11T08:29:44.387 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2024-01-11T08:29:44.508 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts 2024-01-11T08:29:44.542 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2024-01-11T08:29:44.617 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname 2024-01-11T08:29:44.691 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2024-01-11T08:29:44.764 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2024-01-11T08:29:44.825 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2024-01-11T08:29:44.825 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8" 2024-01-11T08:29:44.825 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2024-01-11T08:29:44.825 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2024-01-11T08:29:44.825 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8" 2024-01-11T08:29:44.825 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2024-01-11T08:29:44.825 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-11T08:29:44.825 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2024-01-11T08:29:44.825 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-11T08:29:44.825 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2024-01-11T08:29:44.825 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T08:29:44.825 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T08:29:44.825 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-11T08:29:44.826 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2024-01-11T08:29:44.826 DEBUG:teuthology.parallel:result is None 2024-01-11T08:29:44.976 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2024-01-11T08:29:44.977 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-11T08:29:45.001 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2024-01-11T08:29:45.001 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-11T08:29:45.018 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2024-01-11T08:29:45.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-01-11T08:29:45.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T08:29:45.093 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-01-11T08:29:45.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-01-11T08:29:45.237 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2024-01-11T08:29:45.296 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2024-01-11T08:29:45.296 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-01-11T08:29:45.357 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-01-11T08:29:45.357 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8" 2024-01-11T08:29:45.357 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-01-11T08:29:45.357 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-01-11T08:29:45.357 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8" 2024-01-11T08:29:45.357 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2024-01-11T08:29:45.357 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-11T08:29:45.357 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-01-11T08:29:45.357 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-11T08:29:45.357 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-01-11T08:29:45.357 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T08:29:45.358 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T08:29:45.358 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-11T08:29:45.358 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-01-11T08:29:45.385 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2024-01-11T08:29:45.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-01-11T08:29:45.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T08:29:45.457 DEBUG:teuthology.orchestra.run.smithi125:> true 2024-01-11T08:29:45.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-01-11T08:29:45.531 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2024-01-11T08:29:45.592 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2024-01-11T08:29:45.593 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2024-01-11T08:29:45.654 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2024-01-11T08:29:45.654 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8" 2024-01-11T08:29:45.654 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2024-01-11T08:29:45.654 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2024-01-11T08:29:45.654 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8" 2024-01-11T08:29:45.654 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2024-01-11T08:29:45.654 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-11T08:29:45.654 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2024-01-11T08:29:45.654 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-11T08:29:45.654 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2024-01-11T08:29:45.654 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T08:29:45.655 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T08:29:45.655 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-11T08:29:45.655 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2024-01-11T08:29:45.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T08:29:45.786 INFO:teuthology.dispatcher.supervisor:Running job 7512619 2024-01-11T08:29:45.787 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-10_19:20:36-fs-wip-vshankar-testing1-quincy-2024-01-10-2010-quincy-distro-default-smithi/7512619 --name yuriw-2024-01-10_19:20:36-fs-wip-vshankar-testing1-quincy-2024-01-10-2010-quincy-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2024-01-10_19:20:36-fs-wip-vshankar-testing1-quincy-2024-01-10-2010-quincy-distro-default-smithi/7512619/orig.config.yaml 2024-01-11T08:29:45.791 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-10_19:20:36-fs-wip-vshankar-testing1-quincy-2024-01-10-2010-quincy-distro-default-smithi/7512619 2024-01-11T08:29:45.791 INFO:teuthology.dispatcher.supervisor:Job PID: 1028144 2024-01-11T08:29:45.791 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-11T08:31:45.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T08:33:45.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T08:35:45.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T08:37:46.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T08:39:46.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T08:41:46.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T08:41:46.226 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-11T08:41:46.383 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-11T08:41:46.384 INFO:teuthology.nuke:Checking targets against current locks 2024-01-11T08:41:46.434 DEBUG:teuthology.nuke:shortname: smithi055 2024-01-11T08:41:46.435 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-11T08:41:46.454 DEBUG:teuthology.nuke:shortname: smithi125 2024-01-11T08:41:46.455 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-11T08:41:46.459 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-10_19:20:36-fs-wip-vshankar-testing1-quincy-2024-01-10-2010-quincy-distro-default-smithi/7512619', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-11 08:24:39.312802', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzozdZQ7F8N1L6jv2Rn2be3wkYl35HQRu87SwzCtBu56QyMZNbLhlAdlpVWn/MjRZQQ6zigfNy8gTsREdUs0aI='} 2024-01-11T08:41:46.482 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-10_19:20:36-fs-wip-vshankar-testing1-quincy-2024-01-10-2010-quincy-distro-default-smithi/7512619', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-11 08:24:39.311077', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIx7f0tGt0UqlV9z0qcwPNpAr3GQvF39M4NdgwgdJlh0Qff6aIb78t45dTRoySmzHnteENrwE6X1mV1bYXPkLNM='} 2024-01-11T08:41:46.508 INFO:teuthology.orchestra.console.smithi055:Power off 2024-01-11T08:41:46.509 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T08:41:46.532 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2024-01-11T08:41:46.532 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:41:46.546 INFO:teuthology.orchestra.console.smithi125:Power off 2024-01-11T08:41:46.546 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T08:41:46.554 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-01-11T08:41:46.566 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2024-01-11T08:41:46.566 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T08:41:46.590 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-01-11T08:41:46.656 INFO:teuthology.orchestra.console.smithi055:Power off completed 2024-01-11T08:41:46.690 INFO:teuthology.orchestra.console.smithi125:Power off completed 2024-01-11T08:41:46.808 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2024-01-11T08:41:46.832 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com