2024-02-28T15:44:41.139 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-28T15:44:41.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T15:44:41.304 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efe8baa3c10>, signals=[15]) 2024-02-28T15:44:41.304 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2024-02-28T15:44:41.304 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2024-02-28T15:44:41.305 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-02-28T15:44:41.329 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2024-02-28T15:44:41.330 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2024-02-28T15:44:41.330 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-02-28T15:44:41.453 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_centos_9.stream (ID 10) 2024-02-28T15:44:41.482 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_9.stream (ID 10) 2024-02-28T15:44:41.506 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 9.stream 2024-02-28T15:44:41.529 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 9.stream 2024-02-28T15:44:41.734 INFO:teuthology.orchestra.console.smithi006:Power off 2024-02-28T15:44:41.735 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T15:44:41.759 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2024-02-28T15:44:41.759 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T15:44:41.774 INFO:teuthology.orchestra.console.smithi090:Power off 2024-02-28T15:44:41.774 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T15:44:41.783 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-02-28T15:44:41.798 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2024-02-28T15:44:41.798 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T15:44:41.821 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2024-02-28T15:44:45.788 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T15:44:45.822 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T15:44:45.898 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-02-28T15:44:45.932 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2024-02-28T15:44:49.900 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T15:44:49.934 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T15:44:50.010 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-02-28T15:44:50.045 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2024-02-28T15:44:50.111 INFO:teuthology.orchestra.console.smithi006:Power off completed 2024-02-28T15:44:50.212 INFO:teuthology.orchestra.console.smithi006:Power on 2024-02-28T15:44:50.212 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-28T15:44:50.234 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On 2024-02-28T15:44:50.234 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T15:44:50.257 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-02-28T15:44:54.048 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T15:44:54.157 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-02-28T15:44:54.258 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T15:44:54.265 INFO:teuthology.orchestra.console.smithi090:Power off completed 2024-02-28T15:44:54.366 INFO:teuthology.orchestra.console.smithi090:Power on 2024-02-28T15:44:54.367 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-28T15:44:54.376 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-02-28T15:44:54.388 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On 2024-02-28T15:44:54.388 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T15:44:54.410 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-02-28T15:44:58.380 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T15:44:58.411 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T15:44:58.489 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-02-28T15:44:58.523 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2024-02-28T15:44:58.590 INFO:teuthology.orchestra.console.smithi006:Power on completed 2024-02-28T15:44:58.624 INFO:teuthology.orchestra.console.smithi090:Power on completed 2024-02-28T15:44:58.691 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2024-02-28T15:44:58.725 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2024-02-28T15:47:29.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:47:32.604 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-02-28T15:47:38.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:47:41.660 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-02-28T15:47:47.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:47:50.716 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-02-28T15:47:56.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:47:59.804 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-02-28T15:48:05.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:48:08.860 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-02-28T15:48:14.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:48:14.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:48:17.788 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-02-28T15:48:23.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:48:26.844 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-02-28T15:48:32.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:48:35.900 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-02-28T15:48:41.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:48:44.956 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-02-28T15:48:50.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:48:54.012 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-02-28T15:49:00.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:49:03.068 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-02-28T15:49:09.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:49:12.124 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-02-28T15:49:14.867 WARNING:teuthology.provision.fog.smithi006:timed out 2024-02-28T15:49:18.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:49:20.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:49:21.129 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-28T15:49:21.130 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-28T15:49:21.180 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-02-28T15:49:21.463 INFO:teuthology.provision.fog.smithi006:Node is ready 2024-02-28T15:49:21.463 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2024-02-28T15:49:21.479 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2024-02-28T15:49:21.479 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2024-02-28T15:49:21.535 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2024-02-28T15:49:21.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-02-28T15:49:21.655 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2024-02-28T15:49:21.686 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2024-02-28T15:49:21.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2024-02-28T15:49:21.829 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-02-28T15:49:21.899 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-02-28T15:49:21.955 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-02-28T15:49:21.955 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-02-28T15:49:21.955 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-02-28T15:49:21.955 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-02-28T15:49:21.955 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-02-28T15:49:21.955 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-02-28T15:49:21.955 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T15:49:21.955 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-02-28T15:49:21.956 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-02-28T15:49:21.956 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T15:49:21.956 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-02-28T15:49:21.956 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T15:49:21.956 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T15:49:21.956 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T15:49:21.957 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2024-02-28T15:49:21.958 DEBUG:teuthology.parallel:result is None 2024-02-28T15:49:27.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:50:27.237 WARNING:teuthology.provision.fog.smithi090:timed out 2024-02-28T15:50:33.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:50:33.523 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-28T15:50:33.524 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-28T15:50:33.867 INFO:teuthology.provision.fog.smithi090:Node is ready 2024-02-28T15:50:33.867 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2024-02-28T15:50:33.881 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2024-02-28T15:50:33.882 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2024-02-28T15:50:33.937 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2024-02-28T15:50:33.937 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2024-02-28T15:50:34.052 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2024-02-28T15:50:34.080 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2024-02-28T15:50:34.147 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2024-02-28T15:50:34.215 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2024-02-28T15:50:34.281 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-02-28T15:50:34.335 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-02-28T15:50:34.335 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-02-28T15:50:34.335 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-02-28T15:50:34.335 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-02-28T15:50:34.335 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-02-28T15:50:34.335 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-02-28T15:50:34.336 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T15:50:34.336 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-02-28T15:50:34.336 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-02-28T15:50:34.336 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T15:50:34.336 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-02-28T15:50:34.336 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T15:50:34.336 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T15:50:34.336 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T15:50:34.336 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2024-02-28T15:50:34.337 DEBUG:teuthology.parallel:result is None 2024-02-28T15:50:34.537 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2024-02-28T15:50:34.537 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-28T15:50:34.558 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2024-02-28T15:50:34.558 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-28T15:50:34.575 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2024-02-28T15:50:34.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-02-28T15:50:34.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:50:34.679 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-02-28T15:50:34.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-02-28T15:50:34.863 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-02-28T15:50:34.918 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-02-28T15:50:34.918 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-02-28T15:50:34.972 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-02-28T15:50:34.973 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-02-28T15:50:34.973 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-02-28T15:50:34.973 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-02-28T15:50:34.973 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-02-28T15:50:34.973 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-02-28T15:50:34.973 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T15:50:34.973 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-02-28T15:50:34.973 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-02-28T15:50:34.973 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T15:50:34.973 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-02-28T15:50:34.973 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T15:50:34.973 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T15:50:34.973 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T15:50:34.974 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-02-28T15:50:35.001 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2024-02-28T15:50:35.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-02-28T15:50:35.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:50:35.093 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-02-28T15:50:35.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-02-28T15:50:35.158 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-02-28T15:50:35.212 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-02-28T15:50:35.212 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-02-28T15:50:35.267 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-02-28T15:50:35.267 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-02-28T15:50:35.267 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-02-28T15:50:35.267 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-02-28T15:50:35.267 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-02-28T15:50:35.267 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-02-28T15:50:35.268 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T15:50:35.268 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-02-28T15:50:35.268 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-02-28T15:50:35.268 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T15:50:35.268 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-02-28T15:50:35.268 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T15:50:35.268 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T15:50:35.268 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T15:50:35.268 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-02-28T15:50:35.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T15:50:35.385 INFO:teuthology.dispatcher.supervisor:Running job 7575587 2024-02-28T15:50:35.385 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575587 --name vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575587/orig.config.yaml 2024-02-28T15:50:35.388 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575587 2024-02-28T15:50:35.388 INFO:teuthology.dispatcher.supervisor:Job PID: 2505456 2024-02-28T15:50:35.388 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-28T15:52:35.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T15:54:35.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T15:56:35.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T15:58:35.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:00:36.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:02:36.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:04:36.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:06:36.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:08:36.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:10:36.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:12:37.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:14:37.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:16:37.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:18:37.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:20:37.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:22:38.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:24:38.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:26:38.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:28:38.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:30:38.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:32:38.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:34:39.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:36:39.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:38:39.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:40:39.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:42:39.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:44:39.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:46:40.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:48:40.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:50:40.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:52:40.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:54:40.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:56:40.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:58:41.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:00:41.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:02:41.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:04:41.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:06:41.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:08:41.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:10:42.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:12:42.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:14:42.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:16:42.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:18:42.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:20:43.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:22:43.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:24:43.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:26:43.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:28:43.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:30:43.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:32:44.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:34:44.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:36:44.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:38:44.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:40:44.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:42:44.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:44:45.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:46:45.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:48:45.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:50:45.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:52:45.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:54:45.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:56:46.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T17:58:46.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T18:00:46.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T18:02:46.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T18:04:46.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T18:06:46.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T18:06:47.074 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1