2024-03-20T20:49:51.902 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-20T20:49:51.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T20:49:52.028 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa0a3308c10>, signals=[15]) 2024-03-20T20:49:52.028 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2024-03-20T20:49:52.028 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2024-03-20T20:49:52.028 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-03-20T20:49:52.047 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging 2024-03-20T20:49:52.047 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server 2024-03-20T20:49:52.047 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-03-20T20:49:52.178 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_centos_9.stream (ID 10) 2024-03-20T20:49:52.181 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_centos_9.stream (ID 10) 2024-03-20T20:49:52.234 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 9.stream 2024-03-20T20:49:52.237 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of centos 9.stream 2024-03-20T20:49:52.456 INFO:teuthology.orchestra.console.smithi135:Power off 2024-03-20T20:49:52.457 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-20T20:49:52.471 INFO:teuthology.orchestra.console.smithi144:Power off 2024-03-20T20:49:52.471 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-20T20:49:52.480 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2024-03-20T20:49:52.481 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T20:49:52.493 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2024-03-20T20:49:52.493 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T20:49:52.503 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-03-20T20:49:52.514 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2024-03-20T20:49:56.506 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T20:49:56.515 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T20:49:56.614 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-03-20T20:49:56.624 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2024-03-20T20:50:00.618 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T20:50:00.625 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T20:50:00.727 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-03-20T20:50:00.733 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2024-03-20T20:50:00.833 INFO:teuthology.orchestra.console.smithi144:Power off completed 2024-03-20T20:50:00.934 INFO:teuthology.orchestra.console.smithi144:Power on 2024-03-20T20:50:00.934 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-20T20:50:00.956 DEBUG:teuthology.orchestra.console.smithi144:power on output: Chassis Power Control: Up/On 2024-03-20T20:50:00.956 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T20:50:00.977 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2024-03-20T20:50:04.730 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T20:50:04.839 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2024-03-20T20:50:04.940 INFO:teuthology.orchestra.console.smithi135:Power off completed 2024-03-20T20:50:04.978 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T20:50:05.041 INFO:teuthology.orchestra.console.smithi135:Power on 2024-03-20T20:50:05.042 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-20T20:50:05.064 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On 2024-03-20T20:50:05.065 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T20:50:05.086 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2024-03-20T20:50:05.087 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2024-03-20T20:50:05.188 INFO:teuthology.orchestra.console.smithi144:Power on completed 2024-03-20T20:50:05.288 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2024-03-20T20:50:09.092 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T20:50:09.200 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2024-03-20T20:50:13.202 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T20:50:13.311 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-03-20T20:50:13.412 INFO:teuthology.orchestra.console.smithi135:Power on completed 2024-03-20T20:50:13.513 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2024-03-20T20:52:51.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:52:54.814 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-03-20T20:52:59.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:53:00.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:53:02.910 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-03-20T20:53:03.870 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-03-20T20:53:08.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:53:09.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:53:12.001 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-03-20T20:53:12.926 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-03-20T20:53:18.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:53:18.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:53:21.086 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-03-20T20:53:21.982 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-03-20T20:53:27.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:53:27.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:53:30.142 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-03-20T20:53:31.038 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-03-20T20:53:36.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:53:37.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:53:39.198 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-03-20T20:53:40.094 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-03-20T20:53:45.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:53:46.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:53:48.286 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-03-20T20:53:54.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:54:46.143 WARNING:teuthology.provision.fog.smithi144:timed out 2024-03-20T20:54:52.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:54:52.449 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-20T20:54:52.450 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-20T20:54:52.773 INFO:teuthology.provision.fog.smithi144:Node is ready 2024-03-20T20:54:52.773 DEBUG:teuthology.orchestra.run.smithi144:> hostname 2024-03-20T20:54:52.787 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com 2024-03-20T20:54:52.788 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts 2024-03-20T20:54:52.843 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2024-03-20T20:54:52.843 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2024-03-20T20:54:52.951 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts 2024-03-20T20:54:52.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts 2024-03-20T20:54:53.044 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname 2024-03-20T20:54:53.111 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2024-03-20T20:54:53.178 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-03-20T20:54:53.232 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-03-20T20:54:53.232 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2024-03-20T20:54:53.232 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-03-20T20:54:53.232 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-03-20T20:54:53.232 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2024-03-20T20:54:53.232 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2024-03-20T20:54:53.232 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T20:54:53.232 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-03-20T20:54:53.232 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2024-03-20T20:54:53.233 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T20:54:53.233 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-03-20T20:54:53.233 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T20:54:53.233 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T20:54:53.233 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T20:54:53.234 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2024-03-20T20:54:53.235 DEBUG:teuthology.parallel:result is None 2024-03-20T20:54:54.294 WARNING:teuthology.provision.fog.smithi135:timed out 2024-03-20T20:55:00.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:55:00.742 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-20T20:55:00.742 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-20T20:55:01.105 INFO:teuthology.provision.fog.smithi135:Node is ready 2024-03-20T20:55:01.105 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2024-03-20T20:55:01.120 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com 2024-03-20T20:55:01.120 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts 2024-03-20T20:55:01.175 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2024-03-20T20:55:01.175 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2024-03-20T20:55:01.277 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts 2024-03-20T20:55:01.304 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts 2024-03-20T20:55:01.373 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname 2024-03-20T20:55:01.442 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2024-03-20T20:55:01.510 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-03-20T20:55:01.567 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-03-20T20:55:01.568 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-03-20T20:55:01.568 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-03-20T20:55:01.568 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-03-20T20:55:01.568 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-03-20T20:55:01.568 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-03-20T20:55:01.568 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T20:55:01.568 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-03-20T20:55:01.568 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-03-20T20:55:01.568 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T20:55:01.568 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-03-20T20:55:01.568 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T20:55:01.568 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T20:55:01.569 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T20:55:01.569 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2024-03-20T20:55:01.570 DEBUG:teuthology.parallel:result is None 2024-03-20T20:55:01.737 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2024-03-20T20:55:01.737 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-20T20:55:01.758 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2024-03-20T20:55:01.758 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-20T20:55:01.775 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2024-03-20T20:55:01.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-03-20T20:55:01.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:55:01.860 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-03-20T20:55:01.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-03-20T20:55:01.924 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-03-20T20:55:01.980 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-03-20T20:55:01.980 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-03-20T20:55:02.036 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-03-20T20:55:02.036 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-03-20T20:55:02.036 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-03-20T20:55:02.036 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-03-20T20:55:02.036 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-03-20T20:55:02.036 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-03-20T20:55:02.036 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T20:55:02.036 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-03-20T20:55:02.036 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-03-20T20:55:02.036 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T20:55:02.036 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-03-20T20:55:02.036 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T20:55:02.037 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T20:55:02.037 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T20:55:02.037 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-03-20T20:55:02.066 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2024-03-20T20:55:02.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-03-20T20:55:02.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T20:55:02.154 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-03-20T20:55:02.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-03-20T20:55:02.223 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-03-20T20:55:02.278 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-03-20T20:55:02.279 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-03-20T20:55:02.334 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-03-20T20:55:02.335 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2024-03-20T20:55:02.335 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-03-20T20:55:02.335 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-03-20T20:55:02.335 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2024-03-20T20:55:02.335 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2024-03-20T20:55:02.335 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T20:55:02.335 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-03-20T20:55:02.335 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2024-03-20T20:55:02.335 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T20:55:02.335 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-03-20T20:55:02.335 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T20:55:02.335 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T20:55:02.336 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T20:55:02.336 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-03-20T20:55:02.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T20:55:02.461 INFO:teuthology.dispatcher.supervisor:Running job 7612980 2024-03-20T20:55:02.462 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7612980 --name pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7612980/orig.config.yaml 2024-03-20T20:55:02.465 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7612980 2024-03-20T20:55:02.465 INFO:teuthology.dispatcher.supervisor:Job PID: 129787 2024-03-20T20:55:02.465 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-20T20:57:02.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T20:59:02.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:01:02.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:03:03.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:05:03.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:07:03.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:09:03.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:11:03.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:13:04.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:15:04.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:17:04.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:19:04.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:21:04.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:23:04.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:25:05.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:27:05.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:29:05.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:31:05.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:33:05.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:35:05.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:37:06.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:39:06.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:41:06.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:43:06.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:45:06.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:47:06.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:49:07.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:51:07.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:53:07.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:55:07.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:57:07.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:59:07.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:01:08.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:03:08.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:05:08.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:07:08.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:09:08.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:11:08.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:13:09.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:15:09.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:17:09.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:19:09.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:21:10.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:23:10.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:25:10.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:27:10.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:29:10.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:31:11.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:33:11.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:35:11.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:37:11.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:39:11.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:41:11.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:43:12.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:45:12.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:47:12.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:49:12.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:51:12.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:53:12.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:55:13.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:57:13.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:59:13.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:01:13.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:03:13.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:05:14.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:07:14.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:09:14.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:11:14.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:13:14.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:15:14.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:17:15.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:19:15.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:21:15.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:23:15.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:25:15.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:27:15.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:29:16.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:31:16.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:33:16.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:35:16.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:37:16.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:39:16.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:41:16.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:43:17.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:45:17.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:47:17.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:49:17.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:51:17.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:53:17.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:55:18.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:57:18.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T23:59:18.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:01:18.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:03:18.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:05:18.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:07:19.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:09:19.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:11:19.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:13:19.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:15:19.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:17:20.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:19:20.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:21:20.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:23:20.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:25:20.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:27:20.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:29:21.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:31:21.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:33:21.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:35:21.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:37:21.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:39:21.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T00:39:21.997 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1