2024-02-20T07:50:42.131 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-20T07:50:42.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:50:42.272 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff3e9acec10>, signals=[15]) 2024-02-20T07:50:42.272 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2024-02-20T07:50:42.272 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T07:50:42.272 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-02-20T07:50:42.296 INFO:teuthology.lock.ops:Start node 'smithi087.front.sepia.ceph.com' reimaging 2024-02-20T07:50:42.296 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T07:50:42.296 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-02-20T07:50:42.417 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T07:50:42.436 DEBUG:teuthology.provision.fog.smithi087:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T07:50:42.462 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of centos 9.stream 2024-02-20T07:50:42.484 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of centos 9.stream 2024-02-20T07:50:42.720 INFO:teuthology.orchestra.console.smithi046:Power off 2024-02-20T07:50:42.720 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T07:50:42.733 INFO:teuthology.orchestra.console.smithi087:Power off 2024-02-20T07:50:42.733 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T07:50:42.742 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2024-02-20T07:50:42.742 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:50:42.754 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2024-02-20T07:50:42.754 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:50:42.765 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-02-20T07:50:42.776 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-02-20T07:50:46.770 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:50:46.777 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:50:46.879 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-02-20T07:50:46.884 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-02-20T07:50:50.884 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:50:50.891 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:50:50.993 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-02-20T07:50:51.000 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-02-20T07:50:51.095 INFO:teuthology.orchestra.console.smithi046:Power off completed 2024-02-20T07:50:51.195 INFO:teuthology.orchestra.console.smithi046:Power on 2024-02-20T07:50:51.196 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T07:50:51.224 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On 2024-02-20T07:50:51.225 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:50:51.248 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-02-20T07:50:55.004 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:50:55.113 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-02-20T07:50:55.214 INFO:teuthology.orchestra.console.smithi087:Power off completed 2024-02-20T07:50:55.249 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:50:55.315 INFO:teuthology.orchestra.console.smithi087:Power on 2024-02-20T07:50:55.316 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T07:50:55.337 DEBUG:teuthology.orchestra.console.smithi087:power on output: Chassis Power Control: Up/On 2024-02-20T07:50:55.338 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:50:55.357 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-02-20T07:50:55.359 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-02-20T07:50:59.359 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:50:59.366 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:50:59.468 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-02-20T07:50:59.474 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-02-20T07:50:59.570 INFO:teuthology.orchestra.console.smithi046:Power on completed 2024-02-20T07:50:59.670 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2024-02-20T07:51:03.476 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:51:03.625 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-02-20T07:51:03.726 INFO:teuthology.orchestra.console.smithi087:Power on completed 2024-02-20T07:51:03.827 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish 2024-02-20T07:53:30.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:53:33.664 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-20T07:53:34.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:53:37.788 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-02-20T07:53:39.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:53:42.748 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-20T07:53:43.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:53:46.844 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-02-20T07:53:48.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:53:51.804 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-20T07:53:52.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:53:56.060 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-02-20T07:53:57.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:54:00.860 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-20T07:54:02.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:54:05.120 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-02-20T07:54:06.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:54:09.920 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-20T07:54:11.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:54:14.172 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-02-20T07:54:15.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:54:19.004 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-20T07:54:20.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:54:23.228 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-02-20T07:54:25.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:54:28.060 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-20T07:54:29.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:54:34.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:54:47.740 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-02-20T07:54:53.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:54:56.796 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-02-20T07:55:02.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:55:05.852 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-02-20T07:55:11.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:55:12.195 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T07:55:12.196 DEBUG:teuthology.orchestra.run.smithi087:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T07:55:27.585 INFO:teuthology.provision.fog.smithi087:Node is ready 2024-02-20T07:55:27.586 DEBUG:teuthology.orchestra.run.smithi087:> hostname 2024-02-20T07:55:27.603 INFO:teuthology.orchestra.run.smithi087.stdout:smithi046 2024-02-20T07:55:27.603 DEBUG:teuthology.orchestra.run.smithi087:> grep smithi046 /etc/hosts 2024-02-20T07:55:27.660 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-02-20T07:55:27.660 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2024-02-20T07:55:27.812 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi046/smithi087/g' /etc/hosts 2024-02-20T07:55:27.842 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/172.21.15.46/172.21.15.87/g' /etc/hosts 2024-02-20T07:55:27.911 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi046/smithi087/g' /etc/hostname 2024-02-20T07:55:27.980 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2024-02-20T07:55:28.049 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-02-20T07:55:28.104 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-02-20T07:55:28.104 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-02-20T07:55:28.104 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-02-20T07:55:28.104 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:55:28.104 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-02-20T07:55:28.104 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:55:28.104 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:55:28.104 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-02-20T07:55:28.104 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:55:28.105 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:55:28.105 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:55:28.105 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:55:28.105 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:55:28.105 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:55:28.106 INFO:teuthology.provision.fog.smithi087:Deploy complete! 2024-02-20T07:55:28.107 DEBUG:teuthology.parallel:result is None 2024-02-20T07:55:34.072 WARNING:teuthology.provision.fog.smithi046:timed out 2024-02-20T07:55:40.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:55:40.363 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T07:55:40.363 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T07:55:40.740 INFO:teuthology.provision.fog.smithi046:Node is ready 2024-02-20T07:55:40.740 DEBUG:teuthology.orchestra.run.smithi046:> hostname 2024-02-20T07:55:40.756 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2024-02-20T07:55:40.756 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2024-02-20T07:55:40.815 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-02-20T07:55:40.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2024-02-20T07:55:40.943 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2024-02-20T07:55:40.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2024-02-20T07:55:41.048 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2024-02-20T07:55:41.137 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2024-02-20T07:55:41.210 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-02-20T07:55:41.268 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-02-20T07:55:41.269 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-02-20T07:55:41.269 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-02-20T07:55:41.269 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:55:41.269 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-02-20T07:55:41.269 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:55:41.269 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:55:41.270 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-02-20T07:55:41.270 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:55:41.270 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:55:41.270 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:55:41.270 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:55:41.270 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:55:41.270 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:55:41.271 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2024-02-20T07:55:41.272 DEBUG:teuthology.parallel:result is None 2024-02-20T07:55:41.473 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2024-02-20T07:55:41.474 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T07:55:41.500 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com 2024-02-20T07:55:41.500 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T07:55:41.526 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2024-02-20T07:55:41.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-20T07:55:41.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:55:41.635 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-02-20T07:55:41.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-20T07:55:41.703 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-02-20T07:55:41.757 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-02-20T07:55:41.758 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-02-20T07:55:41.812 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-02-20T07:55:41.813 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-02-20T07:55:41.813 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-02-20T07:55:41.813 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:55:41.813 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-02-20T07:55:41.813 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:55:41.813 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:55:41.813 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-02-20T07:55:41.813 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:55:41.813 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:55:41.813 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:55:41.813 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:55:41.813 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:55:41.814 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:55:41.814 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-02-20T07:55:41.851 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server 2024-02-20T07:55:41.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-02-20T07:55:41.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:55:41.940 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-02-20T07:55:42.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-02-20T07:55:42.110 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-02-20T07:55:42.164 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-02-20T07:55:42.165 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-02-20T07:55:42.219 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-02-20T07:55:42.219 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-02-20T07:55:42.219 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-02-20T07:55:42.220 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:55:42.220 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-02-20T07:55:42.220 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:55:42.220 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:55:42.220 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-02-20T07:55:42.220 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:55:42.220 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:55:42.220 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:55:42.220 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:55:42.220 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:55:42.220 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:55:42.225 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-02-20T07:55:42.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:55:42.361 INFO:teuthology.dispatcher.supervisor:Running job 7568569 2024-02-20T07:55:42.362 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568569 --name pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 0a 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568569/orig.config.yaml 2024-02-20T07:55:42.365 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568569 2024-02-20T07:55:42.365 INFO:teuthology.dispatcher.supervisor:Job PID: 3063698 2024-02-20T07:55:42.365 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-20T07:57:42.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:59:42.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:01:42.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:03:43.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:05:43.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:07:43.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:09:43.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:11:43.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:13:44.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:15:44.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:17:44.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:19:44.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:21:44.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:23:44.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:25:45.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:27:45.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:29:45.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:31:45.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:33:45.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:35:45.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:37:46.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:39:46.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:41:46.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:43:46.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:45:46.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:47:46.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:49:47.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:51:47.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:53:47.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:55:47.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:57:47.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:59:47.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:01:48.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:03:48.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:05:48.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:07:48.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:09:48.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:11:48.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:13:49.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:15:49.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:17:49.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:19:49.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:21:49.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:23:49.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:25:50.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:27:50.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:29:50.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:31:50.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:33:50.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:35:50.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:37:51.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:37:51.207 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1