2024-02-16T01:47:55.917 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-16T01:47:55.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T01:47:56.052 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb014b8bc10>, signals=[15]) 2024-02-16T01:47:56.052 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2024-02-16T01:47:56.052 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2024-02-16T01:47:56.052 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-02-16T01:47:56.076 INFO:teuthology.lock.ops:Start node 'smithi189.front.sepia.ceph.com' reimaging 2024-02-16T01:47:56.076 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: reset os type and version on server 2024-02-16T01:47:56.076 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-02-16T01:47:56.214 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_9.stream (ID 10) 2024-02-16T01:47:56.218 DEBUG:teuthology.provision.fog.smithi189:Requesting image smithi_centos_9.stream (ID 10) 2024-02-16T01:47:56.259 INFO:teuthology.provision.fog.smithi189:Scheduling deploy of centos 9.stream 2024-02-16T01:47:56.263 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 9.stream 2024-02-16T01:47:56.531 INFO:teuthology.orchestra.console.smithi088:Power off 2024-02-16T01:47:56.532 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-16T01:47:56.545 INFO:teuthology.orchestra.console.smithi189:Power off 2024-02-16T01:47:56.545 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-16T01:47:56.558 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-02-16T01:47:56.558 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T01:47:56.566 DEBUG:teuthology.orchestra.console.smithi189:power off output: Chassis Power Control: Down/Off 2024-02-16T01:47:56.567 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T01:47:56.578 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-02-16T01:47:56.591 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on 2024-02-16T01:48:00.583 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T01:48:00.592 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T01:48:00.694 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-02-16T01:48:00.700 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on 2024-02-16T01:48:04.700 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T01:48:04.707 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T01:48:04.809 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-02-16T01:48:04.817 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-02-16T01:48:04.917 INFO:teuthology.orchestra.console.smithi189:Power off completed 2024-02-16T01:48:05.018 INFO:teuthology.orchestra.console.smithi189:Power on 2024-02-16T01:48:05.018 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-16T01:48:05.039 DEBUG:teuthology.orchestra.console.smithi189:power on output: Chassis Power Control: Up/On 2024-02-16T01:48:05.040 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T01:48:05.062 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-02-16T01:48:08.812 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T01:48:08.920 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-02-16T01:48:09.021 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-02-16T01:48:09.063 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T01:48:09.122 INFO:teuthology.orchestra.console.smithi088:Power on 2024-02-16T01:48:09.122 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-16T01:48:09.143 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2024-02-16T01:48:09.144 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T01:48:09.168 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-02-16T01:48:09.171 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-02-16T01:48:13.172 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T01:48:13.179 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T01:48:13.282 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-02-16T01:48:13.288 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on 2024-02-16T01:48:13.383 INFO:teuthology.orchestra.console.smithi088:Power on completed 2024-02-16T01:48:13.389 INFO:teuthology.orchestra.console.smithi189:Power on completed 2024-02-16T01:48:13.484 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2024-02-16T01:48:13.490 INFO:teuthology.provision.fog.smithi189:Waiting for deploy to finish 2024-02-16T01:50:59.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:51:14.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:51:17.820 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-02-16T01:51:23.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:51:26.908 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-02-16T01:51:32.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:51:32.928 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-16T01:51:35.964 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-02-16T01:51:38.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:51:41.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:51:42.012 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-16T01:51:45.024 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-02-16T01:51:48.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:51:51.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:51:51.071 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-16T01:51:57.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:52:00.156 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-16T01:52:06.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:52:09.212 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-16T01:52:15.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:52:18.268 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-16T01:52:24.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:52:51.060 WARNING:teuthology.provision.fog.smithi189:timed out 2024-02-16T01:52:57.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:52:57.411 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-16T01:52:57.411 DEBUG:teuthology.orchestra.run.smithi189:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-16T01:52:57.753 INFO:teuthology.provision.fog.smithi189:Node is ready 2024-02-16T01:52:57.754 DEBUG:teuthology.orchestra.run.smithi189:> hostname 2024-02-16T01:52:57.769 INFO:teuthology.orchestra.run.smithi189.stdout:smithi189.front.sepia.ceph.com 2024-02-16T01:52:57.769 DEBUG:teuthology.orchestra.run.smithi189:> grep smithi189.front.sepia.ceph.com /etc/hosts 2024-02-16T01:52:57.826 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.15.189 smithi189.front.sepia.ceph.com smithi189 2024-02-16T01:52:57.826 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname smithi189 2024-02-16T01:52:57.927 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi189.front.sepia.ceph.com/smithi189/g' /etc/hosts 2024-02-16T01:52:57.955 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/172.21.15.189/172.21.15.189/g' /etc/hosts 2024-02-16T01:52:58.023 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi189.front.sepia.ceph.com/smithi189/g' /etc/hostname 2024-02-16T01:52:58.090 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname smithi189 2024-02-16T01:52:58.157 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-02-16T01:52:58.211 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-02-16T01:52:58.211 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-02-16T01:52:58.211 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-02-16T01:52:58.211 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-02-16T01:52:58.211 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-02-16T01:52:58.211 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-02-16T01:52:58.212 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-16T01:52:58.212 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-02-16T01:52:58.212 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-02-16T01:52:58.212 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-16T01:52:58.212 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-02-16T01:52:58.212 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-16T01:52:58.212 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-16T01:52:58.212 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-16T01:52:58.213 INFO:teuthology.provision.fog.smithi189:Deploy complete! 2024-02-16T01:52:58.215 DEBUG:teuthology.parallel:result is None 2024-02-16T01:53:24.300 WARNING:teuthology.provision.fog.smithi088:timed out 2024-02-16T01:53:30.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:53:30.909 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-16T01:53:30.909 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-16T01:53:31.244 INFO:teuthology.provision.fog.smithi088:Node is ready 2024-02-16T01:53:31.244 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2024-02-16T01:53:31.259 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2024-02-16T01:53:31.259 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2024-02-16T01:53:31.315 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2024-02-16T01:53:31.315 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-02-16T01:53:31.421 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2024-02-16T01:53:31.449 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2024-02-16T01:53:31.515 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2024-02-16T01:53:31.582 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-02-16T01:53:31.648 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-02-16T01:53:31.703 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-02-16T01:53:31.703 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-02-16T01:53:31.703 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-02-16T01:53:31.703 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-02-16T01:53:31.703 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-02-16T01:53:31.703 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-02-16T01:53:31.703 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-16T01:53:31.703 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-02-16T01:53:31.704 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-02-16T01:53:31.704 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-16T01:53:31.704 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-02-16T01:53:31.704 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-16T01:53:31.704 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-16T01:53:31.704 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-16T01:53:31.704 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2024-02-16T01:53:31.705 DEBUG:teuthology.parallel:result is None 2024-02-16T01:53:31.868 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2024-02-16T01:53:31.869 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-16T01:53:31.898 INFO:teuthology.lock.ops:Checking smithi189.front.sepia.ceph.com 2024-02-16T01:53:31.898 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-16T01:53:31.915 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2024-02-16T01:53:31.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-02-16T01:53:31.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:53:32.003 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-02-16T01:53:32.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-02-16T01:53:32.070 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-02-16T01:53:32.124 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-02-16T01:53:32.124 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-02-16T01:53:32.178 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-02-16T01:53:32.178 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-02-16T01:53:32.178 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-02-16T01:53:32.178 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-02-16T01:53:32.178 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-02-16T01:53:32.178 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-02-16T01:53:32.178 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-16T01:53:32.178 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-02-16T01:53:32.178 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-02-16T01:53:32.178 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-16T01:53:32.179 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-02-16T01:53:32.179 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-16T01:53:32.179 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-16T01:53:32.179 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-16T01:53:32.179 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-02-16T01:53:32.198 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: set os type and version on server 2024-02-16T01:53:32.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-02-16T01:53:32.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T01:53:32.286 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-02-16T01:53:32.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-02-16T01:53:32.459 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-02-16T01:53:32.514 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-02-16T01:53:32.514 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-02-16T01:53:32.568 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-02-16T01:53:32.568 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-02-16T01:53:32.568 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-02-16T01:53:32.568 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-02-16T01:53:32.568 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-02-16T01:53:32.568 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-02-16T01:53:32.569 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-16T01:53:32.569 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-02-16T01:53:32.569 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-02-16T01:53:32.569 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-16T01:53:32.569 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-02-16T01:53:32.569 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-16T01:53:32.569 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-16T01:53:32.569 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-16T01:53:32.569 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-02-16T01:53:32.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T01:53:32.684 INFO:teuthology.dispatcher.supervisor:Running job 7561882 2024-02-16T01:53:32.684 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-16_01:25:08-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561882 --name pdonnell-2024-02-16_01:25:08-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-16_01:25:08-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561882/orig.config.yaml 2024-02-16T01:53:32.687 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-16_01:25:08-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561882 2024-02-16T01:53:32.688 INFO:teuthology.dispatcher.supervisor:Job PID: 189624 2024-02-16T01:53:32.688 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-16T01:55:32.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T01:57:32.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T01:59:33.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:01:33.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:03:33.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:05:33.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:07:33.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:09:33.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:11:34.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:13:34.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:15:34.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:17:34.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:19:34.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:21:34.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:23:35.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:25:35.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:27:35.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:29:35.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:31:35.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T02:31:35.887 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-02-16T02:31:36.000 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi088 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-02-14_14:58:57-rados-wip-yuri4-testing-2024-02-13-1546-distro-default-smithi/7559970 2024-02-16T02:31:36.000 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi189 but it was locked by another job: /home/teuthworker/archive/vshankar-2024-02-16_02:29:06-fs-wip-63945-4-testing-default-smithi/7561913