2024-03-24T00:16:25.131 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-24T00:16:25.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:16:25.285 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f325bb09c10>, signals=[15]) 2024-03-24T00:16:25.285 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2024-03-24T00:16:25.286 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2024-03-24T00:16:25.286 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-03-24T00:16:25.309 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2024-03-24T00:16:25.309 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2024-03-24T00:16:25.309 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-03-24T00:16:25.436 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_centos_9.stream (ID 10) 2024-03-24T00:16:25.447 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_9.stream (ID 10) 2024-03-24T00:16:25.483 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 9.stream 2024-03-24T00:16:25.497 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 9.stream 2024-03-24T00:16:25.758 INFO:teuthology.orchestra.console.smithi038:Power off 2024-03-24T00:16:25.758 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-24T00:16:25.780 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2024-03-24T00:16:25.781 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:16:25.797 INFO:teuthology.orchestra.console.smithi088:Power off 2024-03-24T00:16:25.797 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-24T00:16:25.806 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-03-24T00:16:25.818 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-03-24T00:16:25.818 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:16:25.838 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-03-24T00:16:29.810 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:16:29.838 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:16:29.920 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-03-24T00:16:29.946 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-03-24T00:16:33.923 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:16:33.948 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:16:34.033 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-03-24T00:16:34.055 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-03-24T00:16:34.156 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-03-24T00:16:34.256 INFO:teuthology.orchestra.console.smithi088:Power on 2024-03-24T00:16:34.257 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-24T00:16:34.279 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2024-03-24T00:16:34.280 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:16:34.304 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-03-24T00:16:38.034 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:16:38.142 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-03-24T00:16:38.243 INFO:teuthology.orchestra.console.smithi038:Power off completed 2024-03-24T00:16:38.305 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:16:38.344 INFO:teuthology.orchestra.console.smithi038:Power on 2024-03-24T00:16:38.344 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-24T00:16:38.367 DEBUG:teuthology.orchestra.console.smithi038:power on output: Chassis Power Control: Up/On 2024-03-24T00:16:38.367 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:16:38.387 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-03-24T00:16:38.414 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-03-24T00:16:42.392 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:16:42.415 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T00:16:42.501 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-03-24T00:16:42.524 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-03-24T00:16:42.603 INFO:teuthology.orchestra.console.smithi038:Power on completed 2024-03-24T00:16:42.625 INFO:teuthology.orchestra.console.smithi088:Power on completed 2024-03-24T00:16:42.704 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2024-03-24T00:16:42.726 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2024-03-24T00:19:13.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:19:28.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:19:32.003 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-03-24T00:19:38.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:19:41.086 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-03-24T00:19:47.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:19:47.102 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-03-24T00:19:50.178 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-03-24T00:19:53.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:19:56.158 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-03-24T00:19:56.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:19:59.262 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-03-24T00:20:02.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:20:05.214 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-03-24T00:20:05.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:20:11.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:20:14.270 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-03-24T00:20:20.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:20:23.326 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-03-24T00:20:29.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:20:32.382 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-03-24T00:20:38.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:21:05.291 WARNING:teuthology.provision.fog.smithi038:timed out 2024-03-24T00:21:11.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:21:11.606 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-24T00:21:11.606 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-24T00:21:11.933 INFO:teuthology.provision.fog.smithi038:Node is ready 2024-03-24T00:21:11.933 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2024-03-24T00:21:11.948 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2024-03-24T00:21:11.949 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2024-03-24T00:21:12.006 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2024-03-24T00:21:12.007 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2024-03-24T00:21:12.130 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2024-03-24T00:21:12.163 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2024-03-24T00:21:12.236 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2024-03-24T00:21:12.309 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2024-03-24T00:21:12.380 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-03-24T00:21:12.435 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-03-24T00:21:12.435 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2024-03-24T00:21:12.435 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-03-24T00:21:12.435 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-03-24T00:21:12.435 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2024-03-24T00:21:12.435 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2024-03-24T00:21:12.436 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T00:21:12.436 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-03-24T00:21:12.436 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2024-03-24T00:21:12.436 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T00:21:12.436 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-03-24T00:21:12.436 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T00:21:12.436 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T00:21:12.436 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T00:21:12.437 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2024-03-24T00:21:12.438 DEBUG:teuthology.parallel:result is None 2024-03-24T00:21:38.410 WARNING:teuthology.provision.fog.smithi088:timed out 2024-03-24T00:21:44.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:21:44.722 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-24T00:21:44.722 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-24T00:21:45.057 INFO:teuthology.provision.fog.smithi088:Node is ready 2024-03-24T00:21:45.057 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2024-03-24T00:21:45.072 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2024-03-24T00:21:45.072 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2024-03-24T00:21:45.126 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2024-03-24T00:21:45.126 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-03-24T00:21:45.226 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2024-03-24T00:21:45.253 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2024-03-24T00:21:45.321 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2024-03-24T00:21:45.388 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-03-24T00:21:45.454 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-03-24T00:21:45.509 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-03-24T00:21:45.509 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-03-24T00:21:45.509 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-03-24T00:21:45.509 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-03-24T00:21:45.509 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-03-24T00:21:45.509 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-03-24T00:21:45.509 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T00:21:45.509 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-03-24T00:21:45.509 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-03-24T00:21:45.510 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T00:21:45.510 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-03-24T00:21:45.510 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T00:21:45.510 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T00:21:45.510 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T00:21:45.510 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2024-03-24T00:21:45.511 DEBUG:teuthology.parallel:result is None 2024-03-24T00:21:45.682 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2024-03-24T00:21:45.682 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-24T00:21:45.704 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2024-03-24T00:21:45.704 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-24T00:21:45.729 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2024-03-24T00:21:45.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-03-24T00:21:45.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:21:45.835 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-03-24T00:21:46.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-03-24T00:21:46.021 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-03-24T00:21:46.076 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-03-24T00:21:46.076 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-03-24T00:21:46.130 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-03-24T00:21:46.130 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2024-03-24T00:21:46.131 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-03-24T00:21:46.131 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-03-24T00:21:46.131 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2024-03-24T00:21:46.131 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2024-03-24T00:21:46.131 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T00:21:46.131 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-03-24T00:21:46.131 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2024-03-24T00:21:46.131 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T00:21:46.131 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-03-24T00:21:46.131 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T00:21:46.131 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T00:21:46.131 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T00:21:46.132 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-03-24T00:21:46.154 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2024-03-24T00:21:46.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-03-24T00:21:46.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T00:21:46.240 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-03-24T00:21:46.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-03-24T00:21:46.305 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-03-24T00:21:46.359 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-03-24T00:21:46.359 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-03-24T00:21:46.412 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-03-24T00:21:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-03-24T00:21:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-03-24T00:21:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-03-24T00:21:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-03-24T00:21:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-03-24T00:21:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T00:21:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-03-24T00:21:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-03-24T00:21:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T00:21:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-03-24T00:21:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T00:21:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T00:21:46.413 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T00:21:46.414 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-03-24T00:21:46.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:21:46.539 INFO:teuthology.dispatcher.supervisor:Running job 7616441 2024-03-24T00:21:46.540 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616441 --name mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616441/orig.config.yaml 2024-03-24T00:21:46.542 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616441 2024-03-24T00:21:46.543 INFO:teuthology.dispatcher.supervisor:Job PID: 2844127 2024-03-24T00:21:46.543 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-24T00:23:46.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:25:46.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:27:46.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:29:47.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:31:47.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:33:47.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:35:47.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:37:47.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:39:47.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:41:48.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:43:48.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:45:48.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:47:48.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:49:48.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:51:48.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:53:49.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:55:49.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:57:49.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T00:59:49.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T01:01:49.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T01:03:49.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T01:05:50.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T01:07:50.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T01:09:50.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T01:09:50.486 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1