2024-02-19T18:29:59.226 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T18:29:59.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:29:59.365 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb80fbdfc10>, signals=[15]) 2024-02-19T18:29:59.366 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging 2024-02-19T18:29:59.366 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T18:29:59.366 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-02-19T18:29:59.383 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2024-02-19T18:29:59.383 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T18:29:59.384 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-02-19T18:29:59.517 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T18:29:59.526 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T18:29:59.562 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 9.stream 2024-02-19T18:29:59.569 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 9.stream 2024-02-19T18:30:00.182 INFO:teuthology.orchestra.console.smithi181:Power off 2024-02-19T18:30:00.183 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T18:30:00.204 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2024-02-19T18:30:00.204 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:00.223 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-02-19T18:30:00.230 INFO:teuthology.orchestra.console.smithi162:Power off 2024-02-19T18:30:00.230 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T18:30:00.254 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2024-02-19T18:30:00.255 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:00.278 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-19T18:30:00.324 INFO:teuthology.orchestra.console.smithi181:Power off completed 2024-02-19T18:30:00.425 INFO:teuthology.orchestra.console.smithi181:Power on 2024-02-19T18:30:00.425 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T18:30:00.448 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2024-02-19T18:30:00.449 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:00.470 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-02-19T18:30:04.283 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:04.394 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-19T18:30:04.471 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:04.580 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-02-19T18:30:08.399 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:08.511 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-19T18:30:08.581 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:08.689 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-02-19T18:30:08.790 INFO:teuthology.orchestra.console.smithi181:Power on completed 2024-02-19T18:30:08.890 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2024-02-19T18:30:12.515 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:12.624 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-02-19T18:30:12.724 INFO:teuthology.orchestra.console.smithi162:Power off completed 2024-02-19T18:30:12.825 INFO:teuthology.orchestra.console.smithi162:Power on 2024-02-19T18:30:12.825 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T18:30:12.846 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On 2024-02-19T18:30:12.846 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:12.866 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-02-19T18:30:16.871 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:16.979 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-02-19T18:30:20.984 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:21.094 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-19T18:30:21.195 INFO:teuthology.orchestra.console.smithi162:Power on completed 2024-02-19T18:30:21.295 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2024-02-19T18:35:05.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:08.252 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-19T18:35:14.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:17.308 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-19T18:35:20.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:23.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:23.996 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-19T18:35:26.364 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-19T18:35:30.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:32.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:33.052 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-19T18:35:35.420 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-19T18:35:39.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:41.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:42.108 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-19T18:35:44.476 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-02-19T18:35:48.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:50.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:51.196 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-19T18:35:57.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:00.252 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-19T18:36:06.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:09.308 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-19T18:36:15.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:18.364 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-19T18:36:24.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:50.509 WARNING:teuthology.provision.fog.smithi181:timed out 2024-02-19T18:36:56.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:56.746 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T18:36:56.746 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T18:36:57.051 INFO:teuthology.provision.fog.smithi181:Node is ready 2024-02-19T18:36:57.052 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2024-02-19T18:36:57.107 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2024-02-19T18:36:57.107 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts 2024-02-19T18:36:57.162 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2024-02-19T18:36:57.162 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2024-02-19T18:36:57.269 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts 2024-02-19T18:36:57.298 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2024-02-19T18:36:57.365 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname 2024-02-19T18:36:57.432 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2024-02-19T18:36:57.499 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-02-19T18:36:57.554 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-02-19T18:36:57.554 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-02-19T18:36:57.554 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-02-19T18:36:57.554 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:36:57.554 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-02-19T18:36:57.554 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:36:57.554 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:36:57.554 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-02-19T18:36:57.555 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:36:57.555 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:36:57.555 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:36:57.555 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:36:57.555 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:36:57.555 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:36:57.556 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2024-02-19T18:36:57.557 DEBUG:teuthology.parallel:result is None 2024-02-19T18:37:24.392 WARNING:teuthology.provision.fog.smithi162:timed out 2024-02-19T18:37:30.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:30.826 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T18:37:30.827 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T18:37:31.152 INFO:teuthology.provision.fog.smithi162:Node is ready 2024-02-19T18:37:31.152 DEBUG:teuthology.orchestra.run.smithi162:> hostname 2024-02-19T18:37:31.166 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2024-02-19T18:37:31.166 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts 2024-02-19T18:37:31.221 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2024-02-19T18:37:31.221 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2024-02-19T18:37:31.319 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts 2024-02-19T18:37:31.347 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts 2024-02-19T18:37:31.414 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname 2024-02-19T18:37:31.481 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2024-02-19T18:37:31.547 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-02-19T18:37:31.602 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-02-19T18:37:31.602 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-02-19T18:37:31.602 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-02-19T18:37:31.602 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:37:31.602 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-02-19T18:37:31.602 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:37:31.602 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:37:31.602 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-02-19T18:37:31.602 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:37:31.602 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:37:31.602 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:37:31.602 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:37:31.602 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:37:31.603 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:37:31.603 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2024-02-19T18:37:31.604 DEBUG:teuthology.parallel:result is None 2024-02-19T18:37:31.774 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2024-02-19T18:37:31.774 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T18:37:31.800 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2024-02-19T18:37:31.800 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T18:37:31.817 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2024-02-19T18:37:31.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-02-19T18:37:31.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:31.903 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-02-19T18:37:31.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-02-19T18:37:31.974 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-02-19T18:37:32.028 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-02-19T18:37:32.029 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-02-19T18:37:32.083 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-02-19T18:37:32.083 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-02-19T18:37:32.083 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-02-19T18:37:32.083 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:37:32.083 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-02-19T18:37:32.083 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:37:32.083 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:37:32.084 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-02-19T18:37:32.084 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:37:32.084 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:37:32.084 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:37:32.084 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:37:32.084 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:37:32.084 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:37:32.084 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-02-19T18:37:32.108 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2024-02-19T18:37:32.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-02-19T18:37:32.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:32.193 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-02-19T18:37:32.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-02-19T18:37:32.362 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-02-19T18:37:32.416 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-02-19T18:37:32.419 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-02-19T18:37:32.471 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-02-19T18:37:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-02-19T18:37:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-02-19T18:37:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:37:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-02-19T18:37:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:37:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:37:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-02-19T18:37:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:37:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:37:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:37:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:37:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:37:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:37:32.473 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-02-19T18:37:32.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:37:32.584 INFO:teuthology.dispatcher.supervisor:Running job 7566642 2024-02-19T18:37:32.584 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566642 --name pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 0a 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566642/orig.config.yaml 2024-02-19T18:37:32.588 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566642 2024-02-19T18:37:32.588 INFO:teuthology.dispatcher.supervisor:Job PID: 3452247 2024-02-19T18:37:32.588 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-19T18:39:32.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:41:32.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:43:33.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:45:33.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:47:33.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:49:33.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:51:33.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:53:34.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:55:34.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:57:34.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:59:34.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:01:34.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:03:34.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:05:35.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:07:35.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:09:35.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:11:35.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:13:35.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:15:35.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:17:36.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:19:36.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:21:36.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:23:36.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:25:36.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:27:36.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:29:37.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:31:37.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:33:37.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:35:37.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:37:37.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:39:37.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:41:38.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:43:38.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:45:38.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:47:38.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:49:38.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:51:38.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:53:39.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:55:39.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:57:39.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:59:39.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:01:39.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:03:39.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:05:40.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:07:40.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:09:40.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:11:40.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:13:40.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:15:40.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:17:41.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:19:41.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:21:41.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:23:41.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:23:41.749 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1