2024-02-19T18:29:59.585 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T18:29:59.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:29:59.731 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa9bef2cc10>, signals=[15]) 2024-02-19T18:29:59.731 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2024-02-19T18:29:59.732 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T18:29:59.732 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-02-19T18:29:59.750 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2024-02-19T18:29:59.750 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T18:29:59.750 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-02-19T18:29:59.854 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T18:29:59.893 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T18:29:59.905 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 9.stream 2024-02-19T18:29:59.946 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 9.stream 2024-02-19T18:30:00.528 INFO:teuthology.orchestra.console.smithi084:Power off 2024-02-19T18:30:00.528 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T18:30:00.541 INFO:teuthology.orchestra.console.smithi099:Power off 2024-02-19T18:30:00.541 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T18:30:00.549 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-02-19T18:30:00.550 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:00.562 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-02-19T18:30:00.563 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:00.571 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-02-19T18:30:00.585 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-19T18:30:00.671 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-02-19T18:30:00.772 INFO:teuthology.orchestra.console.smithi084:Power on 2024-02-19T18:30:00.772 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T18:30:00.794 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2024-02-19T18:30:00.794 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:00.816 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-02-19T18:30:04.588 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:04.697 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-19T18:30:04.817 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:04.927 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-02-19T18:30:08.700 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:08.808 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-19T18:30:08.928 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:09.035 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-02-19T18:30:09.136 INFO:teuthology.orchestra.console.smithi084:Power on completed 2024-02-19T18:30:09.237 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2024-02-19T18:30:12.812 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:12.920 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-19T18:30:13.021 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-02-19T18:30:13.122 INFO:teuthology.orchestra.console.smithi099:Power on 2024-02-19T18:30:13.122 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T18:30:13.141 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2024-02-19T18:30:13.141 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:13.165 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-19T18:30:17.166 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:17.274 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-19T18:30:21.278 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T18:30:21.390 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-19T18:30:21.490 INFO:teuthology.orchestra.console.smithi099:Power on completed 2024-02-19T18:30:21.591 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2024-02-19T18:35:06.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:09.180 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-19T18:35:15.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:18.268 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-19T18:35:24.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:27.324 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-19T18:35:33.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:36.380 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-19T18:35:42.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:45.436 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-19T18:35:51.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:35:54.492 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-19T18:36:00.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:03.580 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-19T18:36:09.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:19.900 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-19T18:36:25.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:28.957 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-19T18:36:34.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:38.044 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-19T18:36:44.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:36:46.327 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T18:36:46.328 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T18:37:06.711 INFO:teuthology.provision.fog.smithi099:Node is ready 2024-02-19T18:37:06.711 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2024-02-19T18:37:06.729 INFO:teuthology.orchestra.run.smithi099.stdout:smithi046 2024-02-19T18:37:06.730 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi046 /etc/hosts 2024-02-19T18:37:06.786 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-02-19T18:37:06.787 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-02-19T18:37:06.964 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi046/smithi099/g' /etc/hosts 2024-02-19T18:37:06.995 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.46/172.21.15.99/g' /etc/hosts 2024-02-19T18:37:07.067 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi046/smithi099/g' /etc/hostname 2024-02-19T18:37:07.137 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-02-19T18:37:07.207 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-02-19T18:37:07.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:07.263 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-02-19T18:37:07.263 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-02-19T18:37:07.263 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-02-19T18:37:07.263 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:37:07.263 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-02-19T18:37:07.263 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:37:07.263 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:37:07.263 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-02-19T18:37:07.263 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:37:07.263 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:37:07.264 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:37:07.264 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:37:07.264 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:37:07.264 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:37:07.264 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2024-02-19T18:37:07.266 DEBUG:teuthology.parallel:result is None 2024-02-19T18:37:10.300 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-19T18:37:16.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:19.356 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-19T18:37:25.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:28.444 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-19T18:37:34.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:37.532 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-19T18:37:43.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:46.624 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-19T18:37:52.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:37:55.708 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-02-19T18:38:01.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:39:01.769 WARNING:teuthology.provision.fog.smithi084:timed out 2024-02-19T18:39:07.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:39:08.110 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T18:39:08.110 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T18:39:08.446 INFO:teuthology.provision.fog.smithi084:Node is ready 2024-02-19T18:39:08.446 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2024-02-19T18:39:08.460 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2024-02-19T18:39:08.461 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2024-02-19T18:39:08.516 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2024-02-19T18:39:08.516 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-02-19T18:39:08.628 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2024-02-19T18:39:08.655 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2024-02-19T18:39:08.721 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2024-02-19T18:39:08.790 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-02-19T18:39:08.856 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-02-19T18:39:08.910 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-02-19T18:39:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-02-19T18:39:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-02-19T18:39:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:39:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-02-19T18:39:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:39:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:39:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-02-19T18:39:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:39:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:39:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:39:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:39:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:39:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:39:08.912 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2024-02-19T18:39:08.912 DEBUG:teuthology.parallel:result is None 2024-02-19T18:39:09.079 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2024-02-19T18:39:09.080 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T18:39:09.106 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2024-02-19T18:39:09.107 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T18:39:09.132 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2024-02-19T18:39:09.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-02-19T18:39:09.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:39:09.224 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-02-19T18:39:09.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-02-19T18:39:09.289 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-02-19T18:39:09.343 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-02-19T18:39:09.343 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-02-19T18:39:09.397 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-02-19T18:39:09.397 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-02-19T18:39:09.397 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-02-19T18:39:09.397 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:39:09.397 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-02-19T18:39:09.397 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:39:09.398 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:39:09.398 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-02-19T18:39:09.398 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:39:09.398 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:39:09.398 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:39:09.398 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:39:09.398 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:39:09.398 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:39:09.399 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-02-19T18:39:09.423 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2024-02-19T18:39:09.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-19T18:39:09.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:39:09.510 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-02-19T18:39:09.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-19T18:39:09.679 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-02-19T18:39:09.733 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-02-19T18:39:09.733 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-02-19T18:39:09.787 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-02-19T18:39:09.787 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-02-19T18:39:09.788 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-02-19T18:39:09.788 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:39:09.788 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-02-19T18:39:09.788 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:39:09.788 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:39:09.788 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-02-19T18:39:09.788 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:39:09.788 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:39:09.788 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:39:09.788 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:39:09.789 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:39:09.789 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:39:09.790 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-02-19T18:39:09.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:39:09.906 INFO:teuthology.dispatcher.supervisor:Running job 7566643 2024-02-19T18:39:09.906 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566643 --name pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566643/orig.config.yaml 2024-02-19T18:39:09.909 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566643 2024-02-19T18:39:09.909 INFO:teuthology.dispatcher.supervisor:Job PID: 3456548 2024-02-19T18:39:09.909 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-19T18:41:10.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:43:10.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:45:10.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:47:10.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:49:10.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:51:10.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:53:11.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:55:11.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:57:11.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:59:11.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:01:11.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:03:11.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:05:12.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:07:12.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:09:12.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:11:12.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:13:12.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:15:12.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:17:13.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:19:13.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:21:13.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:23:13.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:25:13.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:27:13.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:29:14.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:31:14.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:33:14.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:35:14.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:37:14.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:39:14.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:41:15.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:43:15.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:45:15.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:47:15.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:49:15.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:51:15.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:53:16.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:55:16.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:57:16.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T19:59:16.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:01:16.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:03:16.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:05:16.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:07:17.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:09:17.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:11:17.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:13:17.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:15:17.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:17:17.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:19:18.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:21:18.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:23:18.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:25:18.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:27:18.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:29:18.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:31:19.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:33:19.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:35:19.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:37:19.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:37:19.720 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1