2024-02-20T08:00:01.411 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-20T08:00:01.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:00:01.559 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6cdc662c10>, signals=[15]) 2024-02-20T08:00:01.559 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2024-02-20T08:00:01.560 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T08:00:01.560 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-02-20T08:00:01.580 INFO:teuthology.lock.ops:Start node 'smithi018.front.sepia.ceph.com' reimaging 2024-02-20T08:00:01.580 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T08:00:01.580 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-02-20T08:00:01.700 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T08:00:01.716 DEBUG:teuthology.provision.fog.smithi018:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T08:00:01.750 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 9.stream 2024-02-20T08:00:01.764 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of centos 9.stream 2024-02-20T08:00:01.999 INFO:teuthology.orchestra.console.smithi008:Power off 2024-02-20T08:00:02.000 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T08:00:02.014 INFO:teuthology.orchestra.console.smithi018:Power off 2024-02-20T08:00:02.014 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T08:00:02.025 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2024-02-20T08:00:02.026 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:00:02.040 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off 2024-02-20T08:00:02.040 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:00:02.048 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-02-20T08:00:02.064 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2024-02-20T08:00:06.052 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:00:06.064 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:00:06.162 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-02-20T08:00:06.173 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2024-02-20T08:00:10.164 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:00:10.174 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:00:10.274 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-02-20T08:00:10.285 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2024-02-20T08:00:10.375 INFO:teuthology.orchestra.console.smithi008:Power off completed 2024-02-20T08:00:10.386 INFO:teuthology.orchestra.console.smithi018:Power off completed 2024-02-20T08:00:10.476 INFO:teuthology.orchestra.console.smithi008:Power on 2024-02-20T08:00:10.476 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T08:00:10.487 INFO:teuthology.orchestra.console.smithi018:Power on 2024-02-20T08:00:10.487 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T08:00:10.498 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On 2024-02-20T08:00:10.498 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:00:10.507 DEBUG:teuthology.orchestra.console.smithi018:power on output: Chassis Power Control: Up/On 2024-02-20T08:00:10.508 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:00:10.520 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-02-20T08:00:10.531 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2024-02-20T08:00:14.525 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:00:14.532 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:00:14.635 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-02-20T08:00:14.641 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2024-02-20T08:00:18.637 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:00:18.645 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T08:00:18.747 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-02-20T08:00:18.754 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2024-02-20T08:00:18.848 INFO:teuthology.orchestra.console.smithi008:Power on completed 2024-02-20T08:00:18.855 INFO:teuthology.orchestra.console.smithi018:Power on completed 2024-02-20T08:00:18.949 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2024-02-20T08:00:18.956 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish 2024-02-20T08:02:49.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:02:49.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:02:52.864 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-02-20T08:02:52.864 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-20T08:02:58.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:02:58.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:03:01.948 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-02-20T08:03:01.949 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-20T08:03:07.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:03:07.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:03:11.008 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-02-20T08:03:11.009 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-20T08:03:17.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:03:17.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:03:20.092 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-02-20T08:03:20.093 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-20T08:03:26.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:03:26.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:03:29.148 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-02-20T08:03:29.148 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-20T08:03:35.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:03:35.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:03:38.204 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-02-20T08:03:38.240 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-20T08:03:44.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:03:44.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:04:44.269 WARNING:teuthology.provision.fog.smithi018:timed out 2024-02-20T08:04:44.270 WARNING:teuthology.provision.fog.smithi008:timed out 2024-02-20T08:04:50.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:04:50.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:04:50.554 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T08:04:50.555 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T08:04:50.562 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T08:04:50.562 DEBUG:teuthology.orchestra.run.smithi018:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T08:04:50.865 INFO:teuthology.provision.fog.smithi008:Node is ready 2024-02-20T08:04:50.865 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2024-02-20T08:04:50.879 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2024-02-20T08:04:50.880 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2024-02-20T08:04:50.895 INFO:teuthology.provision.fog.smithi018:Node is ready 2024-02-20T08:04:50.895 DEBUG:teuthology.orchestra.run.smithi018:> hostname 2024-02-20T08:04:50.910 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com 2024-02-20T08:04:50.910 DEBUG:teuthology.orchestra.run.smithi018:> grep smithi018.front.sepia.ceph.com /etc/hosts 2024-02-20T08:04:50.934 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2024-02-20T08:04:50.935 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-02-20T08:04:50.966 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018 2024-02-20T08:04:50.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018 2024-02-20T08:04:51.043 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2024-02-20T08:04:51.063 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hosts 2024-02-20T08:04:51.075 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2024-02-20T08:04:51.095 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/172.21.15.18/172.21.15.18/g' /etc/hosts 2024-02-20T08:04:51.145 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2024-02-20T08:04:51.166 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hostname 2024-02-20T08:04:51.216 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-02-20T08:04:51.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018 2024-02-20T08:04:51.286 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-02-20T08:04:51.307 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-02-20T08:04:51.341 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-02-20T08:04:51.341 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-02-20T08:04:51.341 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-02-20T08:04:51.341 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-02-20T08:04:51.341 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-02-20T08:04:51.342 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-02-20T08:04:51.342 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T08:04:51.342 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-02-20T08:04:51.342 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-02-20T08:04:51.342 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T08:04:51.342 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-02-20T08:04:51.342 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T08:04:51.342 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T08:04:51.342 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T08:04:51.343 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2024-02-20T08:04:51.344 DEBUG:teuthology.parallel:result is None 2024-02-20T08:04:51.362 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-02-20T08:04:51.362 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-02-20T08:04:51.362 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-02-20T08:04:51.362 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-02-20T08:04:51.362 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-02-20T08:04:51.362 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-02-20T08:04:51.362 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T08:04:51.362 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-02-20T08:04:51.362 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-02-20T08:04:51.362 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T08:04:51.362 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-02-20T08:04:51.363 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T08:04:51.363 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T08:04:51.363 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T08:04:51.363 INFO:teuthology.provision.fog.smithi018:Deploy complete! 2024-02-20T08:04:51.363 DEBUG:teuthology.parallel:result is None 2024-02-20T08:04:51.539 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2024-02-20T08:04:51.539 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T08:04:51.562 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com 2024-02-20T08:04:51.562 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T08:04:51.579 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2024-02-20T08:04:51.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-02-20T08:04:51.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:04:51.677 DEBUG:teuthology.orchestra.run.smithi008:> true 2024-02-20T08:04:51.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-02-20T08:04:51.743 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2024-02-20T08:04:51.797 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2024-02-20T08:04:51.797 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-02-20T08:04:51.852 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-02-20T08:04:51.852 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-02-20T08:04:51.852 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-02-20T08:04:51.852 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-02-20T08:04:51.852 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-02-20T08:04:51.852 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-02-20T08:04:51.852 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T08:04:51.853 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-02-20T08:04:51.853 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-02-20T08:04:51.853 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T08:04:51.853 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-02-20T08:04:51.853 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T08:04:51.853 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T08:04:51.853 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T08:04:51.853 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-02-20T08:04:51.878 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server 2024-02-20T08:04:51.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-02-20T08:04:51.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T08:04:51.976 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-02-20T08:04:52.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-02-20T08:04:52.042 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-02-20T08:04:52.097 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-02-20T08:04:52.098 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-02-20T08:04:52.153 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-02-20T08:04:52.153 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-02-20T08:04:52.153 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-02-20T08:04:52.153 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-02-20T08:04:52.153 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-02-20T08:04:52.153 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-02-20T08:04:52.153 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T08:04:52.153 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-02-20T08:04:52.153 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-02-20T08:04:52.154 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T08:04:52.154 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-02-20T08:04:52.154 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T08:04:52.154 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T08:04:52.154 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T08:04:52.154 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-02-20T08:04:52.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:04:52.273 INFO:teuthology.dispatcher.supervisor:Running job 7568577 2024-02-20T08:04:52.273 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568577 --name pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 0a 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568577/orig.config.yaml 2024-02-20T08:04:52.276 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568577 2024-02-20T08:04:52.277 INFO:teuthology.dispatcher.supervisor:Job PID: 3106323 2024-02-20T08:04:52.277 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-20T08:06:52.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:08:52.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:10:52.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:12:52.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:14:53.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:16:53.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:18:53.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:20:53.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:22:53.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:24:53.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:26:54.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:28:54.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:30:54.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:32:54.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:34:54.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:36:54.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:38:55.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:40:55.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:42:55.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:44:55.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:46:55.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:48:55.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:50:56.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:52:56.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:54:56.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:56:56.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:58:56.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:00:56.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:02:57.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:04:57.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:06:57.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:08:57.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:10:57.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:12:57.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:14:57.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:16:58.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:18:58.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:20:58.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:22:58.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:24:58.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:26:59.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:28:59.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:30:59.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:32:59.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:34:59.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:36:59.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:38:59.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:41:00.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:43:00.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:45:00.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:47:00.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:49:00.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:51:00.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:53:01.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:55:01.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:57:01.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:59:01.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:01:01.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:03:01.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T10:03:02.017 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1