2024-02-20T07:41:56.333 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-20T07:41:56.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:41:56.480 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb2df9f6c10>, signals=[15]) 2024-02-20T07:41:56.480 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging 2024-02-20T07:41:56.480 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T07:41:56.481 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-02-20T07:41:56.498 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2024-02-20T07:41:56.499 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T07:41:56.499 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-02-20T07:41:56.630 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T07:41:56.643 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T07:41:56.675 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 9.stream 2024-02-20T07:41:56.685 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of centos 9.stream 2024-02-20T07:41:56.917 INFO:teuthology.orchestra.console.smithi174:Power off 2024-02-20T07:41:56.917 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T07:41:56.931 INFO:teuthology.orchestra.console.smithi114:Power off 2024-02-20T07:41:56.931 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T07:41:56.942 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2024-02-20T07:41:56.942 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:41:56.955 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2024-02-20T07:41:56.956 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:41:56.964 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-02-20T07:41:56.977 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-02-20T07:42:00.971 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:42:00.980 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:42:01.082 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-02-20T07:42:01.095 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-02-20T07:42:05.084 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:42:05.097 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:42:05.194 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-02-20T07:42:05.207 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2024-02-20T07:42:05.307 INFO:teuthology.orchestra.console.smithi114:Power off completed 2024-02-20T07:42:05.408 INFO:teuthology.orchestra.console.smithi114:Power on 2024-02-20T07:42:05.408 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T07:42:05.433 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On 2024-02-20T07:42:05.434 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:42:05.457 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2024-02-20T07:42:09.196 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:42:09.305 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-02-20T07:42:09.406 INFO:teuthology.orchestra.console.smithi174:Power off completed 2024-02-20T07:42:09.458 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:42:09.506 INFO:teuthology.orchestra.console.smithi174:Power on 2024-02-20T07:42:09.507 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T07:42:09.532 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2024-02-20T07:42:09.533 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:42:09.556 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-02-20T07:42:09.567 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2024-02-20T07:42:13.560 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:42:13.568 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:42:13.670 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-02-20T07:42:13.677 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-02-20T07:42:13.777 INFO:teuthology.orchestra.console.smithi114:Power on completed 2024-02-20T07:42:13.878 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2024-02-20T07:42:17.673 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:42:17.783 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-02-20T07:42:17.886 INFO:teuthology.orchestra.console.smithi174:Power on completed 2024-02-20T07:42:17.986 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2024-02-20T07:44:44.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:44:47.612 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-20T07:44:48.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:44:51.644 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-20T07:44:53.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:44:56.668 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-20T07:44:57.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:00.700 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-20T07:45:02.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:05.728 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-20T07:45:06.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:09.756 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-20T07:45:11.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:14.812 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-20T07:45:15.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:18.816 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-20T07:45:20.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:23.872 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-20T07:45:24.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:27.900 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-20T07:45:29.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:32.956 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-20T07:45:33.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:36.956 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-20T07:45:38.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:42.012 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-20T07:45:42.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:46.012 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-20T07:45:48.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:52.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:45:55.068 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-20T07:46:01.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:46:04.124 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-20T07:46:10.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:46:48.054 WARNING:teuthology.provision.fog.smithi114:timed out 2024-02-20T07:46:54.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:46:54.419 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T07:46:54.420 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T07:46:54.744 INFO:teuthology.provision.fog.smithi114:Node is ready 2024-02-20T07:46:54.744 DEBUG:teuthology.orchestra.run.smithi114:> hostname 2024-02-20T07:46:54.761 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com 2024-02-20T07:46:54.762 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts 2024-02-20T07:46:54.818 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2024-02-20T07:46:54.818 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2024-02-20T07:46:54.928 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts 2024-02-20T07:46:54.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts 2024-02-20T07:46:55.024 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname 2024-02-20T07:46:55.092 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2024-02-20T07:46:55.160 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-02-20T07:46:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2024-02-20T07:46:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2024-02-20T07:46:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2024-02-20T07:46:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:46:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2024-02-20T07:46:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:46:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:46:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2024-02-20T07:46:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:46:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:46:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:46:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:46:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:46:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:46:55.217 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2024-02-20T07:46:55.218 DEBUG:teuthology.parallel:result is None 2024-02-20T07:47:10.144 WARNING:teuthology.provision.fog.smithi174:timed out 2024-02-20T07:47:16.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:47:16.384 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T07:47:16.384 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T07:47:16.728 INFO:teuthology.provision.fog.smithi174:Node is ready 2024-02-20T07:47:16.728 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2024-02-20T07:47:16.744 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2024-02-20T07:47:16.744 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2024-02-20T07:47:16.799 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2024-02-20T07:47:16.799 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2024-02-20T07:47:16.906 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2024-02-20T07:47:16.936 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2024-02-20T07:47:17.005 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2024-02-20T07:47:17.073 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2024-02-20T07:47:17.142 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-02-20T07:47:17.196 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-02-20T07:47:17.196 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-02-20T07:47:17.196 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-02-20T07:47:17.196 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:47:17.196 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-02-20T07:47:17.196 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:47:17.196 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:47:17.197 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-02-20T07:47:17.197 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:47:17.197 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:47:17.197 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:47:17.197 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:47:17.197 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:47:17.197 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:47:17.197 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2024-02-20T07:47:17.198 DEBUG:teuthology.parallel:result is None 2024-02-20T07:47:17.361 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2024-02-20T07:47:17.361 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T07:47:17.391 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2024-02-20T07:47:17.391 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T07:47:17.419 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2024-02-20T07:47:17.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-02-20T07:47:17.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:47:17.516 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-02-20T07:47:17.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-02-20T07:47:17.682 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-02-20T07:47:17.736 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-02-20T07:47:17.737 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-02-20T07:47:17.791 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2024-02-20T07:47:17.791 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2024-02-20T07:47:17.791 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2024-02-20T07:47:17.791 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:47:17.791 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2024-02-20T07:47:17.791 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:47:17.791 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:47:17.791 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2024-02-20T07:47:17.791 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:47:17.792 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:47:17.792 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:47:17.792 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:47:17.792 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:47:17.792 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:47:17.792 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-02-20T07:47:17.816 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2024-02-20T07:47:17.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-02-20T07:47:17.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:47:17.904 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-02-20T07:47:17.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-02-20T07:47:17.975 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-02-20T07:47:18.031 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-02-20T07:47:18.031 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-02-20T07:47:18.087 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-02-20T07:47:18.087 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-02-20T07:47:18.087 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-02-20T07:47:18.087 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:47:18.088 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-02-20T07:47:18.088 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:47:18.088 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:47:18.088 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-02-20T07:47:18.088 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:47:18.088 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:47:18.088 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:47:18.088 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:47:18.088 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:47:18.088 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:47:18.089 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-02-20T07:47:18.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:47:18.207 INFO:teuthology.dispatcher.supervisor:Running job 7568558 2024-02-20T07:47:18.207 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568558 --name pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 0a 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568558/orig.config.yaml 2024-02-20T07:47:18.210 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568558 2024-02-20T07:47:18.211 INFO:teuthology.dispatcher.supervisor:Job PID: 3020530 2024-02-20T07:47:18.211 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-20T07:49:18.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:51:18.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:53:18.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:55:18.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:57:18.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:59:19.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:01:19.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:03:19.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:05:19.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:07:19.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:09:20.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:11:20.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:13:20.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:15:20.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:17:20.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:19:20.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:21:21.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:23:21.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:25:21.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:27:21.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:29:21.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:31:21.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:33:21.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:35:22.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:37:22.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:39:22.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:41:22.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:43:22.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:45:22.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:47:22.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:49:23.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:51:23.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:53:23.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:55:23.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:57:23.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:59:23.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:01:24.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:03:24.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:05:24.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:07:24.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:09:24.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:11:24.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:13:25.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:15:25.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:17:25.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:19:25.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:21:25.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:23:25.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:25:26.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:27:26.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:29:26.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:31:26.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:31:26.722 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1