2024-02-20T07:38:15.041 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-20T07:38:15.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:38:15.179 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f509ac7ec10>, signals=[15]) 2024-02-20T07:38:15.179 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2024-02-20T07:38:15.180 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T07:38:15.180 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-02-20T07:38:15.206 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2024-02-20T07:38:15.206 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T07:38:15.206 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-02-20T07:38:15.321 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T07:38:15.347 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T07:38:15.369 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 9.stream 2024-02-20T07:38:15.395 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 9.stream 2024-02-20T07:38:15.632 INFO:teuthology.orchestra.console.smithi088:Power off 2024-02-20T07:38:15.633 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T07:38:15.647 INFO:teuthology.orchestra.console.smithi157:Power off 2024-02-20T07:38:15.647 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T07:38:15.656 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-02-20T07:38:15.657 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:38:15.670 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2024-02-20T07:38:15.670 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:38:15.679 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-02-20T07:38:15.693 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-02-20T07:38:15.781 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-02-20T07:38:15.881 INFO:teuthology.orchestra.console.smithi088:Power on 2024-02-20T07:38:15.882 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T07:38:15.903 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2024-02-20T07:38:15.904 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:38:15.927 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-02-20T07:38:19.698 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:38:19.811 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-02-20T07:38:19.928 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:38:20.037 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-02-20T07:38:20.138 INFO:teuthology.orchestra.console.smithi088:Power on completed 2024-02-20T07:38:20.239 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2024-02-20T07:38:23.816 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:38:23.926 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-02-20T07:38:24.027 INFO:teuthology.orchestra.console.smithi157:Power off completed 2024-02-20T07:38:24.127 INFO:teuthology.orchestra.console.smithi157:Power on 2024-02-20T07:38:24.127 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T07:38:24.150 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2024-02-20T07:38:24.150 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:38:24.172 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-02-20T07:38:28.176 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:38:28.286 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-02-20T07:38:32.288 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T07:38:32.396 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-02-20T07:38:32.497 INFO:teuthology.orchestra.console.smithi157:Power on completed 2024-02-20T07:38:32.597 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2024-02-20T07:41:21.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:41:24.284 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-20T07:41:30.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:41:33.344 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-20T07:41:33.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:41:36.636 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-20T07:41:39.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:41:42.428 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-20T07:41:42.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:41:45.696 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-20T07:41:48.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:41:51.488 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-20T07:41:51.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:41:54.780 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-20T07:41:57.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:42:00.572 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-20T07:42:00.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:42:03.836 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-20T07:42:06.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:42:09.628 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-20T07:42:09.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:42:12.892 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-20T07:42:15.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:42:18.684 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-20T07:42:18.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:42:21.948 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-20T07:42:24.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:42:27.740 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-20T07:42:27.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:42:31.005 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-20T07:42:33.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:42:37.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:42:40.060 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-20T07:42:46.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:43:33.795 WARNING:teuthology.provision.fog.smithi088:timed out 2024-02-20T07:43:39.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:43:40.060 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T07:43:40.061 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T07:43:40.395 INFO:teuthology.provision.fog.smithi088:Node is ready 2024-02-20T07:43:40.396 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2024-02-20T07:43:40.411 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2024-02-20T07:43:40.411 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2024-02-20T07:43:40.468 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2024-02-20T07:43:40.469 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-02-20T07:43:40.580 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2024-02-20T07:43:40.608 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2024-02-20T07:43:40.676 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2024-02-20T07:43:40.744 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-02-20T07:43:40.810 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-02-20T07:43:40.865 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-02-20T07:43:40.865 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-02-20T07:43:40.865 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-02-20T07:43:40.865 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:43:40.865 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-02-20T07:43:40.865 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:43:40.865 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:43:40.865 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-02-20T07:43:40.866 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:43:40.866 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:43:40.866 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:43:40.866 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:43:40.866 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:43:40.866 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:43:40.867 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2024-02-20T07:43:40.868 DEBUG:teuthology.parallel:result is None 2024-02-20T07:43:46.072 WARNING:teuthology.provision.fog.smithi157:timed out 2024-02-20T07:43:52.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:43:52.310 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T07:43:52.310 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T07:43:52.619 INFO:teuthology.provision.fog.smithi157:Node is ready 2024-02-20T07:43:52.619 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2024-02-20T07:43:52.634 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2024-02-20T07:43:52.634 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2024-02-20T07:43:52.693 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2024-02-20T07:43:52.693 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2024-02-20T07:43:52.815 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2024-02-20T07:43:52.842 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2024-02-20T07:43:52.913 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2024-02-20T07:43:52.984 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2024-02-20T07:43:53.054 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-02-20T07:43:53.115 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2024-02-20T07:43:53.115 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9" 2024-02-20T07:43:53.115 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2024-02-20T07:43:53.115 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:43:53.115 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9" 2024-02-20T07:43:53.116 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:43:53.116 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:43:53.116 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-02-20T07:43:53.116 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:43:53.116 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:43:53.116 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:43:53.116 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:43:53.116 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:43:53.116 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:43:53.116 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2024-02-20T07:43:53.117 DEBUG:teuthology.parallel:result is None 2024-02-20T07:43:53.283 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2024-02-20T07:43:53.283 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T07:43:53.308 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2024-02-20T07:43:53.308 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T07:43:53.324 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2024-02-20T07:43:53.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-02-20T07:43:53.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:43:53.413 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-02-20T07:43:53.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-02-20T07:43:53.578 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-02-20T07:43:53.634 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-02-20T07:43:53.634 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-02-20T07:43:53.688 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-02-20T07:43:53.688 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-02-20T07:43:53.689 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-02-20T07:43:53.689 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:43:53.689 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-02-20T07:43:53.689 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:43:53.689 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:43:53.689 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-02-20T07:43:53.689 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:43:53.689 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:43:53.689 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:43:53.689 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:43:53.689 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:43:53.689 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:43:53.690 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-02-20T07:43:53.715 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2024-02-20T07:43:53.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-20T07:43:53.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T07:43:53.848 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-02-20T07:43:53.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-20T07:43:53.914 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-02-20T07:43:53.972 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-02-20T07:43:53.972 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-02-20T07:43:54.030 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2024-02-20T07:43:54.031 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9" 2024-02-20T07:43:54.031 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2024-02-20T07:43:54.031 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2024-02-20T07:43:54.031 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9" 2024-02-20T07:43:54.031 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9" 2024-02-20T07:43:54.031 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T07:43:54.031 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-02-20T07:43:54.031 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon" 2024-02-20T07:43:54.031 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T07:43:54.031 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2024-02-20T07:43:54.031 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T07:43:54.031 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T07:43:54.032 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T07:43:54.032 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-02-20T07:43:54.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:43:54.155 INFO:teuthology.dispatcher.supervisor:Running job 7568556 2024-02-20T07:43:54.155 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568556 --name pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 0a 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568556/orig.config.yaml 2024-02-20T07:43:54.159 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-02-20_07:23:03-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240220.022152-distro-default-smithi/7568556 2024-02-20T07:43:54.159 INFO:teuthology.dispatcher.supervisor:Job PID: 2990838 2024-02-20T07:43:54.160 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-20T07:45:54.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:47:54.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:49:54.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:51:54.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:53:54.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:55:55.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:57:55.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T07:59:55.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:01:55.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:03:55.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:05:55.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:07:56.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:09:56.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:11:56.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:13:56.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:15:56.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:17:56.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:19:57.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:21:57.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:23:57.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:25:57.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:27:57.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:29:58.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:31:58.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:33:58.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:35:58.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:37:58.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:39:58.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:41:58.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:43:59.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:45:59.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:47:59.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:49:59.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:51:59.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:54:00.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:56:00.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T08:58:00.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:00:00.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:02:00.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:04:00.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:06:01.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:08:01.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:10:01.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:12:01.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:14:01.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:16:01.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:18:02.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:20:02.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:22:02.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:24:02.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:26:02.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:28:02.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T09:28:02.965 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1