2024-03-28T16:38:43.212 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-28T16:38:43.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:38:43.405 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ffa738b5f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ffa74816c10>, signals=[15])
2024-03-28T16:38:43.405 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging
2024-03-28T16:38:43.406 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server
2024-03-28T16:38:43.406 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2024-03-28T16:38:43.431 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging
2024-03-28T16:38:43.431 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server
2024-03-28T16:38:43.431 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2024-03-28T16:38:43.456 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging
2024-03-28T16:38:43.456 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server
2024-03-28T16:38:43.456 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2024-03-28T16:38:43.559 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_centos_9.stream (ID 10)
2024-03-28T16:38:43.576 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_centos_9.stream (ID 10)
2024-03-28T16:38:43.582 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_centos_9.stream (ID 10)
2024-03-28T16:38:43.612 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 9.stream
2024-03-28T16:38:43.623 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of centos 9.stream
2024-03-28T16:38:43.633 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of centos 9.stream
2024-03-28T16:38:43.875 INFO:teuthology.orchestra.console.smithi044:Power off
2024-03-28T16:38:43.876 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-28T16:38:43.894 INFO:teuthology.orchestra.console.smithi097:Power off
2024-03-28T16:38:43.894 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-28T16:38:43.908 INFO:teuthology.orchestra.console.smithi031:Power off
2024-03-28T16:38:43.909 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-28T16:38:43.919 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off
2024-03-28T16:38:43.919 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:43.928 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off
2024-03-28T16:38:43.929 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:43.938 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off
2024-03-28T16:38:43.939 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:43.948 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2024-03-28T16:38:43.953 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2024-03-28T16:38:43.964 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2024-03-28T16:38:47.950 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:47.959 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:47.967 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:48.061 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2024-03-28T16:38:48.068 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2024-03-28T16:38:48.075 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2024-03-28T16:38:52.066 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:52.073 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:52.080 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:52.176 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2024-03-28T16:38:52.182 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2024-03-28T16:38:52.187 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-03-28T16:38:52.277 INFO:teuthology.orchestra.console.smithi097:Power off completed
2024-03-28T16:38:52.288 INFO:teuthology.orchestra.console.smithi031:Power off completed
2024-03-28T16:38:52.378 INFO:teuthology.orchestra.console.smithi097:Power on
2024-03-28T16:38:52.378 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-28T16:38:52.389 INFO:teuthology.orchestra.console.smithi031:Power on
2024-03-28T16:38:52.389 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-28T16:38:52.399 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On
2024-03-28T16:38:52.399 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:52.413 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On
2024-03-28T16:38:52.414 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:52.421 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2024-03-28T16:38:52.434 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-03-28T16:38:56.186 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:56.295 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2024-03-28T16:38:56.396 INFO:teuthology.orchestra.console.smithi044:Power off completed
2024-03-28T16:38:56.422 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:56.435 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:56.497 INFO:teuthology.orchestra.console.smithi044:Power on
2024-03-28T16:38:56.498 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-28T16:38:56.519 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On
2024-03-28T16:38:56.520 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:38:56.530 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2024-03-28T16:38:56.542 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2024-03-28T16:38:56.544 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-03-28T16:39:00.534 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:39:00.542 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:39:00.549 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:39:00.651 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2024-03-28T16:39:00.658 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2024-03-28T16:39:00.759 INFO:teuthology.orchestra.console.smithi031:Power on completed
2024-03-28T16:39:00.778 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2024-03-28T16:39:00.860 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2024-03-28T16:39:00.879 INFO:teuthology.orchestra.console.smithi097:Power on completed
2024-03-28T16:39:00.979 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish
2024-03-28T16:39:04.655 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-28T16:39:04.767 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2024-03-28T16:39:04.867 INFO:teuthology.orchestra.console.smithi044:Power on completed
2024-03-28T16:39:04.968 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish
2024-03-28T16:41:16.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:41:16.785 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-28T16:41:31.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:41:34.686 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2024-03-28T16:41:35.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:41:38.750 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-03-28T16:41:40.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:41:43.743 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2024-03-28T16:41:44.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:41:47.806 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-03-28T16:41:49.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:41:52.798 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2024-03-28T16:41:53.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:41:56.862 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-03-28T16:41:58.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:42:01.854 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2024-03-28T16:42:02.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:42:05.918 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-03-28T16:42:07.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:42:10.910 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2024-03-28T16:42:11.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:42:14.974 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-03-28T16:42:16.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:42:19.970 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2024-03-28T16:42:20.788 WARNING:teuthology.provision.fog.smithi031:timed out
2024-03-28T16:42:20.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:42:24.030 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-03-28T16:42:25.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:42:26.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:42:29.854 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-03-28T16:42:30.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:42:35.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:42:38.910 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-03-28T16:42:44.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:42:46.303 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-28T16:42:46.304 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-28T16:43:06.697 INFO:teuthology.provision.fog.smithi031:Node is ready
2024-03-28T16:43:06.697 DEBUG:teuthology.orchestra.run.smithi031:> hostname
2024-03-28T16:43:06.717 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com
2024-03-28T16:43:06.717 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts
2024-03-28T16:43:06.775 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031
2024-03-28T16:43:06.775 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2024-03-28T16:43:06.897 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts
2024-03-28T16:43:06.931 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts
2024-03-28T16:43:07.004 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname
2024-03-28T16:43:07.077 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2024-03-28T16:43:07.149 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2024-03-28T16:43:07.204 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream"
2024-03-28T16:43:07.204 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9"
2024-03-28T16:43:07.204 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos"
2024-03-28T16:43:07.204 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora"
2024-03-28T16:43:07.204 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9"
2024-03-28T16:43:07.204 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9"
2024-03-28T16:43:07.205 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T16:43:07.205 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2024-03-28T16:43:07.205 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon"
2024-03-28T16:43:07.205 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T16:43:07.205 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/"
2024-03-28T16:43:07.205 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T16:43:07.205 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T16:43:07.205 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T16:43:07.206 INFO:teuthology.provision.fog.smithi031:Deploy complete!
2024-03-28T16:43:07.207 DEBUG:teuthology.parallel:result is None
2024-03-28T16:43:25.974 WARNING:teuthology.provision.fog.smithi097:timed out
2024-03-28T16:43:30.034 WARNING:teuthology.provision.fog.smithi044:timed out
2024-03-28T16:43:31.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:43:32.228 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-28T16:43:32.228 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-28T16:43:32.552 INFO:teuthology.provision.fog.smithi097:Node is ready
2024-03-28T16:43:32.552 DEBUG:teuthology.orchestra.run.smithi097:> hostname
2024-03-28T16:43:32.567 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com
2024-03-28T16:43:32.567 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts
2024-03-28T16:43:32.622 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097
2024-03-28T16:43:32.622 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2024-03-28T16:43:32.741 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts
2024-03-28T16:43:32.768 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts
2024-03-28T16:43:32.835 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname
2024-03-28T16:43:32.902 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2024-03-28T16:43:32.969 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2024-03-28T16:43:33.022 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream"
2024-03-28T16:43:33.022 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9"
2024-03-28T16:43:33.022 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos"
2024-03-28T16:43:33.022 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora"
2024-03-28T16:43:33.022 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9"
2024-03-28T16:43:33.023 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9"
2024-03-28T16:43:33.023 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T16:43:33.023 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2024-03-28T16:43:33.023 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon"
2024-03-28T16:43:33.023 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T16:43:33.023 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/"
2024-03-28T16:43:33.023 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T16:43:33.023 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T16:43:33.023 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T16:43:33.023 INFO:teuthology.provision.fog.smithi097:Deploy complete!
2024-03-28T16:43:33.024 DEBUG:teuthology.parallel:result is None
2024-03-28T16:43:36.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:43:36.262 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-28T16:43:36.262 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-28T16:43:36.591 INFO:teuthology.provision.fog.smithi044:Node is ready
2024-03-28T16:43:36.591 DEBUG:teuthology.orchestra.run.smithi044:> hostname
2024-03-28T16:43:36.606 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com
2024-03-28T16:43:36.606 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts
2024-03-28T16:43:36.664 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044
2024-03-28T16:43:36.665 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2024-03-28T16:43:36.783 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts
2024-03-28T16:43:36.815 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts
2024-03-28T16:43:36.887 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname
2024-03-28T16:43:36.957 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2024-03-28T16:43:37.028 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2024-03-28T16:43:37.082 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream"
2024-03-28T16:43:37.082 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9"
2024-03-28T16:43:37.083 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos"
2024-03-28T16:43:37.083 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora"
2024-03-28T16:43:37.083 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9"
2024-03-28T16:43:37.083 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9"
2024-03-28T16:43:37.083 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T16:43:37.083 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31"
2024-03-28T16:43:37.083 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon"
2024-03-28T16:43:37.083 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T16:43:37.083 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/"
2024-03-28T16:43:37.083 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T16:43:37.083 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T16:43:37.083 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T16:43:37.084 INFO:teuthology.provision.fog.smithi044:Deploy complete!
2024-03-28T16:43:37.084 DEBUG:teuthology.parallel:result is None
2024-03-28T16:43:37.340 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com
2024-03-28T16:43:37.341 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-28T16:43:37.364 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com
2024-03-28T16:43:37.365 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-28T16:43:37.381 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com
2024-03-28T16:43:37.381 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-28T16:43:37.407 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server
2024-03-28T16:43:37.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2024-03-28T16:43:37.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:43:37.515 DEBUG:teuthology.orchestra.run.smithi031:> true
2024-03-28T16:43:37.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com'
2024-03-28T16:43:37.702 DEBUG:teuthology.orchestra.run.smithi031:> uname -m
2024-03-28T16:43:37.756 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64
2024-03-28T16:43:37.757 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2024-03-28T16:43:37.812 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream"
2024-03-28T16:43:37.812 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9"
2024-03-28T16:43:37.812 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos"
2024-03-28T16:43:37.812 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora"
2024-03-28T16:43:37.812 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9"
2024-03-28T16:43:37.812 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9"
2024-03-28T16:43:37.812 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T16:43:37.812 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2024-03-28T16:43:37.813 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon"
2024-03-28T16:43:37.813 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T16:43:37.813 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/"
2024-03-28T16:43:37.813 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T16:43:37.813 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T16:43:37.813 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T16:43:37.813 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2024-03-28T16:43:37.849 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server
2024-03-28T16:43:37.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com'
2024-03-28T16:43:37.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:43:37.949 DEBUG:teuthology.orchestra.run.smithi044:> true
2024-03-28T16:43:38.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com'
2024-03-28T16:43:38.019 DEBUG:teuthology.orchestra.run.smithi044:> uname -m
2024-03-28T16:43:38.074 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64
2024-03-28T16:43:38.075 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2024-03-28T16:43:38.130 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream"
2024-03-28T16:43:38.131 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9"
2024-03-28T16:43:38.131 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos"
2024-03-28T16:43:38.131 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora"
2024-03-28T16:43:38.131 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9"
2024-03-28T16:43:38.131 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9"
2024-03-28T16:43:38.131 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T16:43:38.131 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31"
2024-03-28T16:43:38.131 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon"
2024-03-28T16:43:38.131 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T16:43:38.131 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/"
2024-03-28T16:43:38.131 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T16:43:38.131 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T16:43:38.132 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T16:43:38.132 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2024-03-28T16:43:38.156 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server
2024-03-28T16:43:38.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2024-03-28T16:43:38.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-28T16:43:38.246 DEBUG:teuthology.orchestra.run.smithi097:> true
2024-03-28T16:43:38.315 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com'
2024-03-28T16:43:38.315 DEBUG:teuthology.orchestra.run.smithi097:> uname -m
2024-03-28T16:43:38.374 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64
2024-03-28T16:43:38.375 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2024-03-28T16:43:38.434 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream"
2024-03-28T16:43:38.434 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9"
2024-03-28T16:43:38.434 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos"
2024-03-28T16:43:38.435 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora"
2024-03-28T16:43:38.435 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9"
2024-03-28T16:43:38.435 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9"
2024-03-28T16:43:38.435 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-28T16:43:38.435 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2024-03-28T16:43:38.435 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon"
2024-03-28T16:43:38.436 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-28T16:43:38.436 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/"
2024-03-28T16:43:38.436 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-28T16:43:38.436 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-28T16:43:38.436 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-28T16:43:38.437 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2024-03-28T16:43:38.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:43:38.563 INFO:teuthology.dispatcher.supervisor:Running job 7625347
2024-03-28T16:43:38.564 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625347 --name mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625347/orig.config.yaml
2024-03-28T16:43:38.567 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625347
2024-03-28T16:43:38.567 INFO:teuthology.dispatcher.supervisor:Job PID: 1285725
2024-03-28T16:43:38.567 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-28T16:45:38.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:47:38.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:49:38.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:51:38.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:53:38.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:55:38.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:57:38.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T16:59:39.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:01:39.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:03:39.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:05:39.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:07:39.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:09:39.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:11:39.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-28T17:11:39.583 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1