2024-02-16T13:03:13.838 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-16T13:03:13.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-16T13:03:14.009 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fbf3fd91f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fbf40df2c10>, signals=[15])
2024-02-16T13:03:14.010 INFO:teuthology.lock.ops:Start node 'smithi001.front.sepia.ceph.com' reimaging
2024-02-16T13:03:14.010 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: reset os type and version on server
2024-02-16T13:03:14.010 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2024-02-16T13:03:14.031 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging
2024-02-16T13:03:14.031 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server
2024-02-16T13:03:14.031 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2024-02-16T13:03:14.056 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging
2024-02-16T13:03:14.056 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server
2024-02-16T13:03:14.056 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-02-16T13:03:14.149 DEBUG:teuthology.provision.fog.smithi001:Requesting image smithi_centos_9.stream (ID 10)
2024-02-16T13:03:14.188 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_centos_9.stream (ID 10)
2024-02-16T13:03:14.192 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of centos 9.stream
2024-02-16T13:03:14.195 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_9.stream (ID 10)
2024-02-16T13:03:14.235 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 9.stream
2024-02-16T13:03:14.241 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 9.stream
2024-02-16T13:03:14.394 INFO:teuthology.orchestra.console.smithi001:Power off
2024-02-16T13:03:14.395 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-16T13:03:14.421 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off
2024-02-16T13:03:14.422 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:14.443 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2024-02-16T13:03:14.449 INFO:teuthology.orchestra.console.smithi134:Power off
2024-02-16T13:03:14.450 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-16T13:03:14.462 INFO:teuthology.orchestra.console.smithi163:Power off
2024-02-16T13:03:14.463 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-16T13:03:14.471 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off
2024-02-16T13:03:14.472 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:14.486 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off
2024-02-16T13:03:14.487 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:14.495 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2024-02-16T13:03:14.509 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-16T13:03:18.448 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:18.496 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:18.509 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:18.558 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2024-02-16T13:03:18.605 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2024-02-16T13:03:18.618 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-16T13:03:22.561 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:22.606 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:22.618 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:22.671 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2024-02-16T13:03:22.718 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2024-02-16T13:03:22.727 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-16T13:03:22.772 INFO:teuthology.orchestra.console.smithi001:Power off completed
2024-02-16T13:03:22.819 INFO:teuthology.orchestra.console.smithi134:Power off completed
2024-02-16T13:03:22.873 INFO:teuthology.orchestra.console.smithi001:Power on
2024-02-16T13:03:22.874 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-16T13:03:22.898 DEBUG:teuthology.orchestra.console.smithi001:power on output: Chassis Power Control: Up/On
2024-02-16T13:03:22.898 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:22.920 INFO:teuthology.orchestra.console.smithi134:Power on
2024-02-16T13:03:22.920 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-16T13:03:22.929 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2024-02-16T13:03:22.940 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On
2024-02-16T13:03:22.941 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:22.961 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2024-02-16T13:03:26.728 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:26.837 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-16T13:03:26.930 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:26.938 INFO:teuthology.orchestra.console.smithi163:Power off completed
2024-02-16T13:03:26.963 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:27.039 INFO:teuthology.orchestra.console.smithi163:Power on
2024-02-16T13:03:27.039 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-16T13:03:27.048 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2024-02-16T13:03:27.061 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On
2024-02-16T13:03:27.061 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:27.072 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2024-02-16T13:03:27.083 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-16T13:03:31.052 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:31.073 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:31.084 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:31.163 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2024-02-16T13:03:31.182 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2024-02-16T13:03:31.193 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-02-16T13:03:31.264 INFO:teuthology.orchestra.console.smithi001:Power on completed
2024-02-16T13:03:31.283 INFO:teuthology.orchestra.console.smithi134:Power on completed
2024-02-16T13:03:31.365 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish
2024-02-16T13:03:31.383 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish
2024-02-16T13:03:35.196 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-16T13:03:35.521 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-02-16T13:03:35.621 INFO:teuthology.orchestra.console.smithi163:Power on completed
2024-02-16T13:03:35.722 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2024-02-16T13:06:02.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:02.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:05.344 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-02-16T13:06:05.345 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-02-16T13:06:11.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:11.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:14.432 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-02-16T13:06:14.433 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-02-16T13:06:20.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:20.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:23.516 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-02-16T13:06:23.516 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-02-16T13:06:29.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:29.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:32.576 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-02-16T13:06:32.577 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-02-16T13:06:36.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:38.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:38.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:39.740 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-16T13:06:41.660 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2024-02-16T13:06:41.660 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-02-16T13:06:45.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:47.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:47.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:48.800 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-16T13:06:50.716 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-02-16T13:06:54.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:56.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:06:57.884 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-16T13:06:59.772 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-02-16T13:07:03.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:07:05.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:07:06.940 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-16T13:07:12.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:07:15.996 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-16T13:07:22.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:07:25.052 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-16T13:07:31.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:07:34.108 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-16T13:07:40.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:07:43.164 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-02-16T13:07:47.669 WARNING:teuthology.provision.fog.smithi001:timed out
2024-02-16T13:07:49.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:07:53.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:07:53.909 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-16T13:07:53.910 DEBUG:teuthology.orchestra.run.smithi001:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-16T13:07:54.264 INFO:teuthology.provision.fog.smithi001:Node is ready
2024-02-16T13:07:54.264 DEBUG:teuthology.orchestra.run.smithi001:> hostname
2024-02-16T13:07:54.280 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001.front.sepia.ceph.com
2024-02-16T13:07:54.280 DEBUG:teuthology.orchestra.run.smithi001:> grep smithi001.front.sepia.ceph.com /etc/hosts
2024-02-16T13:07:54.336 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001.front.sepia.ceph.com smithi001
2024-02-16T13:07:54.337 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001
2024-02-16T13:07:54.477 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hosts
2024-02-16T13:07:54.509 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/172.21.15.1/172.21.15.1/g' /etc/hosts
2024-02-16T13:07:54.581 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hostname
2024-02-16T13:07:54.652 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001
2024-02-16T13:07:54.723 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release
2024-02-16T13:07:54.778 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream"
2024-02-16T13:07:54.778 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9"
2024-02-16T13:07:54.778 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos"
2024-02-16T13:07:54.778 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora"
2024-02-16T13:07:54.778 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9"
2024-02-16T13:07:54.778 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9"
2024-02-16T13:07:54.778 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-16T13:07:54.778 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31"
2024-02-16T13:07:54.778 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon"
2024-02-16T13:07:54.778 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-16T13:07:54.778 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/"
2024-02-16T13:07:54.779 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-16T13:07:54.779 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-16T13:07:54.779 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-16T13:07:54.779 INFO:teuthology.provision.fog.smithi001:Deploy complete!
2024-02-16T13:07:54.784 DEBUG:teuthology.parallel:result is None
2024-02-16T13:08:05.788 WARNING:teuthology.provision.fog.smithi134:timed out
2024-02-16T13:08:11.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:08:12.041 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-16T13:08:12.042 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-16T13:08:12.399 INFO:teuthology.provision.fog.smithi134:Node is ready
2024-02-16T13:08:12.399 DEBUG:teuthology.orchestra.run.smithi134:> hostname
2024-02-16T13:08:12.415 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com
2024-02-16T13:08:12.416 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts
2024-02-16T13:08:12.472 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134
2024-02-16T13:08:12.473 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2024-02-16T13:08:12.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts
2024-02-16T13:08:12.612 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts
2024-02-16T13:08:12.681 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname
2024-02-16T13:08:12.749 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2024-02-16T13:08:12.816 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2024-02-16T13:08:12.871 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream"
2024-02-16T13:08:12.871 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9"
2024-02-16T13:08:12.871 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos"
2024-02-16T13:08:12.871 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora"
2024-02-16T13:08:12.871 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9"
2024-02-16T13:08:12.871 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9"
2024-02-16T13:08:12.871 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-16T13:08:12.871 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2024-02-16T13:08:12.871 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon"
2024-02-16T13:08:12.871 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-16T13:08:12.872 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/"
2024-02-16T13:08:12.872 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-16T13:08:12.872 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-16T13:08:12.872 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-16T13:08:12.872 INFO:teuthology.provision.fog.smithi134:Deploy complete!
2024-02-16T13:08:12.873 DEBUG:teuthology.parallel:result is None
2024-02-16T13:08:49.206 WARNING:teuthology.provision.fog.smithi163:timed out
2024-02-16T13:08:55.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:08:55.528 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-16T13:08:55.528 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-16T13:08:55.848 INFO:teuthology.provision.fog.smithi163:Node is ready
2024-02-16T13:08:55.848 DEBUG:teuthology.orchestra.run.smithi163:> hostname
2024-02-16T13:08:55.863 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2024-02-16T13:08:55.863 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts
2024-02-16T13:08:55.919 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2024-02-16T13:08:55.920 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-02-16T13:08:56.022 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts
2024-02-16T13:08:56.052 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts
2024-02-16T13:08:56.120 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname
2024-02-16T13:08:56.188 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-02-16T13:08:56.255 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-02-16T13:08:56.309 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2024-02-16T13:08:56.309 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9"
2024-02-16T13:08:56.309 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2024-02-16T13:08:56.310 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2024-02-16T13:08:56.310 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9"
2024-02-16T13:08:56.310 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9"
2024-02-16T13:08:56.310 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-16T13:08:56.310 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2024-02-16T13:08:56.310 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon"
2024-02-16T13:08:56.310 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-16T13:08:56.310 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2024-02-16T13:08:56.311 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-16T13:08:56.311 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-16T13:08:56.311 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-16T13:08:56.311 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2024-02-16T13:08:56.312 DEBUG:teuthology.parallel:result is None
2024-02-16T13:08:56.532 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com
2024-02-16T13:08:56.532 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-16T13:08:56.566 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com
2024-02-16T13:08:56.566 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-16T13:08:56.590 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com
2024-02-16T13:08:56.590 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-16T13:08:56.608 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server
2024-02-16T13:08:56.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com'
2024-02-16T13:08:56.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:08:56.710 DEBUG:teuthology.orchestra.run.smithi001:> true
2024-02-16T13:08:56.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com'
2024-02-16T13:08:56.895 DEBUG:teuthology.orchestra.run.smithi001:> uname -m
2024-02-16T13:08:56.949 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64
2024-02-16T13:08:56.950 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release
2024-02-16T13:08:57.004 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream"
2024-02-16T13:08:57.005 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9"
2024-02-16T13:08:57.005 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos"
2024-02-16T13:08:57.005 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora"
2024-02-16T13:08:57.005 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9"
2024-02-16T13:08:57.005 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9"
2024-02-16T13:08:57.005 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-16T13:08:57.005 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31"
2024-02-16T13:08:57.005 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon"
2024-02-16T13:08:57.005 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-16T13:08:57.005 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/"
2024-02-16T13:08:57.005 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-16T13:08:57.005 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-16T13:08:57.005 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-16T13:08:57.006 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2024-02-16T13:08:57.024 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server
2024-02-16T13:08:57.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2024-02-16T13:08:57.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:08:57.116 DEBUG:teuthology.orchestra.run.smithi134:> true
2024-02-16T13:08:57.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com'
2024-02-16T13:08:57.286 DEBUG:teuthology.orchestra.run.smithi134:> uname -m
2024-02-16T13:08:57.342 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64
2024-02-16T13:08:57.342 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2024-02-16T13:08:57.396 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream"
2024-02-16T13:08:57.396 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9"
2024-02-16T13:08:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos"
2024-02-16T13:08:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora"
2024-02-16T13:08:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9"
2024-02-16T13:08:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9"
2024-02-16T13:08:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-16T13:08:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2024-02-16T13:08:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon"
2024-02-16T13:08:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-16T13:08:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/"
2024-02-16T13:08:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-16T13:08:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-16T13:08:57.397 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-16T13:08:57.398 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2024-02-16T13:08:57.425 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server
2024-02-16T13:08:57.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-02-16T13:08:57.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-16T13:08:57.528 DEBUG:teuthology.orchestra.run.smithi163:> true
2024-02-16T13:08:57.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-02-16T13:08:57.597 DEBUG:teuthology.orchestra.run.smithi163:> uname -m
2024-02-16T13:08:57.654 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64
2024-02-16T13:08:57.654 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-02-16T13:08:57.712 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2024-02-16T13:08:57.712 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9"
2024-02-16T13:08:57.712 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2024-02-16T13:08:57.712 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2024-02-16T13:08:57.712 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9"
2024-02-16T13:08:57.712 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9"
2024-02-16T13:08:57.712 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-16T13:08:57.712 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2024-02-16T13:08:57.712 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon"
2024-02-16T13:08:57.712 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-16T13:08:57.712 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2024-02-16T13:08:57.713 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-16T13:08:57.713 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-16T13:08:57.713 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-16T13:08:57.713 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-02-16T13:08:57.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-16T13:08:57.819 INFO:teuthology.dispatcher.supervisor:Running job 7562320
2024-02-16T13:08:57.819 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-16_12:40:36-fs:workload-wip-vshankar-testing-20240216.103400-testing-default-smithi/7562320 --name vshankar-2024-02-16_12:40:36-fs:workload-wip-vshankar-testing-20240216.103400-testing-default-smithi --description fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} -- /home/teuthworker/archive/vshankar-2024-02-16_12:40:36-fs:workload-wip-vshankar-testing-20240216.103400-testing-default-smithi/7562320/orig.config.yaml
2024-02-16T13:08:57.822 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-16_12:40:36-fs:workload-wip-vshankar-testing-20240216.103400-testing-default-smithi/7562320
2024-02-16T13:08:57.823 INFO:teuthology.dispatcher.supervisor:Job PID: 4142897
2024-02-16T13:08:57.823 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-16T13:10:57.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-16T13:12:58.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-16T13:14:58.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-16T13:16:58.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-16T13:18:58.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-16T13:20:58.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-16T13:22:58.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-16T13:22:59.011 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1