2024-03-07T19:53:47.627 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-07T19:53:47.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:53:47.812 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb7aa36af70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb7ab3cbc10>, signals=[15])
2024-03-07T19:53:47.813 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging
2024-03-07T19:53:47.813 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T19:53:47.813 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2024-03-07T19:53:47.842 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging
2024-03-07T19:53:47.842 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T19:53:47.843 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2024-03-07T19:53:47.866 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging
2024-03-07T19:53:47.867 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server
2024-03-07T19:53:47.867 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2024-03-07T19:53:47.970 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_9.stream (ID 10)
2024-03-07T19:53:47.995 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_9.stream (ID 10)
2024-03-07T19:53:47.998 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_9.stream (ID 10)
2024-03-07T19:53:48.016 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 9.stream
2024-03-07T19:53:48.039 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 9.stream
2024-03-07T19:53:48.043 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 9.stream
2024-03-07T19:53:48.307 INFO:teuthology.orchestra.console.smithi040:Power off
2024-03-07T19:53:48.307 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T19:53:48.322 INFO:teuthology.orchestra.console.smithi088:Power off
2024-03-07T19:53:48.322 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T19:53:48.332 INFO:teuthology.orchestra.console.smithi098:Power off
2024-03-07T19:53:48.333 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-07T19:53:48.341 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off
2024-03-07T19:53:48.341 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:53:48.349 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2024-03-07T19:53:48.350 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:53:48.358 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off
2024-03-07T19:53:48.358 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:53:48.366 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2024-03-07T19:53:48.371 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-03-07T19:53:48.380 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2024-03-07T19:53:52.370 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:53:52.378 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:53:52.384 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:53:52.480 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2024-03-07T19:53:52.486 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-03-07T19:53:52.493 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2024-03-07T19:53:56.482 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:53:56.489 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:53:56.495 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:53:56.591 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2024-03-07T19:53:56.597 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-03-07T19:53:56.604 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2024-03-07T19:53:56.692 INFO:teuthology.orchestra.console.smithi040:Power off completed
2024-03-07T19:53:56.704 INFO:teuthology.orchestra.console.smithi098:Power off completed
2024-03-07T19:53:56.793 INFO:teuthology.orchestra.console.smithi040:Power on
2024-03-07T19:53:56.793 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T19:53:56.805 INFO:teuthology.orchestra.console.smithi098:Power on
2024-03-07T19:53:56.806 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T19:53:56.815 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On
2024-03-07T19:53:56.816 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:53:56.827 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On
2024-03-07T19:53:56.827 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:53:56.837 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2024-03-07T19:53:56.849 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2024-03-07T19:54:00.599 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:54:00.707 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-03-07T19:54:00.808 INFO:teuthology.orchestra.console.smithi088:Power off completed
2024-03-07T19:54:00.838 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:54:00.849 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:54:00.909 INFO:teuthology.orchestra.console.smithi088:Power on
2024-03-07T19:54:00.910 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-07T19:54:00.930 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On
2024-03-07T19:54:00.930 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:54:00.948 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2024-03-07T19:54:00.952 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-03-07T19:54:00.957 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2024-03-07T19:54:04.953 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:54:04.960 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:54:04.966 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:54:05.061 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2024-03-07T19:54:05.068 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-03-07T19:54:05.137 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2024-03-07T19:54:05.162 INFO:teuthology.orchestra.console.smithi040:Power on completed
2024-03-07T19:54:05.238 INFO:teuthology.orchestra.console.smithi098:Power on completed
2024-03-07T19:54:05.263 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish
2024-03-07T19:54:05.339 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish
2024-03-07T19:54:09.070 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-07T19:54:09.180 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-03-07T19:54:09.281 INFO:teuthology.orchestra.console.smithi088:Power on completed
2024-03-07T19:54:09.382 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish
2024-03-07T19:56:36.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:56:51.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:56:54.689 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-03-07T19:56:55.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:57:00.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:57:03.774 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-03-07T19:57:09.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:57:09.790 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-07T19:57:12.830 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2024-03-07T19:57:13.630 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-03-07T19:57:15.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:57:18.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:57:18.846 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-07T19:57:19.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:57:22.686 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-03-07T19:57:24.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:57:27.902 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-07T19:57:28.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:57:31.742 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-03-07T19:57:33.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:57:36.958 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-07T19:57:37.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:57:40.805 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-03-07T19:57:42.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:57:46.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:57:49.886 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-03-07T19:57:55.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:57:58.946 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-03-07T19:58:01.507 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-07T19:58:04.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:58:07.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:58:10.590 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-07T19:58:16.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:58:18.838 WARNING:teuthology.provision.fog.smithi040:timed out
2024-03-07T19:58:19.650 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2024-03-07T19:58:24.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:58:25.076 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T19:58:25.077 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T19:58:25.446 INFO:teuthology.provision.fog.smithi040:Node is ready
2024-03-07T19:58:25.446 DEBUG:teuthology.orchestra.run.smithi040:> hostname
2024-03-07T19:58:25.461 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com
2024-03-07T19:58:25.461 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts
2024-03-07T19:58:25.517 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040
2024-03-07T19:58:25.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2024-03-07T19:58:25.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts
2024-03-07T19:58:25.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:58:25.678 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts
2024-03-07T19:58:25.777 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname
2024-03-07T19:58:25.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2024-03-07T19:58:25.918 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2024-03-07T19:58:25.937 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T19:58:25.937 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T19:58:25.973 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream"
2024-03-07T19:58:25.973 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9"
2024-03-07T19:58:25.973 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos"
2024-03-07T19:58:25.974 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora"
2024-03-07T19:58:25.974 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9"
2024-03-07T19:58:25.974 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9"
2024-03-07T19:58:25.974 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T19:58:25.974 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31"
2024-03-07T19:58:25.974 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon"
2024-03-07T19:58:25.974 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T19:58:25.974 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/"
2024-03-07T19:58:25.974 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T19:58:25.974 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T19:58:25.974 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T19:58:25.975 INFO:teuthology.provision.fog.smithi040:Deploy complete!
2024-03-07T19:58:25.977 DEBUG:teuthology.parallel:result is None
2024-03-07T19:58:41.353 INFO:teuthology.provision.fog.smithi098:Node is ready
2024-03-07T19:58:41.354 DEBUG:teuthology.orchestra.run.smithi098:> hostname
2024-03-07T19:58:41.412 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com
2024-03-07T19:58:41.413 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts
2024-03-07T19:58:41.470 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098
2024-03-07T19:58:41.470 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2024-03-07T19:58:41.589 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts
2024-03-07T19:58:41.619 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts
2024-03-07T19:58:41.689 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname
2024-03-07T19:58:41.758 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2024-03-07T19:58:41.826 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2024-03-07T19:58:41.881 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2024-03-07T19:58:41.882 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9"
2024-03-07T19:58:41.882 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2024-03-07T19:58:41.882 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2024-03-07T19:58:41.882 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9"
2024-03-07T19:58:41.882 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9"
2024-03-07T19:58:41.882 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T19:58:41.882 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2024-03-07T19:58:41.882 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon"
2024-03-07T19:58:41.882 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T19:58:41.882 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2024-03-07T19:58:41.882 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T19:58:41.883 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T19:58:41.883 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T19:58:41.883 INFO:teuthology.provision.fog.smithi098:Deploy complete!
2024-03-07T19:58:41.883 DEBUG:teuthology.parallel:result is None
2024-03-07T19:59:04.975 WARNING:teuthology.provision.fog.smithi088:timed out
2024-03-07T19:59:10.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:59:11.255 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-07T19:59:11.255 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-07T19:59:11.590 INFO:teuthology.provision.fog.smithi088:Node is ready
2024-03-07T19:59:11.590 DEBUG:teuthology.orchestra.run.smithi088:> hostname
2024-03-07T19:59:11.605 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com
2024-03-07T19:59:11.605 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts
2024-03-07T19:59:11.660 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088
2024-03-07T19:59:11.660 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2024-03-07T19:59:11.767 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts
2024-03-07T19:59:11.795 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts
2024-03-07T19:59:11.864 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname
2024-03-07T19:59:11.931 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2024-03-07T19:59:11.998 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2024-03-07T19:59:12.052 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream"
2024-03-07T19:59:12.052 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9"
2024-03-07T19:59:12.052 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos"
2024-03-07T19:59:12.053 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora"
2024-03-07T19:59:12.053 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9"
2024-03-07T19:59:12.053 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9"
2024-03-07T19:59:12.053 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T19:59:12.053 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2024-03-07T19:59:12.053 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon"
2024-03-07T19:59:12.053 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T19:59:12.053 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/"
2024-03-07T19:59:12.053 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T19:59:12.053 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T19:59:12.054 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T19:59:12.054 INFO:teuthology.provision.fog.smithi088:Deploy complete!
2024-03-07T19:59:12.055 DEBUG:teuthology.parallel:result is None
2024-03-07T19:59:12.272 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com
2024-03-07T19:59:12.272 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T19:59:12.296 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com
2024-03-07T19:59:12.296 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T19:59:12.321 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com
2024-03-07T19:59:12.321 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-07T19:59:12.339 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server
2024-03-07T19:59:12.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2024-03-07T19:59:12.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:59:12.450 DEBUG:teuthology.orchestra.run.smithi040:> true
2024-03-07T19:59:12.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com'
2024-03-07T19:59:12.633 DEBUG:teuthology.orchestra.run.smithi040:> uname -m
2024-03-07T19:59:12.688 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64
2024-03-07T19:59:12.689 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2024-03-07T19:59:12.743 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream"
2024-03-07T19:59:12.743 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9"
2024-03-07T19:59:12.743 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos"
2024-03-07T19:59:12.743 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora"
2024-03-07T19:59:12.743 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9"
2024-03-07T19:59:12.743 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9"
2024-03-07T19:59:12.744 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T19:59:12.744 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31"
2024-03-07T19:59:12.744 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon"
2024-03-07T19:59:12.744 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T19:59:12.744 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/"
2024-03-07T19:59:12.744 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T19:59:12.744 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T19:59:12.744 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T19:59:12.745 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2024-03-07T19:59:12.772 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server
2024-03-07T19:59:12.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com'
2024-03-07T19:59:12.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:59:12.864 DEBUG:teuthology.orchestra.run.smithi088:> true
2024-03-07T19:59:12.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com'
2024-03-07T19:59:12.933 DEBUG:teuthology.orchestra.run.smithi088:> uname -m
2024-03-07T19:59:12.987 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64
2024-03-07T19:59:12.988 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2024-03-07T19:59:13.042 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream"
2024-03-07T19:59:13.042 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9"
2024-03-07T19:59:13.042 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos"
2024-03-07T19:59:13.042 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora"
2024-03-07T19:59:13.042 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9"
2024-03-07T19:59:13.042 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9"
2024-03-07T19:59:13.042 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T19:59:13.042 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2024-03-07T19:59:13.042 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon"
2024-03-07T19:59:13.043 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T19:59:13.043 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/"
2024-03-07T19:59:13.043 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T19:59:13.043 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T19:59:13.043 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T19:59:13.043 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2024-03-07T19:59:13.063 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server
2024-03-07T19:59:13.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2024-03-07T19:59:13.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-07T19:59:13.153 DEBUG:teuthology.orchestra.run.smithi098:> true
2024-03-07T19:59:13.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com'
2024-03-07T19:59:13.325 DEBUG:teuthology.orchestra.run.smithi098:> uname -m
2024-03-07T19:59:13.379 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64
2024-03-07T19:59:13.380 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2024-03-07T19:59:13.434 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2024-03-07T19:59:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9"
2024-03-07T19:59:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2024-03-07T19:59:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2024-03-07T19:59:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9"
2024-03-07T19:59:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9"
2024-03-07T19:59:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-07T19:59:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2024-03-07T19:59:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon"
2024-03-07T19:59:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-07T19:59:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2024-03-07T19:59:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-07T19:59:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-07T19:59:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-07T19:59:13.436 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2024-03-07T19:59:13.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T19:59:13.558 INFO:teuthology.dispatcher.supervisor:Running job 7584555
2024-03-07T19:59:13.558 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7584555 --name vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/pjd}} -- /home/teuthworker/archive/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7584555/orig.config.yaml
2024-03-07T19:59:13.561 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-03-07_10:41:12-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7584555
2024-03-07T19:59:13.561 INFO:teuthology.dispatcher.supervisor:Job PID: 951507
2024-03-07T19:59:13.561 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-07T20:01:13.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:03:13.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:05:14.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:07:14.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:09:14.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:11:14.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:13:14.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:15:14.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:17:15.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:19:15.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:21:15.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:23:15.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:25:15.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:27:15.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:29:16.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:31:16.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:33:16.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:35:16.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:37:16.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:39:16.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:41:17.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-07T20:41:17.128 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1