2024-03-24T17:48:59.243 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-24T17:48:59.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T17:48:59.421 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f34c719ef70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f34c81ffc10>, signals=[15])
2024-03-24T17:48:59.422 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2024-03-24T17:48:59.422 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T17:48:59.422 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-03-24T17:48:59.443 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging
2024-03-24T17:48:59.443 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T17:48:59.443 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server
2024-03-24T17:48:59.460 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging
2024-03-24T17:48:59.460 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T17:48:59.460 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2024-03-24T17:48:59.572 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10)
2024-03-24T17:48:59.580 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_9.stream (ID 10)
2024-03-24T17:48:59.597 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_9.stream (ID 10)
2024-03-24T17:48:59.620 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream
2024-03-24T17:48:59.623 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 9.stream
2024-03-24T17:48:59.643 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 9.stream
2024-03-24T17:48:59.891 INFO:teuthology.orchestra.console.smithi119:Power off
2024-03-24T17:48:59.892 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T17:48:59.904 INFO:teuthology.orchestra.console.smithi173:Power off
2024-03-24T17:48:59.905 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T17:48:59.915 INFO:teuthology.orchestra.console.smithi188:Power off
2024-03-24T17:48:59.915 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T17:48:59.923 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2024-03-24T17:48:59.924 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:48:59.930 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off
2024-03-24T17:48:59.930 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:48:59.938 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off
2024-03-24T17:48:59.938 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:48:59.947 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-03-24T17:48:59.950 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on
2024-03-24T17:48:59.958 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on
2024-03-24T17:49:03.950 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:03.957 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:03.964 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:04.061 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-03-24T17:49:04.066 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on
2024-03-24T17:49:04.073 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on
2024-03-24T17:49:08.066 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:08.073 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:08.080 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:08.175 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-03-24T17:49:08.181 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off
2024-03-24T17:49:08.188 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on
2024-03-24T17:49:08.277 INFO:teuthology.orchestra.console.smithi119:Power off completed
2024-03-24T17:49:08.282 INFO:teuthology.orchestra.console.smithi173:Power off completed
2024-03-24T17:49:08.377 INFO:teuthology.orchestra.console.smithi119:Power on
2024-03-24T17:49:08.378 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T17:49:08.385 INFO:teuthology.orchestra.console.smithi173:Power on
2024-03-24T17:49:08.385 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T17:49:08.401 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On
2024-03-24T17:49:08.401 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:08.410 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On
2024-03-24T17:49:08.410 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:08.422 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-03-24T17:49:08.429 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off
2024-03-24T17:49:12.190 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:12.301 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off
2024-03-24T17:49:12.402 INFO:teuthology.orchestra.console.smithi188:Power off completed
2024-03-24T17:49:12.422 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:12.430 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:12.503 INFO:teuthology.orchestra.console.smithi188:Power on
2024-03-24T17:49:12.504 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T17:49:12.525 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On
2024-03-24T17:49:12.526 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:12.535 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-03-24T17:49:12.540 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off
2024-03-24T17:49:12.548 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off
2024-03-24T17:49:16.540 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:16.547 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:16.553 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:16.649 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-03-24T17:49:16.655 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on
2024-03-24T17:49:16.660 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off
2024-03-24T17:49:16.750 INFO:teuthology.orchestra.console.smithi119:Power on completed
2024-03-24T17:49:16.756 INFO:teuthology.orchestra.console.smithi173:Power on completed
2024-03-24T17:49:16.851 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2024-03-24T17:49:16.856 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish
2024-03-24T17:49:20.665 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T17:49:20.774 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on
2024-03-24T17:49:20.874 INFO:teuthology.orchestra.console.smithi188:Power on completed
2024-03-24T17:49:20.975 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish
2024-03-24T17:51:47.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:51:47.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:51:50.686 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-24T17:51:50.687 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2024-03-24T17:51:51.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:51:54.782 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-03-24T17:51:56.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:51:56.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:51:59.746 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2024-03-24T17:51:59.747 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-24T17:52:00.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:03.838 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-03-24T17:52:05.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:05.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:08.830 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2024-03-24T17:52:08.830 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-24T17:52:09.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:12.894 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-03-24T17:52:14.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:14.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:17.886 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2024-03-24T17:52:17.887 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-24T17:52:18.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:21.954 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-03-24T17:52:23.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:23.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:26.942 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-24T17:52:26.943 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2024-03-24T17:52:27.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:31.006 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-03-24T17:52:32.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:32.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:36.001 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-24T17:52:36.001 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2024-03-24T17:52:37.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:40.067 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-03-24T17:52:42.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:42.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:45.090 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-24T17:52:46.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:49.150 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2024-03-24T17:52:51.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:52:55.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:53:42.055 WARNING:teuthology.provision.fog.smithi173:timed out
2024-03-24T17:53:48.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:53:48.367 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T17:53:48.368 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T17:53:48.690 INFO:teuthology.provision.fog.smithi173:Node is ready
2024-03-24T17:53:48.690 DEBUG:teuthology.orchestra.run.smithi173:> hostname
2024-03-24T17:53:48.705 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com
2024-03-24T17:53:48.705 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts
2024-03-24T17:53:48.761 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173
2024-03-24T17:53:48.761 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173
2024-03-24T17:53:48.883 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts
2024-03-24T17:53:48.912 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts
2024-03-24T17:53:48.980 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname
2024-03-24T17:53:49.047 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173
2024-03-24T17:53:49.114 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release
2024-03-24T17:53:49.169 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream"
2024-03-24T17:53:49.169 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9"
2024-03-24T17:53:49.169 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos"
2024-03-24T17:53:49.169 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora"
2024-03-24T17:53:49.169 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9"
2024-03-24T17:53:49.169 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9"
2024-03-24T17:53:49.169 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T17:53:49.169 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31"
2024-03-24T17:53:49.169 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon"
2024-03-24T17:53:49.169 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T17:53:49.169 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/"
2024-03-24T17:53:49.170 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T17:53:49.170 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T17:53:49.170 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T17:53:49.170 INFO:teuthology.provision.fog.smithi173:Deploy complete!
2024-03-24T17:53:49.172 DEBUG:teuthology.parallel:result is None
2024-03-24T17:53:51.098 WARNING:teuthology.provision.fog.smithi119:timed out
2024-03-24T17:53:55.163 WARNING:teuthology.provision.fog.smithi188:timed out
2024-03-24T17:53:57.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:53:57.434 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T17:53:57.435 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T17:53:57.767 INFO:teuthology.provision.fog.smithi119:Node is ready
2024-03-24T17:53:57.767 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2024-03-24T17:53:57.781 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com
2024-03-24T17:53:57.781 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts
2024-03-24T17:53:57.836 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2024-03-24T17:53:57.836 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-03-24T17:53:57.952 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts
2024-03-24T17:53:57.979 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2024-03-24T17:53:58.050 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname
2024-03-24T17:53:58.114 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-03-24T17:53:58.180 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-03-24T17:53:58.234 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream"
2024-03-24T17:53:58.234 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9"
2024-03-24T17:53:58.234 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos"
2024-03-24T17:53:58.235 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora"
2024-03-24T17:53:58.235 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9"
2024-03-24T17:53:58.235 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9"
2024-03-24T17:53:58.235 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T17:53:58.235 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-03-24T17:53:58.235 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon"
2024-03-24T17:53:58.235 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T17:53:58.235 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/"
2024-03-24T17:53:58.235 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T17:53:58.235 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T17:53:58.235 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T17:53:58.236 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2024-03-24T17:53:58.236 DEBUG:teuthology.parallel:result is None
2024-03-24T17:54:01.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:54:01.399 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T17:54:01.400 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T17:54:01.730 INFO:teuthology.provision.fog.smithi188:Node is ready
2024-03-24T17:54:01.730 DEBUG:teuthology.orchestra.run.smithi188:> hostname
2024-03-24T17:54:01.745 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com
2024-03-24T17:54:01.745 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts
2024-03-24T17:54:01.799 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188
2024-03-24T17:54:01.800 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188
2024-03-24T17:54:01.924 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts
2024-03-24T17:54:01.952 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts
2024-03-24T17:54:02.020 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname
2024-03-24T17:54:02.086 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188
2024-03-24T17:54:02.153 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release
2024-03-24T17:54:02.207 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2024-03-24T17:54:02.207 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9"
2024-03-24T17:54:02.207 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2024-03-24T17:54:02.207 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2024-03-24T17:54:02.207 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9"
2024-03-24T17:54:02.207 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9"
2024-03-24T17:54:02.208 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T17:54:02.208 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2024-03-24T17:54:02.208 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon"
2024-03-24T17:54:02.208 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T17:54:02.208 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2024-03-24T17:54:02.208 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T17:54:02.208 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T17:54:02.208 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T17:54:02.208 INFO:teuthology.provision.fog.smithi188:Deploy complete!
2024-03-24T17:54:02.209 DEBUG:teuthology.parallel:result is None
2024-03-24T17:54:02.422 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2024-03-24T17:54:02.422 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T17:54:02.448 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com
2024-03-24T17:54:02.448 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T17:54:02.482 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com
2024-03-24T17:54:02.482 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T17:54:02.499 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2024-03-24T17:54:02.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-03-24T17:54:02.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:54:02.592 DEBUG:teuthology.orchestra.run.smithi119:> true
2024-03-24T17:54:02.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-03-24T17:54:02.662 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2024-03-24T17:54:02.718 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2024-03-24T17:54:02.719 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-03-24T17:54:02.774 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream"
2024-03-24T17:54:02.774 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9"
2024-03-24T17:54:02.774 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos"
2024-03-24T17:54:02.774 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora"
2024-03-24T17:54:02.774 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9"
2024-03-24T17:54:02.774 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9"
2024-03-24T17:54:02.775 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T17:54:02.775 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-03-24T17:54:02.775 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon"
2024-03-24T17:54:02.775 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T17:54:02.775 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/"
2024-03-24T17:54:02.775 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T17:54:02.775 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T17:54:02.775 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T17:54:02.775 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-03-24T17:54:02.798 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server
2024-03-24T17:54:02.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com'
2024-03-24T17:54:02.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:54:02.885 DEBUG:teuthology.orchestra.run.smithi173:> true
2024-03-24T17:54:03.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com'
2024-03-24T17:54:03.052 DEBUG:teuthology.orchestra.run.smithi173:> uname -m
2024-03-24T17:54:03.106 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64
2024-03-24T17:54:03.107 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release
2024-03-24T17:54:03.161 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream"
2024-03-24T17:54:03.162 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9"
2024-03-24T17:54:03.162 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos"
2024-03-24T17:54:03.162 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora"
2024-03-24T17:54:03.162 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9"
2024-03-24T17:54:03.162 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9"
2024-03-24T17:54:03.162 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T17:54:03.162 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31"
2024-03-24T17:54:03.162 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon"
2024-03-24T17:54:03.162 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T17:54:03.162 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/"
2024-03-24T17:54:03.162 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T17:54:03.162 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T17:54:03.162 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T17:54:03.163 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server
2024-03-24T17:54:03.182 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server
2024-03-24T17:54:03.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com'
2024-03-24T17:54:03.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T17:54:03.270 DEBUG:teuthology.orchestra.run.smithi188:> true
2024-03-24T17:54:03.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com'
2024-03-24T17:54:03.341 DEBUG:teuthology.orchestra.run.smithi188:> uname -m
2024-03-24T17:54:03.396 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64
2024-03-24T17:54:03.396 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release
2024-03-24T17:54:03.452 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2024-03-24T17:54:03.452 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9"
2024-03-24T17:54:03.452 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2024-03-24T17:54:03.452 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2024-03-24T17:54:03.452 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9"
2024-03-24T17:54:03.452 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9"
2024-03-24T17:54:03.452 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T17:54:03.452 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2024-03-24T17:54:03.452 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon"
2024-03-24T17:54:03.453 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T17:54:03.453 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2024-03-24T17:54:03.453 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T17:54:03.453 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T17:54:03.453 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T17:54:03.453 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2024-03-24T17:54:03.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T17:54:03.562 INFO:teuthology.dispatcher.supervisor:Running job 7619089
2024-03-24T17:54:03.562 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-24_05:00:13-smoke-main-distro-default-smithi/7619089 --name teuthology-2024-03-24_05:00:13-smoke-main-distro-default-smithi --description smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/rados_cls_all}} -- /home/teuthworker/archive/teuthology-2024-03-24_05:00:13-smoke-main-distro-default-smithi/7619089/orig.config.yaml
2024-03-24T17:54:03.566 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-24_05:00:13-smoke-main-distro-default-smithi/7619089
2024-03-24T17:54:03.566 INFO:teuthology.dispatcher.supervisor:Job PID: 1897945
2024-03-24T17:54:03.566 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-24T17:56:03.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T17:58:03.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T18:00:03.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T18:02:04.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T18:04:04.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T18:06:04.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T18:08:04.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T18:10:04.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T18:12:04.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T18:14:05.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T18:16:05.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T18:18:05.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T18:18:05.454 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1