2024-04-17T23:09:33.817 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-17T23:09:33.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T23:09:33.998 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe7172f9c10>, signals=[15]) 2024-04-17T23:09:33.999 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2024-04-17T23:09:33.999 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T23:09:33.999 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-04-17T23:09:34.023 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2024-04-17T23:09:34.023 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T23:09:34.023 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-04-17T23:09:34.047 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2024-04-17T23:09:34.047 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T23:09:34.048 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-04-17T23:09:34.132 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T23:09:34.172 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of centos 9.stream 2024-04-17T23:09:34.181 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T23:09:34.183 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T23:09:34.230 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 9.stream 2024-04-17T23:09:34.236 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 9.stream 2024-04-17T23:09:34.490 INFO:teuthology.orchestra.console.smithi092:Power off 2024-04-17T23:09:34.491 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T23:09:34.514 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2024-04-17T23:09:34.515 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T23:09:34.533 INFO:teuthology.orchestra.console.smithi159:Power off 2024-04-17T23:09:34.533 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T23:09:34.543 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-04-17T23:09:34.557 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2024-04-17T23:09:34.558 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T23:09:34.569 INFO:teuthology.orchestra.console.smithi118:Power off 2024-04-17T23:09:34.570 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T23:09:34.578 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2024-04-17T23:09:34.590 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2024-04-17T23:09:34.590 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T23:09:34.614 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2024-04-17T23:09:34.644 INFO:teuthology.orchestra.console.smithi092:Power off completed 2024-04-17T23:09:34.680 INFO:teuthology.orchestra.console.smithi159:Power off completed 2024-04-17T23:09:34.714 INFO:teuthology.orchestra.console.smithi118:Power off completed 2024-04-17T23:09:34.745 INFO:teuthology.orchestra.console.smithi092:Power on 2024-04-17T23:09:34.745 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T23:09:34.767 DEBUG:teuthology.orchestra.console.smithi092:power on output: Chassis Power Control: Up/On 2024-04-17T23:09:34.768 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T23:09:34.781 INFO:teuthology.orchestra.console.smithi159:Power on 2024-04-17T23:09:34.781 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T23:09:34.790 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-04-17T23:09:34.804 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On 2024-04-17T23:09:34.805 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T23:09:34.815 INFO:teuthology.orchestra.console.smithi118:Power on 2024-04-17T23:09:34.816 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T23:09:34.828 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2024-04-17T23:09:34.836 DEBUG:teuthology.orchestra.console.smithi118:power on output: Chassis Power Control: Up/On 2024-04-17T23:09:34.836 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T23:09:34.859 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2024-04-17T23:09:38.794 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T23:09:38.829 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T23:09:38.861 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T23:09:38.903 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-04-17T23:09:38.940 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2024-04-17T23:09:38.971 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2024-04-17T23:09:42.908 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T23:09:42.941 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T23:09:42.972 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T23:09:43.017 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2024-04-17T23:09:43.049 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2024-04-17T23:09:43.081 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2024-04-17T23:09:43.118 INFO:teuthology.orchestra.console.smithi092:Power on completed 2024-04-17T23:09:43.150 INFO:teuthology.orchestra.console.smithi159:Power on completed 2024-04-17T23:09:43.182 INFO:teuthology.orchestra.console.smithi118:Power on completed 2024-04-17T23:09:43.220 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2024-04-17T23:09:43.251 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2024-04-17T23:09:43.283 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2024-04-17T23:13:30.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:13:33.598 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-17T23:13:39.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:13:42.686 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-17T23:13:48.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:13:51.742 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-17T23:13:57.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:00.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:00.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:00.798 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-17T23:14:03.774 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-17T23:14:03.775 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-04-17T23:14:06.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:09.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:09.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:09.858 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-17T23:14:12.830 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-17T23:14:12.831 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-04-17T23:14:15.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:18.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:18.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:18.942 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-17T23:14:21.886 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-17T23:14:21.887 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-04-17T23:14:24.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:27.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:27.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:27.998 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-04-17T23:14:30.942 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-17T23:14:30.943 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-04-17T23:14:34.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:36.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:36.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:40.002 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-17T23:14:40.034 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-04-17T23:14:46.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:46.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:49.086 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-17T23:14:49.087 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-04-17T23:14:55.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:55.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:14:58.146 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-17T23:15:04.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:15:14.334 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-17T23:15:20.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:15:23.422 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-17T23:15:29.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:15:32.478 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-04-17T23:15:34.007 WARNING:teuthology.provision.fog.smithi118:timed out 2024-04-17T23:15:38.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:15:40.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:15:40.232 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T23:15:40.233 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T23:15:40.571 INFO:teuthology.provision.fog.smithi118:Node is ready 2024-04-17T23:15:40.571 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2024-04-17T23:15:40.585 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com 2024-04-17T23:15:40.585 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts 2024-04-17T23:15:40.640 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2024-04-17T23:15:40.640 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2024-04-17T23:15:40.751 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts 2024-04-17T23:15:40.778 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts 2024-04-17T23:15:40.846 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname 2024-04-17T23:15:40.913 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2024-04-17T23:15:40.979 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-04-17T23:15:41.033 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-04-17T23:15:41.033 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-04-17T23:15:41.033 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-04-17T23:15:41.033 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-04-17T23:15:41.033 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-04-17T23:15:41.033 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-04-17T23:15:41.033 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T23:15:41.034 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-04-17T23:15:41.034 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-04-17T23:15:41.034 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T23:15:41.034 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-04-17T23:15:41.034 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T23:15:41.034 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T23:15:41.034 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T23:15:41.035 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2024-04-17T23:15:41.037 DEBUG:teuthology.parallel:result is None 2024-04-17T23:15:41.498 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T23:15:41.498 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T23:15:55.096 WARNING:teuthology.provision.fog.smithi092:timed out 2024-04-17T23:16:01.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:16:01.506 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T23:16:01.507 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T23:16:01.840 INFO:teuthology.provision.fog.smithi159:Node is ready 2024-04-17T23:16:01.840 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2024-04-17T23:16:01.851 INFO:teuthology.provision.fog.smithi092:Node is ready 2024-04-17T23:16:01.851 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2024-04-17T23:16:01.859 INFO:teuthology.orchestra.run.smithi159.stdout:smithi046 2024-04-17T23:16:01.859 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi046 /etc/hosts 2024-04-17T23:16:01.865 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com 2024-04-17T23:16:01.866 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts 2024-04-17T23:16:01.916 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-17T23:16:01.917 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2024-04-17T23:16:01.921 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2024-04-17T23:16:01.921 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2024-04-17T23:16:02.018 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts 2024-04-17T23:16:02.047 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts 2024-04-17T23:16:02.072 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi046/smithi159/g' /etc/hosts 2024-04-17T23:16:02.103 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.46/172.21.15.159/g' /etc/hosts 2024-04-17T23:16:02.114 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname 2024-04-17T23:16:02.173 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi046/smithi159/g' /etc/hostname 2024-04-17T23:16:02.181 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2024-04-17T23:16:02.242 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2024-04-17T23:16:02.247 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-04-17T23:16:02.301 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-04-17T23:16:02.301 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-04-17T23:16:02.301 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-04-17T23:16:02.302 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-04-17T23:16:02.302 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-04-17T23:16:02.302 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-04-17T23:16:02.302 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T23:16:02.302 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-04-17T23:16:02.302 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-04-17T23:16:02.302 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T23:16:02.302 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-04-17T23:16:02.302 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T23:16:02.302 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T23:16:02.302 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T23:16:02.303 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2024-04-17T23:16:02.303 DEBUG:teuthology.parallel:result is None 2024-04-17T23:16:02.310 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-04-17T23:16:02.365 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-04-17T23:16:02.365 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-04-17T23:16:02.365 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-04-17T23:16:02.365 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-04-17T23:16:02.365 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-04-17T23:16:02.366 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-04-17T23:16:02.366 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T23:16:02.366 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-04-17T23:16:02.366 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-04-17T23:16:02.366 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T23:16:02.366 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-04-17T23:16:02.366 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T23:16:02.366 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T23:16:02.366 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T23:16:02.366 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2024-04-17T23:16:02.367 DEBUG:teuthology.parallel:result is None 2024-04-17T23:16:02.581 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2024-04-17T23:16:02.581 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T23:16:02.606 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2024-04-17T23:16:02.607 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T23:16:02.631 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2024-04-17T23:16:02.631 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T23:16:02.649 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2024-04-17T23:16:02.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-04-17T23:16:02.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:16:02.737 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-04-17T23:16:02.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-04-17T23:16:02.808 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-04-17T23:16:02.862 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-04-17T23:16:02.863 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-04-17T23:16:02.917 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-04-17T23:16:02.917 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-04-17T23:16:02.917 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-04-17T23:16:02.918 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-04-17T23:16:02.918 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-04-17T23:16:02.918 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-04-17T23:16:02.918 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T23:16:02.918 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-04-17T23:16:02.918 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-04-17T23:16:02.918 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T23:16:02.918 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-04-17T23:16:02.918 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T23:16:02.918 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T23:16:02.918 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T23:16:02.919 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-04-17T23:16:02.948 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2024-04-17T23:16:02.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-17T23:16:02.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:16:03.034 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-04-17T23:16:03.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-04-17T23:16:03.204 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2024-04-17T23:16:03.259 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2024-04-17T23:16:03.259 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-04-17T23:16:03.313 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-04-17T23:16:03.313 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-04-17T23:16:03.313 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-04-17T23:16:03.314 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-04-17T23:16:03.314 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-04-17T23:16:03.314 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-04-17T23:16:03.314 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T23:16:03.314 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-04-17T23:16:03.314 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-04-17T23:16:03.314 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T23:16:03.314 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-04-17T23:16:03.314 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T23:16:03.314 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T23:16:03.314 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T23:16:03.315 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-04-17T23:16:03.340 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2024-04-17T23:16:03.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-04-17T23:16:03.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T23:16:03.427 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-04-17T23:16:03.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-04-17T23:16:03.493 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2024-04-17T23:16:03.548 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2024-04-17T23:16:03.548 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-04-17T23:16:03.603 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-04-17T23:16:03.603 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-04-17T23:16:03.603 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-04-17T23:16:03.603 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-04-17T23:16:03.603 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-04-17T23:16:03.603 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-04-17T23:16:03.603 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T23:16:03.603 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-04-17T23:16:03.603 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-04-17T23:16:03.603 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T23:16:03.604 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-04-17T23:16:03.604 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T23:16:03.604 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T23:16:03.604 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T23:16:03.604 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-04-17T23:16:03.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T23:16:03.707 INFO:teuthology.dispatcher.supervisor:Running job 7661247 2024-04-17T23:16:03.707 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi/7661247 --name teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi/7661247/orig.config.yaml 2024-04-17T23:16:03.710 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi/7661247 2024-04-17T23:16:03.710 INFO:teuthology.dispatcher.supervisor:Job PID: 3752932 2024-04-17T23:16:03.710 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T23:18:03.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T23:20:03.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T23:22:04.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T23:24:04.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T23:26:04.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T23:26:04.533 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1