2024-03-11T19:26:51.862 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-11T19:26:51.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:26:52.048 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7efd0e7b4f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7efd0f815c10>, signals=[15])
2024-03-11T19:26:52.048 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging
2024-03-11T19:26:52.048 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T19:26:52.048 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2024-03-11T19:26:52.068 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging
2024-03-11T19:26:52.068 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T19:26:52.068 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2024-03-11T19:26:52.093 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2024-03-11T19:26:52.093 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T19:26:52.093 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-03-11T19:26:52.185 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_centos_9.stream (ID 10)
2024-03-11T19:26:52.210 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_centos_9.stream (ID 10)
2024-03-11T19:26:52.227 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10)
2024-03-11T19:26:52.231 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of centos 9.stream
2024-03-11T19:26:52.253 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 9.stream
2024-03-11T19:26:52.270 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream
2024-03-11T19:26:52.455 INFO:teuthology.orchestra.console.smithi097:Power off
2024-03-11T19:26:52.456 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T19:26:52.471 INFO:teuthology.orchestra.console.smithi114:Power off
2024-03-11T19:26:52.472 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T19:26:52.485 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off
2024-03-11T19:26:52.486 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T19:26:52.496 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off
2024-03-11T19:26:52.497 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T19:26:52.511 INFO:teuthology.orchestra.console.smithi161:Power off
2024-03-11T19:26:52.512 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T19:26:52.520 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2024-03-11T19:26:52.520 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2024-03-11T19:26:52.532 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2024-03-11T19:26:52.532 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T19:26:52.552 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-03-11T19:26:52.621 INFO:teuthology.orchestra.console.smithi114:Power off completed
2024-03-11T19:26:52.621 INFO:teuthology.orchestra.console.smithi097:Power off completed
2024-03-11T19:26:52.654 INFO:teuthology.orchestra.console.smithi161:Power off completed
2024-03-11T19:26:52.722 INFO:teuthology.orchestra.console.smithi114:Power on
2024-03-11T19:26:52.761 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T19:26:52.768 INFO:teuthology.orchestra.console.smithi097:Power on
2024-03-11T19:26:52.769 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T19:26:52.774 INFO:teuthology.orchestra.console.smithi161:Power on
2024-03-11T19:26:52.775 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T19:26:52.782 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On
2024-03-11T19:26:52.782 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T19:26:52.789 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On
2024-03-11T19:26:52.790 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T19:26:52.798 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2024-03-11T19:26:52.798 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T19:26:52.806 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2024-03-11T19:26:52.811 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2024-03-11T19:26:52.819 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-03-11T19:26:56.810 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T19:26:56.817 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T19:26:56.824 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T19:26:56.919 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on
2024-03-11T19:26:56.925 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2024-03-11T19:26:56.932 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-03-11T19:26:57.020 INFO:teuthology.orchestra.console.smithi114:Power on completed
2024-03-11T19:26:57.033 INFO:teuthology.orchestra.console.smithi161:Power on completed
2024-03-11T19:26:57.121 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish
2024-03-11T19:26:57.133 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2024-03-11T19:27:00.926 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T19:27:01.035 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2024-03-11T19:27:01.136 INFO:teuthology.orchestra.console.smithi097:Power on completed
2024-03-11T19:27:01.236 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish
2024-03-11T19:29:27.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:29:31.042 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-11T19:29:31.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:29:32.129 ERROR:teuthology.orchestra.connection:Error authenticating with smithi097.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-03-11T19:29:37.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:29:40.130 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-11T19:29:43.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:29:46.082 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-11T19:29:46.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:29:49.182 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-11T19:29:52.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:29:55.134 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-11T19:29:55.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:29:58.238 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-11T19:30:01.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:30:04.190 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-11T19:30:04.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:30:07.294 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-11T19:30:10.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:30:13.246 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-11T19:30:13.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:30:16.350 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-11T19:30:19.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:30:22.306 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-11T19:30:22.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:30:25.406 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-11T19:30:28.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:30:31.390 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-11T19:30:31.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:30:36.132 WARNING:teuthology.provision.fog.smithi097:timed out
2024-03-11T19:30:37.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:30:40.450 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-11T19:30:42.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:30:46.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:30:49.502 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-03-11T19:30:49.758 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-11T19:30:55.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:30:55.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:30:58.814 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-11T19:31:04.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:31:07.874 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-11T19:31:13.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:31:14.101 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T19:31:14.101 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T19:31:29.419 INFO:teuthology.provision.fog.smithi114:Node is ready
2024-03-11T19:31:29.420 DEBUG:teuthology.orchestra.run.smithi114:> hostname
2024-03-11T19:31:29.437 INFO:teuthology.orchestra.run.smithi114.stdout:smithi046
2024-03-11T19:31:29.437 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi046 /etc/hosts
2024-03-11T19:31:29.494 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-03-11T19:31:29.495 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2024-03-11T19:31:29.654 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi046/smithi114/g' /etc/hosts
2024-03-11T19:31:29.685 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.46/172.21.15.114/g' /etc/hosts
2024-03-11T19:31:29.754 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi046/smithi114/g' /etc/hostname
2024-03-11T19:31:29.823 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2024-03-11T19:31:29.892 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release
2024-03-11T19:31:29.948 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream"
2024-03-11T19:31:29.948 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9"
2024-03-11T19:31:29.948 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos"
2024-03-11T19:31:29.948 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora"
2024-03-11T19:31:29.948 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9"
2024-03-11T19:31:29.949 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9"
2024-03-11T19:31:29.949 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T19:31:29.949 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2024-03-11T19:31:29.949 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon"
2024-03-11T19:31:29.949 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T19:31:29.949 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/"
2024-03-11T19:31:29.949 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T19:31:29.949 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T19:31:29.949 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T19:31:29.950 INFO:teuthology.provision.fog.smithi114:Deploy complete!
2024-03-11T19:31:29.951 DEBUG:teuthology.parallel:result is None
2024-03-11T19:31:42.135 WARNING:teuthology.provision.fog.smithi097:timed out
2024-03-11T19:31:48.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:31:48.474 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T19:31:48.474 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T19:31:48.815 INFO:teuthology.provision.fog.smithi097:Node is ready
2024-03-11T19:31:48.815 DEBUG:teuthology.orchestra.run.smithi097:> hostname
2024-03-11T19:31:48.830 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com
2024-03-11T19:31:48.830 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts
2024-03-11T19:31:48.883 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097
2024-03-11T19:31:48.883 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2024-03-11T19:31:48.994 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts
2024-03-11T19:31:49.023 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts
2024-03-11T19:31:49.090 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname
2024-03-11T19:31:49.157 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2024-03-11T19:31:49.222 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2024-03-11T19:31:49.277 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream"
2024-03-11T19:31:49.277 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9"
2024-03-11T19:31:49.277 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos"
2024-03-11T19:31:49.277 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora"
2024-03-11T19:31:49.277 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9"
2024-03-11T19:31:49.277 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9"
2024-03-11T19:31:49.277 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T19:31:49.277 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2024-03-11T19:31:49.277 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon"
2024-03-11T19:31:49.278 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T19:31:49.278 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/"
2024-03-11T19:31:49.278 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T19:31:49.278 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T19:31:49.278 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T19:31:49.278 INFO:teuthology.provision.fog.smithi097:Deploy complete!
2024-03-11T19:31:49.279 DEBUG:teuthology.parallel:result is None
2024-03-11T19:31:55.505 WARNING:teuthology.provision.fog.smithi161:timed out
2024-03-11T19:32:01.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:32:02.022 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T19:32:02.023 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T19:32:02.345 INFO:teuthology.provision.fog.smithi161:Node is ready
2024-03-11T19:32:02.345 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2024-03-11T19:32:02.360 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2024-03-11T19:32:02.360 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2024-03-11T19:32:02.415 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2024-03-11T19:32:02.416 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-03-11T19:32:02.533 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2024-03-11T19:32:02.560 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2024-03-11T19:32:02.628 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2024-03-11T19:32:02.694 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-03-11T19:32:02.760 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-03-11T19:32:02.815 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-03-11T19:32:02.815 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9"
2024-03-11T19:32:02.815 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-03-11T19:32:02.815 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-03-11T19:32:02.815 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9"
2024-03-11T19:32:02.815 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9"
2024-03-11T19:32:02.815 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T19:32:02.815 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-03-11T19:32:02.815 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon"
2024-03-11T19:32:02.815 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T19:32:02.816 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-03-11T19:32:02.816 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T19:32:02.816 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T19:32:02.816 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T19:32:02.816 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2024-03-11T19:32:02.817 DEBUG:teuthology.parallel:result is None
2024-03-11T19:32:03.057 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com
2024-03-11T19:32:03.057 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T19:32:03.079 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com
2024-03-11T19:32:03.079 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T19:32:03.103 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2024-03-11T19:32:03.103 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T19:32:03.121 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server
2024-03-11T19:32:03.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2024-03-11T19:32:03.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:32:03.212 DEBUG:teuthology.orchestra.run.smithi097:> true
2024-03-11T19:32:03.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com'
2024-03-11T19:32:03.376 DEBUG:teuthology.orchestra.run.smithi097:> uname -m
2024-03-11T19:32:03.431 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64
2024-03-11T19:32:03.431 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2024-03-11T19:32:03.485 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream"
2024-03-11T19:32:03.485 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9"
2024-03-11T19:32:03.485 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos"
2024-03-11T19:32:03.486 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora"
2024-03-11T19:32:03.486 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9"
2024-03-11T19:32:03.486 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9"
2024-03-11T19:32:03.486 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T19:32:03.486 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2024-03-11T19:32:03.486 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon"
2024-03-11T19:32:03.486 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T19:32:03.486 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/"
2024-03-11T19:32:03.486 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T19:32:03.486 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T19:32:03.486 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T19:32:03.487 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2024-03-11T19:32:03.512 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server
2024-03-11T19:32:03.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com'
2024-03-11T19:32:03.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:32:03.599 DEBUG:teuthology.orchestra.run.smithi114:> true
2024-03-11T19:32:03.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com'
2024-03-11T19:32:03.768 DEBUG:teuthology.orchestra.run.smithi114:> uname -m
2024-03-11T19:32:03.823 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64
2024-03-11T19:32:03.824 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release
2024-03-11T19:32:03.878 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream"
2024-03-11T19:32:03.878 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9"
2024-03-11T19:32:03.878 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos"
2024-03-11T19:32:03.878 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora"
2024-03-11T19:32:03.878 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9"
2024-03-11T19:32:03.878 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9"
2024-03-11T19:32:03.878 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T19:32:03.879 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2024-03-11T19:32:03.879 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon"
2024-03-11T19:32:03.879 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T19:32:03.879 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/"
2024-03-11T19:32:03.879 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T19:32:03.879 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T19:32:03.879 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T19:32:03.879 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2024-03-11T19:32:03.903 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2024-03-11T19:32:03.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-03-11T19:32:03.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T19:32:03.988 DEBUG:teuthology.orchestra.run.smithi161:> true
2024-03-11T19:32:04.057 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-03-11T19:32:04.057 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2024-03-11T19:32:04.112 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2024-03-11T19:32:04.112 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-03-11T19:32:04.167 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-03-11T19:32:04.167 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9"
2024-03-11T19:32:04.168 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-03-11T19:32:04.168 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-03-11T19:32:04.168 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9"
2024-03-11T19:32:04.168 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9"
2024-03-11T19:32:04.168 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T19:32:04.168 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-03-11T19:32:04.168 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon"
2024-03-11T19:32:04.168 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T19:32:04.168 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-03-11T19:32:04.168 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T19:32:04.168 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T19:32:04.168 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T19:32:04.169 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-03-11T19:32:04.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:32:04.284 INFO:teuthology.dispatcher.supervisor:Running job 7591293
2024-03-11T19:32:04.284 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi/7591293 --name teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi/7591293/orig.config.yaml
2024-03-11T19:32:04.287 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi/7591293
2024-03-11T19:32:04.287 INFO:teuthology.dispatcher.supervisor:Job PID: 3082239
2024-03-11T19:32:04.287 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-11T19:34:04.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:36:04.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:38:04.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:40:04.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:42:04.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:44:04.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:46:04.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:48:04.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:50:04.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:52:04.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:54:05.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:56:05.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T19:58:05.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:00:05.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:02:05.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:04:05.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:06:05.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:08:05.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:10:05.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:12:05.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:14:05.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T20:14:05.844 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1