2024-03-17T04:23:51.328 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-17T04:23:51.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:23:51.495 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6f337bdf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6f3481ec10>, signals=[15])
2024-03-17T04:23:51.496 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging
2024-03-17T04:23:51.496 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server
2024-03-17T04:23:51.496 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-03-17T04:23:51.516 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging
2024-03-17T04:23:51.516 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server
2024-03-17T04:23:51.516 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-03-17T04:23:51.541 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging
2024-03-17T04:23:51.541 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server
2024-03-17T04:23:51.541 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2024-03-17T04:23:51.623 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_9.stream (ID 10)
2024-03-17T04:23:51.656 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_centos_9.stream (ID 10)
2024-03-17T04:23:51.663 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_9.stream (ID 10)
2024-03-17T04:23:51.666 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 9.stream
2024-03-17T04:23:51.705 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 9.stream
2024-03-17T04:23:51.721 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 9.stream
2024-03-17T04:23:51.903 INFO:teuthology.orchestra.console.smithi149:Power off
2024-03-17T04:23:51.904 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-17T04:23:51.925 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off
2024-03-17T04:23:51.925 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:23:51.948 INFO:teuthology.orchestra.console.smithi153:Power off
2024-03-17T04:23:51.948 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-17T04:23:51.956 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-03-17T04:23:51.962 INFO:teuthology.orchestra.console.smithi192:Power off
2024-03-17T04:23:51.962 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-17T04:23:51.970 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2024-03-17T04:23:51.971 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:23:51.985 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off
2024-03-17T04:23:51.985 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:23:51.993 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-03-17T04:23:52.006 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-03-17T04:23:52.057 INFO:teuthology.orchestra.console.smithi149:Power off completed
2024-03-17T04:23:52.107 INFO:teuthology.orchestra.console.smithi192:Power off completed
2024-03-17T04:23:52.158 INFO:teuthology.orchestra.console.smithi149:Power on
2024-03-17T04:23:52.159 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-17T04:23:52.180 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On
2024-03-17T04:23:52.181 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:23:52.200 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-03-17T04:23:52.208 INFO:teuthology.orchestra.console.smithi192:Power on
2024-03-17T04:23:52.208 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-17T04:23:52.228 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On
2024-03-17T04:23:52.228 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:23:52.249 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-03-17T04:23:55.997 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:23:56.106 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-03-17T04:23:56.201 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:23:56.251 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:23:56.310 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-03-17T04:23:56.360 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-03-17T04:23:56.411 INFO:teuthology.orchestra.console.smithi149:Power on completed
2024-03-17T04:23:56.512 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish
2024-03-17T04:24:00.110 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:24:00.220 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-03-17T04:24:00.360 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:24:00.469 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2024-03-17T04:24:00.569 INFO:teuthology.orchestra.console.smithi192:Power on completed
2024-03-17T04:24:00.670 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish
2024-03-17T04:24:04.224 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:24:04.333 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-03-17T04:24:04.434 INFO:teuthology.orchestra.console.smithi153:Power off completed
2024-03-17T04:24:04.534 INFO:teuthology.orchestra.console.smithi153:Power on
2024-03-17T04:24:04.535 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-17T04:24:04.556 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On
2024-03-17T04:24:04.556 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:24:04.577 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-03-17T04:24:08.582 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:24:08.691 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2024-03-17T04:24:12.693 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T04:24:12.802 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2024-03-17T04:24:12.903 INFO:teuthology.orchestra.console.smithi153:Power on completed
2024-03-17T04:24:13.003 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2024-03-17T04:26:31.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:26:42.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:26:49.758 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-03-17T04:26:55.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:26:58.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:26:58.814 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-03-17T04:27:00.766 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-17T04:27:04.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:27:06.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:27:07.874 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-03-17T04:27:09.822 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-17T04:27:13.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:27:15.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:27:16.962 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-03-17T04:27:17.150 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-03-17T04:27:18.878 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-17T04:27:22.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:27:23.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:27:24.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:27:26.046 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-03-17T04:27:26.210 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-03-17T04:27:27.934 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-17T04:27:32.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:27:32.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:27:33.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:27:35.266 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-03-17T04:27:41.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:27:44.350 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-03-17T04:27:50.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:27:53.406 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2024-03-17T04:27:59.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:28:32.078 WARNING:teuthology.provision.fog.smithi192:timed out
2024-03-17T04:28:33.942 WARNING:teuthology.provision.fog.smithi149:timed out
2024-03-17T04:28:38.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:28:38.338 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-17T04:28:38.339 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-17T04:28:38.669 INFO:teuthology.provision.fog.smithi192:Node is ready
2024-03-17T04:28:38.669 DEBUG:teuthology.orchestra.run.smithi192:> hostname
2024-03-17T04:28:38.684 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com
2024-03-17T04:28:38.684 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts
2024-03-17T04:28:38.740 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192
2024-03-17T04:28:38.741 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2024-03-17T04:28:38.861 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts
2024-03-17T04:28:38.890 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts
2024-03-17T04:28:38.958 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname
2024-03-17T04:28:39.026 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2024-03-17T04:28:39.092 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2024-03-17T04:28:39.147 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream"
2024-03-17T04:28:39.147 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9"
2024-03-17T04:28:39.147 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos"
2024-03-17T04:28:39.147 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora"
2024-03-17T04:28:39.147 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9"
2024-03-17T04:28:39.147 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9"
2024-03-17T04:28:39.147 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T04:28:39.147 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2024-03-17T04:28:39.147 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon"
2024-03-17T04:28:39.148 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T04:28:39.148 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/"
2024-03-17T04:28:39.148 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T04:28:39.148 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T04:28:39.148 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T04:28:39.148 INFO:teuthology.provision.fog.smithi192:Deploy complete!
2024-03-17T04:28:39.150 DEBUG:teuthology.parallel:result is None
2024-03-17T04:28:39.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:28:40.159 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-17T04:28:40.159 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-17T04:28:40.481 INFO:teuthology.provision.fog.smithi149:Node is ready
2024-03-17T04:28:40.482 DEBUG:teuthology.orchestra.run.smithi149:> hostname
2024-03-17T04:28:40.496 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com
2024-03-17T04:28:40.497 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts
2024-03-17T04:28:40.552 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149
2024-03-17T04:28:40.553 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-03-17T04:28:40.657 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts
2024-03-17T04:28:40.684 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts
2024-03-17T04:28:40.752 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname
2024-03-17T04:28:40.819 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-03-17T04:28:40.885 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-03-17T04:28:40.940 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2024-03-17T04:28:40.940 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9"
2024-03-17T04:28:40.940 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2024-03-17T04:28:40.940 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2024-03-17T04:28:40.941 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9"
2024-03-17T04:28:40.941 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9"
2024-03-17T04:28:40.941 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T04:28:40.941 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2024-03-17T04:28:40.941 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon"
2024-03-17T04:28:40.941 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T04:28:40.941 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2024-03-17T04:28:40.941 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T04:28:40.941 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T04:28:40.941 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T04:28:40.941 INFO:teuthology.provision.fog.smithi149:Deploy complete!
2024-03-17T04:28:40.942 DEBUG:teuthology.parallel:result is None
2024-03-17T04:28:59.431 WARNING:teuthology.provision.fog.smithi153:timed out
2024-03-17T04:29:05.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:29:05.706 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-17T04:29:05.706 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-17T04:29:06.029 INFO:teuthology.provision.fog.smithi153:Node is ready
2024-03-17T04:29:06.029 DEBUG:teuthology.orchestra.run.smithi153:> hostname
2024-03-17T04:29:06.044 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com
2024-03-17T04:29:06.045 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts
2024-03-17T04:29:06.100 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2024-03-17T04:29:06.100 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-03-17T04:29:06.196 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts
2024-03-17T04:29:06.224 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts
2024-03-17T04:29:06.292 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname
2024-03-17T04:29:06.360 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2024-03-17T04:29:06.426 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-03-17T04:29:06.481 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2024-03-17T04:29:06.481 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9"
2024-03-17T04:29:06.481 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2024-03-17T04:29:06.481 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2024-03-17T04:29:06.481 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9"
2024-03-17T04:29:06.481 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9"
2024-03-17T04:29:06.482 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T04:29:06.482 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2024-03-17T04:29:06.482 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon"
2024-03-17T04:29:06.482 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T04:29:06.482 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2024-03-17T04:29:06.482 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T04:29:06.482 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T04:29:06.482 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T04:29:06.482 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2024-03-17T04:29:06.483 DEBUG:teuthology.parallel:result is None
2024-03-17T04:29:06.718 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com
2024-03-17T04:29:06.718 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-17T04:29:06.742 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2024-03-17T04:29:06.742 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-17T04:29:06.758 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com
2024-03-17T04:29:06.758 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-17T04:29:06.776 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server
2024-03-17T04:29:06.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-03-17T04:29:06.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:29:06.865 DEBUG:teuthology.orchestra.run.smithi149:> true
2024-03-17T04:29:07.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-03-17T04:29:07.029 DEBUG:teuthology.orchestra.run.smithi149:> uname -m
2024-03-17T04:29:07.082 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64
2024-03-17T04:29:07.083 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-03-17T04:29:07.137 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2024-03-17T04:29:07.137 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9"
2024-03-17T04:29:07.137 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2024-03-17T04:29:07.137 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2024-03-17T04:29:07.137 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9"
2024-03-17T04:29:07.137 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9"
2024-03-17T04:29:07.137 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T04:29:07.137 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2024-03-17T04:29:07.137 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon"
2024-03-17T04:29:07.137 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T04:29:07.137 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2024-03-17T04:29:07.138 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T04:29:07.138 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T04:29:07.138 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T04:29:07.138 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-03-17T04:29:07.159 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2024-03-17T04:29:07.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-03-17T04:29:07.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:29:07.248 DEBUG:teuthology.orchestra.run.smithi153:> true
2024-03-17T04:29:07.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com'
2024-03-17T04:29:07.272 DEBUG:teuthology.orchestra.run.smithi153:> uname -m
2024-03-17T04:29:07.326 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2024-03-17T04:29:07.326 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2024-03-17T04:29:07.381 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2024-03-17T04:29:07.381 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9"
2024-03-17T04:29:07.381 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2024-03-17T04:29:07.381 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2024-03-17T04:29:07.381 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9"
2024-03-17T04:29:07.381 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9"
2024-03-17T04:29:07.382 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T04:29:07.382 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2024-03-17T04:29:07.382 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon"
2024-03-17T04:29:07.382 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T04:29:07.382 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2024-03-17T04:29:07.382 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T04:29:07.382 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T04:29:07.382 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T04:29:07.382 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2024-03-17T04:29:07.400 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server
2024-03-17T04:29:07.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com'
2024-03-17T04:29:07.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T04:29:07.491 DEBUG:teuthology.orchestra.run.smithi192:> true
2024-03-17T04:29:07.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com'
2024-03-17T04:29:07.656 DEBUG:teuthology.orchestra.run.smithi192:> uname -m
2024-03-17T04:29:07.709 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64
2024-03-17T04:29:07.710 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2024-03-17T04:29:07.764 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream"
2024-03-17T04:29:07.764 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9"
2024-03-17T04:29:07.764 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos"
2024-03-17T04:29:07.764 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora"
2024-03-17T04:29:07.764 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9"
2024-03-17T04:29:07.764 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9"
2024-03-17T04:29:07.764 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T04:29:07.764 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2024-03-17T04:29:07.764 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon"
2024-03-17T04:29:07.765 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T04:29:07.765 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/"
2024-03-17T04:29:07.765 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T04:29:07.765 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T04:29:07.765 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T04:29:07.765 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2024-03-17T04:29:07.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:29:07.888 INFO:teuthology.dispatcher.supervisor:Running job 7599124
2024-03-17T04:29:07.888 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599124 --name teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599124/orig.config.yaml
2024-03-17T04:29:07.891 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599124
2024-03-17T04:29:07.892 INFO:teuthology.dispatcher.supervisor:Job PID: 1309151
2024-03-17T04:29:07.892 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-17T04:31:07.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:33:08.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:35:08.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:37:08.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:39:08.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:41:08.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:43:09.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:45:09.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:47:09.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:49:09.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:51:09.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:53:09.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:55:09.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:57:10.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T04:59:10.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:01:10.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:03:10.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:05:10.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:07:10.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:09:11.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:11:11.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:13:11.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:15:11.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:17:11.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:19:11.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:21:11.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:23:12.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:25:12.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:27:12.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:29:12.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:31:12.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:33:12.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:35:12.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:37:13.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:39:13.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:41:13.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:43:13.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:45:14.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:47:14.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:49:14.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:51:14.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:53:14.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:55:14.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:57:14.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T05:59:15.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T06:01:15.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T06:03:15.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T06:05:15.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T06:07:15.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T06:07:15.861 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1