2024-03-16T19:33:09.756 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-16T19:33:09.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T19:33:09.925 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc5933d8c10>, signals=[15]) 2024-03-16T19:33:09.926 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2024-03-16T19:33:09.926 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2024-03-16T19:33:09.926 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-03-16T19:33:09.942 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging 2024-03-16T19:33:09.943 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server 2024-03-16T19:33:09.943 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-03-16T19:33:09.967 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2024-03-16T19:33:09.967 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2024-03-16T19:33:09.967 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-03-16T19:33:10.055 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_centos_9.stream (ID 10) 2024-03-16T19:33:10.073 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_centos_9.stream (ID 10) 2024-03-16T19:33:10.113 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 9.stream 2024-03-16T19:33:10.116 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_centos_9.stream (ID 10) 2024-03-16T19:33:10.117 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 9.stream 2024-03-16T19:33:10.171 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of centos 9.stream 2024-03-16T19:33:10.396 INFO:teuthology.orchestra.console.smithi005:Power off 2024-03-16T19:33:10.397 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T19:33:10.410 INFO:teuthology.orchestra.console.smithi022:Power off 2024-03-16T19:33:10.411 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T19:33:10.420 INFO:teuthology.orchestra.console.smithi019:Power off 2024-03-16T19:33:10.421 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T19:33:10.428 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-03-16T19:33:10.428 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:10.436 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2024-03-16T19:33:10.436 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:10.444 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2024-03-16T19:33:10.444 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:10.452 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-03-16T19:33:10.457 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-03-16T19:33:10.467 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-16T19:33:14.458 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:14.464 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:14.471 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:14.567 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-03-16T19:33:14.573 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-03-16T19:33:14.580 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-16T19:33:18.572 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:18.580 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:18.588 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:18.683 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-03-16T19:33:18.690 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-03-16T19:33:18.697 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-16T19:33:18.784 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-03-16T19:33:18.791 INFO:teuthology.orchestra.console.smithi022:Power off completed 2024-03-16T19:33:18.885 INFO:teuthology.orchestra.console.smithi005:Power on 2024-03-16T19:33:18.885 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-16T19:33:18.892 INFO:teuthology.orchestra.console.smithi022:Power on 2024-03-16T19:33:18.892 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-16T19:33:18.907 DEBUG:teuthology.orchestra.console.smithi005:power on output: Chassis Power Control: Up/On 2024-03-16T19:33:18.907 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:18.916 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2024-03-16T19:33:18.916 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:18.930 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-03-16T19:33:18.937 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-03-16T19:33:22.702 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:22.810 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2024-03-16T19:33:22.910 INFO:teuthology.orchestra.console.smithi019:Power off completed 2024-03-16T19:33:22.932 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:22.938 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:23.011 INFO:teuthology.orchestra.console.smithi019:Power on 2024-03-16T19:33:23.011 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-16T19:33:23.031 DEBUG:teuthology.orchestra.console.smithi019:power on output: Chassis Power Control: Up/On 2024-03-16T19:33:23.032 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:23.040 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-03-16T19:33:23.046 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-03-16T19:33:23.053 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2024-03-16T19:33:27.042 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:27.049 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:27.056 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T19:33:27.151 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-03-16T19:33:27.157 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-03-16T19:33:27.164 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-16T19:33:27.252 INFO:teuthology.orchestra.console.smithi005:Power on completed 2024-03-16T19:33:27.258 INFO:teuthology.orchestra.console.smithi022:Power on completed 2024-03-16T19:33:27.265 INFO:teuthology.orchestra.console.smithi019:Power on completed 2024-03-16T19:33:27.353 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2024-03-16T19:33:27.359 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2024-03-16T19:33:27.365 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish 2024-03-16T19:35:58.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:35:58.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:35:58.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:36:16.671 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-03-16T19:36:16.671 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-16T19:36:16.671 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-03-16T19:36:22.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:36:22.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:36:22.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:36:25.727 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-03-16T19:36:25.758 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-16T19:36:25.758 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-03-16T19:36:31.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:36:31.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:36:31.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:36:34.814 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-03-16T19:36:34.815 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-16T19:36:34.815 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-03-16T19:36:40.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:36:40.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:36:40.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:36:43.902 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-03-16T19:36:49.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:37:40.869 WARNING:teuthology.provision.fog.smithi022:timed out 2024-03-16T19:37:40.869 WARNING:teuthology.provision.fog.smithi005:timed out 2024-03-16T19:37:46.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:37:46.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:37:47.147 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-16T19:37:47.147 DEBUG:teuthology.orchestra.run.smithi005:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-16T19:37:47.231 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-16T19:37:47.231 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-16T19:37:47.470 INFO:teuthology.provision.fog.smithi005:Node is ready 2024-03-16T19:37:47.470 DEBUG:teuthology.orchestra.run.smithi005:> hostname 2024-03-16T19:37:47.485 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2024-03-16T19:37:47.485 DEBUG:teuthology.orchestra.run.smithi005:> grep smithi005.front.sepia.ceph.com /etc/hosts 2024-03-16T19:37:47.521 INFO:teuthology.provision.fog.smithi022:Node is ready 2024-03-16T19:37:47.521 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2024-03-16T19:37:47.536 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2024-03-16T19:37:47.536 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2024-03-16T19:37:47.540 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2024-03-16T19:37:47.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-03-16T19:37:47.591 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2024-03-16T19:37:47.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2024-03-16T19:37:47.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hosts 2024-03-16T19:37:47.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.5/172.21.15.5/g' /etc/hosts 2024-03-16T19:37:47.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2024-03-16T19:37:47.754 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2024-03-16T19:37:47.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hostname 2024-03-16T19:37:47.825 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2024-03-16T19:37:47.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-03-16T19:37:47.896 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2024-03-16T19:37:47.898 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-03-16T19:37:47.953 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-03-16T19:37:47.953 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-03-16T19:37:47.953 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-03-16T19:37:47.953 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-03-16T19:37:47.953 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-03-16T19:37:47.953 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-03-16T19:37:47.954 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T19:37:47.954 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-03-16T19:37:47.954 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-03-16T19:37:47.954 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T19:37:47.954 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-03-16T19:37:47.954 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T19:37:47.954 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T19:37:47.954 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T19:37:47.955 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2024-03-16T19:37:47.956 DEBUG:teuthology.parallel:result is None 2024-03-16T19:37:47.966 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-03-16T19:37:48.021 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-03-16T19:37:48.021 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-03-16T19:37:48.021 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-03-16T19:37:48.021 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-03-16T19:37:48.021 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-03-16T19:37:48.022 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-03-16T19:37:48.022 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T19:37:48.022 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-03-16T19:37:48.022 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-03-16T19:37:48.022 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T19:37:48.022 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-03-16T19:37:48.022 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T19:37:48.022 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T19:37:48.022 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T19:37:48.022 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2024-03-16T19:37:48.023 DEBUG:teuthology.parallel:result is None 2024-03-16T19:37:49.912 WARNING:teuthology.provision.fog.smithi019:timed out 2024-03-16T19:37:55.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:37:56.148 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-16T19:37:56.149 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-16T19:37:56.472 INFO:teuthology.provision.fog.smithi019:Node is ready 2024-03-16T19:37:56.472 DEBUG:teuthology.orchestra.run.smithi019:> hostname 2024-03-16T19:37:56.487 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com 2024-03-16T19:37:56.487 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts 2024-03-16T19:37:56.543 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019 2024-03-16T19:37:56.543 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2024-03-16T19:37:56.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts 2024-03-16T19:37:56.682 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts 2024-03-16T19:37:56.754 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname 2024-03-16T19:37:56.826 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2024-03-16T19:37:56.896 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-03-16T19:37:56.951 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-03-16T19:37:56.951 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-03-16T19:37:56.951 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-03-16T19:37:56.951 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-03-16T19:37:56.951 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-03-16T19:37:56.951 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-03-16T19:37:56.951 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T19:37:56.951 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-03-16T19:37:56.951 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-03-16T19:37:56.951 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T19:37:56.952 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-03-16T19:37:56.952 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T19:37:56.952 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T19:37:56.952 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T19:37:56.952 INFO:teuthology.provision.fog.smithi019:Deploy complete! 2024-03-16T19:37:56.953 DEBUG:teuthology.parallel:result is None 2024-03-16T19:37:57.210 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2024-03-16T19:37:57.210 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-16T19:37:57.239 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com 2024-03-16T19:37:57.240 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-16T19:37:57.264 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2024-03-16T19:37:57.264 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-16T19:37:57.282 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2024-03-16T19:37:57.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-03-16T19:37:57.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:37:57.384 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-03-16T19:37:57.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-03-16T19:37:57.455 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-03-16T19:37:57.516 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-03-16T19:37:57.516 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-03-16T19:37:57.573 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-03-16T19:37:57.573 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-03-16T19:37:57.573 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-03-16T19:37:57.573 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-03-16T19:37:57.573 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-03-16T19:37:57.574 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-03-16T19:37:57.574 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T19:37:57.574 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-03-16T19:37:57.574 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-03-16T19:37:57.574 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T19:37:57.574 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-03-16T19:37:57.574 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T19:37:57.574 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T19:37:57.574 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T19:37:57.575 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-03-16T19:37:57.598 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server 2024-03-16T19:37:57.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-16T19:37:57.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:37:57.697 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-03-16T19:37:57.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-16T19:37:57.766 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-03-16T19:37:57.822 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-03-16T19:37:57.822 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-03-16T19:37:57.879 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-03-16T19:37:57.880 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-03-16T19:37:57.880 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-03-16T19:37:57.880 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-03-16T19:37:57.880 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-03-16T19:37:57.880 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-03-16T19:37:57.880 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T19:37:57.880 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-03-16T19:37:57.880 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-03-16T19:37:57.880 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T19:37:57.880 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-03-16T19:37:57.880 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T19:37:57.880 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T19:37:57.880 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T19:37:57.881 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-03-16T19:37:57.906 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2024-03-16T19:37:57.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-03-16T19:37:57.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T19:37:58.013 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-03-16T19:37:58.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-03-16T19:37:58.083 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-03-16T19:37:58.140 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-03-16T19:37:58.141 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-03-16T19:37:58.198 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-03-16T19:37:58.199 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-03-16T19:37:58.199 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-03-16T19:37:58.199 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-03-16T19:37:58.199 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-03-16T19:37:58.199 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-03-16T19:37:58.199 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T19:37:58.199 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-03-16T19:37:58.199 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-03-16T19:37:58.199 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T19:37:58.199 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-03-16T19:37:58.199 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T19:37:58.199 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T19:37:58.200 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T19:37:58.200 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-03-16T19:37:58.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T19:37:58.321 INFO:teuthology.dispatcher.supervisor:Running job 7602120 2024-03-16T19:37:58.322 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602120 --name leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602120/orig.config.yaml 2024-03-16T19:37:58.324 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602120 2024-03-16T19:37:58.325 INFO:teuthology.dispatcher.supervisor:Job PID: 3696094 2024-03-16T19:37:58.325 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-16T19:39:58.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T19:41:58.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T19:43:58.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T19:45:58.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T19:47:59.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T19:49:59.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T19:51:59.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T19:53:59.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T19:55:59.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T19:57:59.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:00:00.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:02:00.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:04:00.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:06:00.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:08:00.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:10:00.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:12:01.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:14:01.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:16:01.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:18:01.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:20:01.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:22:01.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:24:02.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:26:02.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:28:02.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T20:28:02.493 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1