2024-04-18T04:40:40.050 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T04:40:40.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:40:40.227 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc545c0ec10>, signals=[15]) 2024-04-18T04:40:40.227 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2024-04-18T04:40:40.228 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T04:40:40.228 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-04-18T04:40:40.255 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging 2024-04-18T04:40:40.255 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T04:40:40.255 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-04-18T04:40:40.279 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2024-04-18T04:40:40.279 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T04:40:40.280 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-04-18T04:40:40.371 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T04:40:40.398 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T04:40:40.415 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T04:40:40.426 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of rhel 8.6 2024-04-18T04:40:40.445 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of rhel 8.6 2024-04-18T04:40:40.459 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of rhel 8.6 2024-04-18T04:40:40.723 INFO:teuthology.orchestra.console.smithi022:Power off 2024-04-18T04:40:40.724 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T04:40:40.739 INFO:teuthology.orchestra.console.smithi178:Power off 2024-04-18T04:40:40.739 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T04:40:40.758 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2024-04-18T04:40:40.759 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:40.770 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2024-04-18T04:40:40.770 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:40.787 INFO:teuthology.orchestra.console.smithi114:Power off 2024-04-18T04:40:40.788 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T04:40:40.797 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-04-18T04:40:40.797 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-18T04:40:40.812 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2024-04-18T04:40:40.812 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:40.839 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-04-18T04:40:44.800 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:44.807 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:44.841 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:44.909 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-04-18T04:40:44.915 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-18T04:40:44.949 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-04-18T04:40:48.914 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:48.922 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:48.950 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:49.024 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-04-18T04:40:49.031 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-04-18T04:40:49.059 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-04-18T04:40:49.125 INFO:teuthology.orchestra.console.smithi178:Power off completed 2024-04-18T04:40:49.132 INFO:teuthology.orchestra.console.smithi022:Power off completed 2024-04-18T04:40:49.226 INFO:teuthology.orchestra.console.smithi178:Power on 2024-04-18T04:40:49.227 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T04:40:49.235 INFO:teuthology.orchestra.console.smithi022:Power on 2024-04-18T04:40:49.235 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T04:40:49.248 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On 2024-04-18T04:40:49.248 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:49.257 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2024-04-18T04:40:49.257 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:49.269 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-04-18T04:40:49.278 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-04-18T04:40:53.062 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:53.174 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2024-04-18T04:40:53.270 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:53.277 INFO:teuthology.orchestra.console.smithi114:Power off completed 2024-04-18T04:40:53.279 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:53.378 INFO:teuthology.orchestra.console.smithi114:Power on 2024-04-18T04:40:53.378 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T04:40:53.386 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-04-18T04:40:53.388 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-04-18T04:40:53.401 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On 2024-04-18T04:40:53.401 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:53.422 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2024-04-18T04:40:57.392 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:57.399 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:57.423 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:40:57.502 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-04-18T04:40:57.533 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-04-18T04:40:57.565 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-18T04:40:57.603 INFO:teuthology.orchestra.console.smithi178:Power on completed 2024-04-18T04:40:57.634 INFO:teuthology.orchestra.console.smithi114:Power on completed 2024-04-18T04:40:57.666 INFO:teuthology.orchestra.console.smithi022:Power on completed 2024-04-18T04:40:57.703 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2024-04-18T04:40:57.736 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2024-04-18T04:40:57.767 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2024-04-18T04:43:28.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:43:43.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:43:47.106 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-18T04:43:53.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:43:56.194 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-18T04:43:58.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:02.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:02.206 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-04-18T04:44:05.278 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-18T04:44:08.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:11.262 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-04-18T04:44:11.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:14.334 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-18T04:44:17.054 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-18T04:44:17.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:20.322 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-04-18T04:44:20.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:23.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:26.110 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-18T04:44:26.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:29.406 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-04-18T04:44:32.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:35.170 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-18T04:44:35.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:38.463 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-04-18T04:44:41.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:44.254 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-18T04:44:44.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:50.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:44:53.310 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-18T04:44:59.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:45:20.356 WARNING:teuthology.provision.fog.smithi022:timed out 2024-04-18T04:45:26.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:45:26.585 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T04:45:26.586 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T04:45:26.873 INFO:teuthology.provision.fog.smithi022:Node is ready 2024-04-18T04:45:26.873 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2024-04-18T04:45:26.894 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2024-04-18T04:45:26.894 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2024-04-18T04:45:26.956 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2024-04-18T04:45:26.956 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2024-04-18T04:45:27.079 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2024-04-18T04:45:27.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2024-04-18T04:45:27.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2024-04-18T04:45:27.263 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2024-04-18T04:45:27.338 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-04-18T04:45:27.400 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T04:45:27.400 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T04:45:27.400 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2024-04-18T04:45:27.400 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2024-04-18T04:45:27.400 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6" 2024-04-18T04:45:27.400 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2024-04-18T04:45:27.401 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T04:45:27.401 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-04-18T04:45:27.401 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T04:45:27.401 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T04:45:27.401 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T04:45:27.401 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T04:45:27.401 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-18T04:45:27.401 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T04:45:27.401 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T04:45:27.401 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T04:45:27.401 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T04:45:27.402 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2024-04-18T04:45:27.403 DEBUG:teuthology.parallel:result is None 2024-04-18T04:45:44.483 WARNING:teuthology.provision.fog.smithi114:timed out 2024-04-18T04:45:50.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:45:50.717 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T04:45:50.717 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T04:45:51.002 INFO:teuthology.provision.fog.smithi114:Node is ready 2024-04-18T04:45:51.002 DEBUG:teuthology.orchestra.run.smithi114:> hostname 2024-04-18T04:45:51.019 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com 2024-04-18T04:45:51.020 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts 2024-04-18T04:45:51.078 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2024-04-18T04:45:51.078 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2024-04-18T04:45:51.199 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts 2024-04-18T04:45:51.228 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts 2024-04-18T04:45:51.296 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname 2024-04-18T04:45:51.364 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2024-04-18T04:45:51.430 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-04-18T04:45:51.486 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T04:45:51.487 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T04:45:51.487 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel" 2024-04-18T04:45:51.487 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora" 2024-04-18T04:45:51.487 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6" 2024-04-18T04:45:51.487 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2024-04-18T04:45:51.487 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T04:45:51.487 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2024-04-18T04:45:51.487 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T04:45:51.487 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T04:45:51.487 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T04:45:51.487 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T04:45:51.487 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-18T04:45:51.487 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T04:45:51.488 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T04:45:51.488 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T04:45:51.488 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T04:45:51.488 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2024-04-18T04:45:51.489 DEBUG:teuthology.parallel:result is None 2024-04-18T04:45:59.319 WARNING:teuthology.provision.fog.smithi178:timed out 2024-04-18T04:46:05.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:46:05.593 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T04:46:05.593 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T04:46:05.858 INFO:teuthology.provision.fog.smithi178:Node is ready 2024-04-18T04:46:05.858 DEBUG:teuthology.orchestra.run.smithi178:> hostname 2024-04-18T04:46:05.877 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com 2024-04-18T04:46:05.877 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts 2024-04-18T04:46:05.936 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178 2024-04-18T04:46:05.936 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2024-04-18T04:46:06.062 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts 2024-04-18T04:46:06.092 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts 2024-04-18T04:46:06.160 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname 2024-04-18T04:46:06.229 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2024-04-18T04:46:06.295 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-04-18T04:46:06.353 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T04:46:06.353 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T04:46:06.353 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2024-04-18T04:46:06.353 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2024-04-18T04:46:06.353 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6" 2024-04-18T04:46:06.353 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2024-04-18T04:46:06.354 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T04:46:06.354 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-04-18T04:46:06.354 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T04:46:06.354 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T04:46:06.354 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T04:46:06.354 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T04:46:06.354 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-18T04:46:06.354 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T04:46:06.354 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T04:46:06.354 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T04:46:06.354 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T04:46:06.355 INFO:teuthology.provision.fog.smithi178:Deploy complete! 2024-04-18T04:46:06.355 DEBUG:teuthology.parallel:result is None 2024-04-18T04:46:06.586 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2024-04-18T04:46:06.586 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T04:46:06.616 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2024-04-18T04:46:06.616 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T04:46:06.632 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com 2024-04-18T04:46:06.632 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T04:46:06.650 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2024-04-18T04:46:06.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-04-18T04:46:06.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:46:06.728 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-04-18T04:46:06.871 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-04-18T04:46:06.871 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-04-18T04:46:06.931 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-04-18T04:46:06.932 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-04-18T04:46:06.993 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T04:46:06.993 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T04:46:06.993 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2024-04-18T04:46:06.993 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2024-04-18T04:46:06.993 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6" 2024-04-18T04:46:06.993 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2024-04-18T04:46:06.993 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T04:46:06.993 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-04-18T04:46:06.993 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T04:46:06.993 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T04:46:06.994 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T04:46:06.994 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T04:46:06.994 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-04-18T04:46:06.994 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T04:46:06.994 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T04:46:06.994 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T04:46:06.994 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T04:46:06.994 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-04-18T04:46:07.016 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2024-04-18T04:46:07.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-18T04:46:07.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:46:07.089 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-04-18T04:46:07.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-18T04:46:07.224 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-04-18T04:46:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-04-18T04:46:07.282 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-04-18T04:46:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T04:46:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T04:46:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel" 2024-04-18T04:46:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora" 2024-04-18T04:46:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6" 2024-04-18T04:46:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2024-04-18T04:46:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T04:46:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2024-04-18T04:46:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T04:46:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T04:46:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T04:46:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T04:46:07.340 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-18T04:46:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T04:46:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T04:46:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T04:46:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T04:46:07.340 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-04-18T04:46:07.366 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server 2024-04-18T04:46:07.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-18T04:46:07.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:46:07.442 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-04-18T04:46:07.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-18T04:46:07.507 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-04-18T04:46:07.564 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-04-18T04:46:07.564 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-04-18T04:46:07.621 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T04:46:07.621 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T04:46:07.621 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2024-04-18T04:46:07.621 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2024-04-18T04:46:07.622 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6" 2024-04-18T04:46:07.622 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2024-04-18T04:46:07.622 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T04:46:07.622 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-04-18T04:46:07.622 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T04:46:07.622 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T04:46:07.622 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T04:46:07.622 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T04:46:07.622 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-18T04:46:07.622 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T04:46:07.622 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T04:46:07.622 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T04:46:07.622 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T04:46:07.623 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-04-18T04:46:07.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:46:07.814 INFO:teuthology.dispatcher.supervisor:Running job 7661542 2024-04-18T04:46:07.814 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661542 --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661542/orig.config.yaml 2024-04-18T04:46:07.817 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661542 2024-04-18T04:46:07.818 INFO:teuthology.dispatcher.supervisor:Job PID: 1342004 2024-04-18T04:46:07.818 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T04:48:07.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:50:08.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:52:08.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:54:08.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:56:08.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:58:08.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T05:00:08.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T05:00:08.926 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1