2024-01-24T08:28:03.998 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-24T08:28:03.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T08:28:04.188 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f14837d4c10>, signals=[15]) 2024-01-24T08:28:04.189 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2024-01-24T08:28:04.189 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2024-01-24T08:28:04.189 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-01-24T08:28:04.206 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2024-01-24T08:28:04.207 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2024-01-24T08:28:04.207 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-01-24T08:28:04.231 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2024-01-24T08:28:04.231 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2024-01-24T08:28:04.231 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-01-24T08:28:04.310 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-24T08:28:04.349 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of rhel 8.6 2024-01-24T08:28:04.353 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-24T08:28:04.369 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-24T08:28:04.409 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of rhel 8.6 2024-01-24T08:28:04.418 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of rhel 8.6 2024-01-24T08:28:04.651 INFO:teuthology.orchestra.console.smithi005:Power off 2024-01-24T08:28:04.651 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T08:28:04.676 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-01-24T08:28:04.676 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:04.692 INFO:teuthology.orchestra.console.smithi133:Power off 2024-01-24T08:28:04.692 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T08:28:04.704 INFO:teuthology.orchestra.console.smithi129:Power off 2024-01-24T08:28:04.704 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T08:28:04.711 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-01-24T08:28:04.713 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-01-24T08:28:04.713 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:04.727 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2024-01-24T08:28:04.727 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:04.735 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-24T08:28:04.748 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-01-24T08:28:08.716 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:08.737 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:08.749 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:08.825 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-01-24T08:28:08.846 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-24T08:28:08.857 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-01-24T08:28:12.828 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:12.847 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:12.857 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:12.938 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-01-24T08:28:12.956 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-24T08:28:12.967 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-01-24T08:28:13.039 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-01-24T08:28:13.057 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-01-24T08:28:13.067 INFO:teuthology.orchestra.console.smithi129:Power off completed 2024-01-24T08:28:13.141 INFO:teuthology.orchestra.console.smithi005:Power on 2024-01-24T08:28:13.141 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-24T08:28:13.158 INFO:teuthology.orchestra.console.smithi133:Power on 2024-01-24T08:28:13.158 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-24T08:28:13.167 DEBUG:teuthology.orchestra.console.smithi005:power on output: Chassis Power Control: Up/On 2024-01-24T08:28:13.167 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:13.175 INFO:teuthology.orchestra.console.smithi129:Power on 2024-01-24T08:28:13.175 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-24T08:28:13.185 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2024-01-24T08:28:13.186 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:13.198 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-01-24T08:28:13.199 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2024-01-24T08:28:13.199 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:13.214 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-24T08:28:13.221 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-01-24T08:28:17.200 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:17.215 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:17.227 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:17.310 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-01-24T08:28:17.329 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-24T08:28:17.336 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-01-24T08:28:21.312 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:21.330 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:21.337 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:28:21.438 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-24T08:28:21.446 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-01-24T08:28:21.539 INFO:teuthology.orchestra.console.smithi133:Power on completed 2024-01-24T08:28:21.541 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-01-24T08:28:21.547 INFO:teuthology.orchestra.console.smithi129:Power on completed 2024-01-24T08:28:21.641 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2024-01-24T08:28:21.645 INFO:teuthology.orchestra.console.smithi005:Power on completed 2024-01-24T08:28:21.648 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2024-01-24T08:28:21.746 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2024-01-24T08:30:52.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:30:55.676 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-01-24T08:31:01.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:04.732 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-01-24T08:31:07.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:07.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:10.716 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-01-24T08:31:10.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:10.752 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-24T08:31:13.792 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-01-24T08:31:16.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:16.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:19.772 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-01-24T08:31:19.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:19.808 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-24T08:31:22.844 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-01-24T08:31:25.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:25.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:28.828 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-01-24T08:31:28.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:28.864 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-24T08:31:31.900 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-01-24T08:31:34.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:34.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:37.884 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-01-24T08:31:37.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:37.916 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-24T08:31:40.960 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-01-24T08:31:43.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:43.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:46.944 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-01-24T08:31:46.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:46.976 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-24T08:31:52.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:52.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:31:56.032 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-01-24T08:31:56.032 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-24T08:32:02.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:32:02.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:32:05.120 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-01-24T08:32:11.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:32:42.796 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-24T08:32:42.796 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-24T08:32:46.965 WARNING:teuthology.provision.fog.smithi005:timed out 2024-01-24T08:32:52.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:32:53.188 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-24T08:32:53.188 DEBUG:teuthology.orchestra.run.smithi005:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-24T08:32:53.462 INFO:teuthology.provision.fog.smithi005:Node is ready 2024-01-24T08:32:53.462 DEBUG:teuthology.orchestra.run.smithi005:> hostname 2024-01-24T08:32:53.483 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2024-01-24T08:32:53.483 DEBUG:teuthology.orchestra.run.smithi005:> grep smithi005.front.sepia.ceph.com /etc/hosts 2024-01-24T08:32:53.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2024-01-24T08:32:53.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-01-24T08:32:53.665 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hosts 2024-01-24T08:32:53.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.5/172.21.15.5/g' /etc/hosts 2024-01-24T08:32:53.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hostname 2024-01-24T08:32:53.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-01-24T08:32:53.925 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-01-24T08:32:53.987 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T08:32:53.988 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T08:32:53.988 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2024-01-24T08:32:53.988 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2024-01-24T08:32:53.988 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6" 2024-01-24T08:32:53.988 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2024-01-24T08:32:53.988 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T08:32:53.988 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-01-24T08:32:53.988 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T08:32:53.988 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T08:32:53.988 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T08:32:53.988 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T08:32:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T08:32:53.989 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T08:32:53.989 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T08:32:53.989 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T08:32:53.989 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T08:32:53.990 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2024-01-24T08:32:53.991 DEBUG:teuthology.parallel:result is None 2024-01-24T08:33:02.040 WARNING:teuthology.provision.fog.smithi133:timed out 2024-01-24T08:33:08.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:33:08.272 INFO:teuthology.provision.fog.smithi129:Node is ready 2024-01-24T08:33:08.272 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2024-01-24T08:33:08.295 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2024-01-24T08:33:08.295 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2024-01-24T08:33:08.327 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-24T08:33:08.327 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-24T08:33:08.354 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2024-01-24T08:33:08.355 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2024-01-24T08:33:08.467 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2024-01-24T08:33:08.497 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2024-01-24T08:33:08.564 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2024-01-24T08:33:08.585 INFO:teuthology.provision.fog.smithi133:Node is ready 2024-01-24T08:33:08.586 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2024-01-24T08:33:08.604 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2024-01-24T08:33:08.605 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2024-01-24T08:33:08.633 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2024-01-24T08:33:08.662 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2024-01-24T08:33:08.662 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-01-24T08:33:08.699 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-01-24T08:33:08.757 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T08:33:08.757 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T08:33:08.757 INFO:teuthology.orchestra.run.smithi129.stdout:ID="rhel" 2024-01-24T08:33:08.757 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="fedora" 2024-01-24T08:33:08.757 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8.6" 2024-01-24T08:33:08.757 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2024-01-24T08:33:08.757 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T08:33:08.757 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-01-24T08:33:08.757 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T08:33:08.758 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T08:33:08.758 INFO:teuthology.orchestra.run.smithi129.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T08:33:08.758 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T08:33:08.758 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-01-24T08:33:08.758 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T08:33:08.758 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T08:33:08.758 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T08:33:08.758 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T08:33:08.759 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2024-01-24T08:33:08.759 DEBUG:teuthology.parallel:result is None 2024-01-24T08:33:08.771 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2024-01-24T08:33:08.799 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2024-01-24T08:33:08.868 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2024-01-24T08:33:08.936 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-01-24T08:33:09.003 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-01-24T08:33:09.060 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T08:33:09.060 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T08:33:09.060 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2024-01-24T08:33:09.060 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2024-01-24T08:33:09.060 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6" 2024-01-24T08:33:09.060 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-01-24T08:33:09.060 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T08:33:09.060 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-01-24T08:33:09.060 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T08:33:09.061 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T08:33:09.063 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T08:33:09.064 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T08:33:09.064 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-24T08:33:09.064 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T08:33:09.064 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T08:33:09.064 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T08:33:09.064 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T08:33:09.064 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2024-01-24T08:33:09.065 DEBUG:teuthology.parallel:result is None 2024-01-24T08:33:09.257 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2024-01-24T08:33:09.257 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-24T08:33:09.288 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2024-01-24T08:33:09.288 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-24T08:33:09.304 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2024-01-24T08:33:09.305 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-24T08:33:09.322 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2024-01-24T08:33:09.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-01-24T08:33:09.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:33:09.397 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-01-24T08:33:09.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-01-24T08:33:09.540 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-01-24T08:33:09.601 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-01-24T08:33:09.602 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-01-24T08:33:09.663 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T08:33:09.663 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T08:33:09.663 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2024-01-24T08:33:09.663 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2024-01-24T08:33:09.663 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6" 2024-01-24T08:33:09.663 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2024-01-24T08:33:09.663 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T08:33:09.663 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-01-24T08:33:09.664 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T08:33:09.664 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T08:33:09.664 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T08:33:09.664 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T08:33:09.664 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T08:33:09.664 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T08:33:09.664 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T08:33:09.664 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T08:33:09.664 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T08:33:09.665 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-01-24T08:33:09.689 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2024-01-24T08:33:09.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-01-24T08:33:09.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:33:09.762 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-01-24T08:33:09.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-01-24T08:33:09.836 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-01-24T08:33:09.894 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-01-24T08:33:09.894 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-01-24T08:33:09.953 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T08:33:09.953 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T08:33:09.953 INFO:teuthology.orchestra.run.smithi129.stdout:ID="rhel" 2024-01-24T08:33:09.953 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="fedora" 2024-01-24T08:33:09.954 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8.6" 2024-01-24T08:33:09.954 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2024-01-24T08:33:09.954 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T08:33:09.954 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-01-24T08:33:09.954 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T08:33:09.954 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T08:33:09.954 INFO:teuthology.orchestra.run.smithi129.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T08:33:09.954 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T08:33:09.954 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-01-24T08:33:09.954 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T08:33:09.954 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T08:33:09.954 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T08:33:09.954 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T08:33:09.955 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-01-24T08:33:09.980 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2024-01-24T08:33:09.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-24T08:33:09.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T08:33:10.054 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-01-24T08:33:10.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-24T08:33:10.123 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-01-24T08:33:10.182 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-01-24T08:33:10.182 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-01-24T08:33:10.240 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T08:33:10.241 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T08:33:10.241 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2024-01-24T08:33:10.241 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2024-01-24T08:33:10.241 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6" 2024-01-24T08:33:10.241 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-01-24T08:33:10.241 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T08:33:10.241 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-01-24T08:33:10.241 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T08:33:10.241 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T08:33:10.241 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T08:33:10.241 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T08:33:10.241 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-24T08:33:10.241 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T08:33:10.242 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T08:33:10.242 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T08:33:10.242 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T08:33:10.242 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-01-24T08:33:10.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T08:33:10.367 INFO:teuthology.dispatcher.supervisor:Running job 7528197 2024-01-24T08:33:10.367 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528197 --name vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528197/orig.config.yaml 2024-01-24T08:33:10.371 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528197 2024-01-24T08:33:10.371 INFO:teuthology.dispatcher.supervisor:Job PID: 1457434 2024-01-24T08:33:10.371 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-24T08:35:10.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T08:37:10.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T08:39:10.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T08:41:11.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T08:43:11.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T08:45:11.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T08:47:11.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T08:49:11.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T08:51:12.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T08:53:12.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T08:53:12.295 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-24T08:53:12.445 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-24T08:53:12.445 INFO:teuthology.nuke:Checking targets against current locks 2024-01-24T08:53:12.494 DEBUG:teuthology.nuke:shortname: smithi005 2024-01-24T08:53:12.494 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T08:53:12.521 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528197', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 08:28:02.916896', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHHFiENyGKfeKqXsb40Hks/1dG7w9YsYWZ+kk/mj92p60kZ90gjUSSn9fHCZJrTFZlmdodbrdw7XPPY5nv1SgzE='} 2024-01-24T08:53:12.525 DEBUG:teuthology.nuke:shortname: smithi129 2024-01-24T08:53:12.525 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T08:53:12.554 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528197', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 08:28:02.918124', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNZU+ACs4sCfqKWfIHLdbD6R7jMvNNWFDbJ2VMKLt49OdUsTKU6mCaNnnTgaPh1XRBptyO2oN0fLtdGNfF0aMnY='} 2024-01-24T08:53:12.555 DEBUG:teuthology.nuke:shortname: smithi133 2024-01-24T08:53:12.555 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T08:53:12.582 INFO:teuthology.orchestra.console.smithi005:Power off 2024-01-24T08:53:12.582 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T08:53:12.592 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528197', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 08:28:02.915473', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGKWsRZ5vPG8Zx45pIgZXVaE7ggxOvFf7ZVoRYdPiJA6TS8qWptZ9WQXeAQMqOf+zp34BP3XxYKXPLsgziFnTGk='} 2024-01-24T08:53:12.626 INFO:teuthology.orchestra.console.smithi129:Power off 2024-01-24T08:53:12.626 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T08:53:12.634 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-01-24T08:53:12.634 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:53:12.647 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2024-01-24T08:53:12.647 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:53:12.660 INFO:teuthology.orchestra.console.smithi133:Power off 2024-01-24T08:53:12.660 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T08:53:12.668 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-01-24T08:53:12.668 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-01-24T08:53:12.682 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-01-24T08:53:12.682 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T08:53:12.702 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-24T08:53:12.768 INFO:teuthology.orchestra.console.smithi129:Power off completed 2024-01-24T08:53:12.769 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-01-24T08:53:12.803 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-01-24T08:53:12.926 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com 2024-01-24T08:53:12.936 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com 2024-01-24T08:53:12.952 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com