2023-12-19T13:40:09.678 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T13:40:09.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:40:09.830 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa298029940>, signals=[15]) 2023-12-19T13:40:09.831 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-12-19T13:40:09.831 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:40:09.831 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-12-19T13:40:09.864 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-12-19T13:40:09.865 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:40:09.865 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-12-19T13:40:10.009 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:40:10.049 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:40:10.059 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of rhel 8.6 2023-12-19T13:40:10.096 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of rhel 8.6 2023-12-19T13:40:10.392 INFO:teuthology.orchestra.console.smithi161:Power off 2023-12-19T13:40:10.392 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:40:10.405 INFO:teuthology.orchestra.console.smithi179:Power off 2023-12-19T13:40:10.405 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:40:10.413 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-12-19T13:40:10.413 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:10.425 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-12-19T13:40:10.425 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:10.434 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-19T13:40:10.448 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-12-19T13:40:10.535 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-12-19T13:40:10.549 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-12-19T13:40:10.637 INFO:teuthology.orchestra.console.smithi161:Power on 2023-12-19T13:40:10.637 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:40:10.650 INFO:teuthology.orchestra.console.smithi179:Power on 2023-12-19T13:40:10.650 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:40:10.658 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2023-12-19T13:40:10.658 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:10.671 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2023-12-19T13:40:10.671 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:10.679 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-19T13:40:10.692 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-12-19T13:40:14.683 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:14.693 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:14.793 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-19T13:40:14.801 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-12-19T13:40:18.797 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:18.804 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:40:18.906 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-12-19T13:40:18.912 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-12-19T13:40:19.008 INFO:teuthology.orchestra.console.smithi161:Power on completed 2023-12-19T13:40:19.013 INFO:teuthology.orchestra.console.smithi179:Power on completed 2023-12-19T13:40:19.109 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-12-19T13:40:19.114 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-12-19T13:43:05.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:05.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:08.438 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-12-19T13:43:08.469 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T13:43:14.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:14.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:17.521 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-12-19T13:43:17.522 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T13:43:23.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:23.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:26.581 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-12-19T13:43:26.609 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T13:43:32.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:32.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:35.665 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-12-19T13:43:35.666 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T13:43:41.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:41.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:44.757 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-12-19T13:43:44.758 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T13:43:50.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:50.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:43:53.841 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T13:43:59.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:02.901 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-12-19T13:44:08.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:50.806 WARNING:teuthology.provision.fog.smithi179:timed out 2023-12-19T13:44:56.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:44:57.033 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:44:57.034 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:44:57.270 INFO:teuthology.provision.fog.smithi179:Node is ready 2023-12-19T13:44:57.270 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2023-12-19T13:44:57.287 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179 2023-12-19T13:44:57.287 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179 /etc/hosts 2023-12-19T13:44:57.345 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2023-12-19T13:44:57.346 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-12-19T13:44:57.468 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179/smithi179/g' /etc/hosts 2023-12-19T13:44:57.496 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2023-12-19T13:44:57.564 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179/smithi179/g' /etc/hostname 2023-12-19T13:44:57.632 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-12-19T13:44:57.699 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-12-19T13:44:57.756 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:44:57.756 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:44:57.756 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-12-19T13:44:57.756 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-12-19T13:44:57.756 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6" 2023-12-19T13:44:57.757 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:44:57.757 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:44:57.757 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-12-19T13:44:57.757 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:44:57.757 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:44:57.757 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:44:57.757 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:44:57.757 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-19T13:44:57.757 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:44:57.757 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:44:57.757 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:44:57.757 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:44:57.758 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2023-12-19T13:44:57.759 DEBUG:teuthology.parallel:result is None 2023-12-19T13:45:08.917 WARNING:teuthology.provision.fog.smithi161:timed out 2023-12-19T13:45:14.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:45:15.121 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:45:15.121 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:45:15.390 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-12-19T13:45:15.390 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-12-19T13:45:15.410 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161 2023-12-19T13:45:15.410 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161 /etc/hosts 2023-12-19T13:45:15.469 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-12-19T13:45:15.469 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-12-19T13:45:15.584 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161/smithi161/g' /etc/hosts 2023-12-19T13:45:15.612 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-12-19T13:45:15.680 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161/smithi161/g' /etc/hostname 2023-12-19T13:45:15.749 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-12-19T13:45:15.816 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-12-19T13:45:15.874 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:45:15.874 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:45:15.874 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel" 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora" 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6" 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:45:15.875 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:45:15.876 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-12-19T13:45:15.876 DEBUG:teuthology.parallel:result is None 2023-12-19T13:45:16.056 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-12-19T13:45:16.057 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:45:16.088 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2023-12-19T13:45:16.088 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:45:16.114 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:45:16.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-19T13:45:16.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:45:16.180 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-12-19T13:45:16.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-12-19T13:45:16.246 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-12-19T13:45:16.302 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-12-19T13:45:16.303 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-12-19T13:45:16.360 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:45:16.360 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:45:16.360 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel" 2023-12-19T13:45:16.360 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora" 2023-12-19T13:45:16.360 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6" 2023-12-19T13:45:16.360 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:45:16.360 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:45:16.360 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-12-19T13:45:16.360 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:45:16.360 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:45:16.361 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:45:16.361 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:45:16.361 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-12-19T13:45:16.361 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:45:16.361 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:45:16.361 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:45:16.361 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:45:16.361 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-12-19T13:45:16.388 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:45:16.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-12-19T13:45:16.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:45:16.454 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-12-19T13:45:16.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-12-19T13:45:16.584 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-12-19T13:45:16.642 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-12-19T13:45:16.645 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-12-19T13:45:16.699 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:45:16.699 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:45:16.699 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-12-19T13:45:16.699 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-12-19T13:45:16.699 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6" 2023-12-19T13:45:16.699 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:45:16.700 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:45:16.700 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-12-19T13:45:16.700 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:45:16.700 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:45:16.700 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:45:16.700 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:45:16.700 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-19T13:45:16.700 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:45:16.700 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:45:16.700 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:45:16.700 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:45:16.701 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-12-19T13:45:16.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:45:16.802 INFO:teuthology.dispatcher.supervisor:Running job 7496804 2023-12-19T13:45:16.803 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496804 --name rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap_schedule_snapdir} -- /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496804/orig.config.yaml 2023-12-19T13:45:16.805 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496804 2023-12-19T13:45:16.806 INFO:teuthology.dispatcher.supervisor:Job PID: 1360182 2023-12-19T13:45:16.806 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T13:47:16.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:49:17.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:51:17.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:53:17.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:53:17.475 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T13:53:17.603 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T13:53:17.604 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T13:53:17.642 DEBUG:teuthology.nuke:shortname: smithi161 2023-12-19T13:53:17.642 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:53:17.665 DEBUG:teuthology.nuke:shortname: smithi179 2023-12-19T13:53:17.666 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:53:17.669 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496804', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:40:08.842318', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHV+Do8FQO14x3hrpaDoG+vCTV3RcAdvBfj835WhKw3h182Gz+rNuUj/Q5nXsc3f2X6ZY1YanUksSu4LF/1xK60='} 2023-12-19T13:53:17.692 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496804', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:40:08.840893', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBACqId8KlXupxBDsvu/bexRbd6USl0Bzjktp0uksMag+3GTHsM0CcgFPladPqSDBwb72Efe4b4IsbZG0hV3XFfA='} 2023-12-19T13:53:17.722 INFO:teuthology.orchestra.console.smithi161:Power off 2023-12-19T13:53:17.722 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:53:17.747 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-12-19T13:53:17.748 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:53:17.763 INFO:teuthology.orchestra.console.smithi179:Power off 2023-12-19T13:53:17.764 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:53:17.773 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-12-19T13:53:17.785 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-12-19T13:53:17.786 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:53:17.807 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-12-19T13:53:17.874 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-12-19T13:53:17.908 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-12-19T13:53:18.023 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com 2023-12-19T13:53:18.048 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com