2023-12-19T13:20:03.158 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T13:20:03.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:20:03.294 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f28abd67940>, signals=[15]) 2023-12-19T13:20:03.295 INFO:teuthology.lock.ops:Start node 'smithi028.front.sepia.ceph.com' reimaging 2023-12-19T13:20:03.295 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:20:03.295 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2023-12-19T13:20:03.316 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-12-19T13:20:03.316 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T13:20:03.316 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-12-19T13:20:03.436 DEBUG:teuthology.provision.fog.smithi028:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:20:03.452 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-19T13:20:03.482 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of rhel 8.6 2023-12-19T13:20:03.501 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of rhel 8.6 2023-12-19T13:20:03.721 INFO:teuthology.orchestra.console.smithi028:Power off 2023-12-19T13:20:03.721 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:20:03.737 INFO:teuthology.orchestra.console.smithi118:Power off 2023-12-19T13:20:03.737 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:20:03.745 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off 2023-12-19T13:20:03.745 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:20:03.757 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-12-19T13:20:03.757 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:20:03.765 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2023-12-19T13:20:03.777 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-12-19T13:20:03.867 INFO:teuthology.orchestra.console.smithi028:Power off completed 2023-12-19T13:20:03.878 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-12-19T13:20:03.968 INFO:teuthology.orchestra.console.smithi028:Power on 2023-12-19T13:20:03.968 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:20:03.980 INFO:teuthology.orchestra.console.smithi118:Power on 2023-12-19T13:20:03.980 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T13:20:03.991 DEBUG:teuthology.orchestra.console.smithi028:power on output: Chassis Power Control: Up/On 2023-12-19T13:20:03.991 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:20:04.001 DEBUG:teuthology.orchestra.console.smithi118:power on output: Chassis Power Control: Up/On 2023-12-19T13:20:04.002 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:20:04.012 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2023-12-19T13:20:04.021 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-12-19T13:20:08.013 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:20:08.022 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:20:08.123 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2023-12-19T13:20:08.134 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-12-19T13:20:08.224 INFO:teuthology.orchestra.console.smithi028:Power on completed 2023-12-19T13:20:08.325 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish 2023-12-19T13:20:12.137 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:20:12.246 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-12-19T13:20:12.346 INFO:teuthology.orchestra.console.smithi118:Power on completed 2023-12-19T13:20:12.447 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-12-19T13:22:39.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:22:42.198 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2023-12-19T13:22:48.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:22:51.281 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2023-12-19T13:22:57.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:23:00.337 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2023-12-19T13:23:06.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:23:09.393 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2023-12-19T13:23:15.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:23:18.453 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2023-12-19T13:23:24.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:23:28.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:23:31.409 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-19T13:23:37.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:23:40.469 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-19T13:23:46.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:23:49.553 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-19T13:23:55.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:23:58.613 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-19T13:24:04.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:24:07.697 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-19T13:24:13.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:24:16.753 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-19T13:24:22.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:24:24.463 WARNING:teuthology.provision.fog.smithi028:timed out 2023-12-19T13:24:25.813 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-12-19T13:24:30.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:24:30.731 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:24:30.732 DEBUG:teuthology.orchestra.run.smithi028:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:24:31.027 INFO:teuthology.provision.fog.smithi028:Node is ready 2023-12-19T13:24:31.027 DEBUG:teuthology.orchestra.run.smithi028:> hostname 2023-12-19T13:24:31.048 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com 2023-12-19T13:24:31.048 DEBUG:teuthology.orchestra.run.smithi028:> grep smithi028.front.sepia.ceph.com /etc/hosts 2023-12-19T13:24:31.109 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028 2023-12-19T13:24:31.110 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028 2023-12-19T13:24:31.227 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hosts 2023-12-19T13:24:31.261 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/172.21.15.28/172.21.15.28/g' /etc/hosts 2023-12-19T13:24:31.336 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hostname 2023-12-19T13:24:31.411 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028 2023-12-19T13:24:31.487 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2023-12-19T13:24:31.549 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:24:31.549 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:24:31.549 INFO:teuthology.orchestra.run.smithi028.stdout:ID="rhel" 2023-12-19T13:24:31.549 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="fedora" 2023-12-19T13:24:31.549 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="8.6" 2023-12-19T13:24:31.549 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:24:31.549 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:24:31.549 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2023-12-19T13:24:31.549 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:24:31.549 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:24:31.549 INFO:teuthology.orchestra.run.smithi028.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:24:31.550 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:24:31.550 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-19T13:24:31.550 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:24:31.550 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:24:31.550 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:24:31.550 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:24:31.551 INFO:teuthology.provision.fog.smithi028:Deploy complete! 2023-12-19T13:24:31.552 DEBUG:teuthology.parallel:result is None 2023-12-19T13:24:31.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:25:31.874 WARNING:teuthology.provision.fog.smithi118:timed out 2023-12-19T13:25:37.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:25:38.127 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T13:25:38.127 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T13:25:38.411 INFO:teuthology.provision.fog.smithi118:Node is ready 2023-12-19T13:25:38.411 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2023-12-19T13:25:38.431 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com 2023-12-19T13:25:38.431 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts 2023-12-19T13:25:38.491 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2023-12-19T13:25:38.492 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-12-19T13:25:38.617 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts 2023-12-19T13:25:38.648 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts 2023-12-19T13:25:38.718 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname 2023-12-19T13:25:38.787 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-12-19T13:25:38.854 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-12-19T13:25:38.912 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:25:38.912 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:25:38.912 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-12-19T13:25:38.912 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-12-19T13:25:38.912 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.6" 2023-12-19T13:25:38.912 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:25:38.912 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:25:38.913 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-12-19T13:25:38.913 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:25:38.913 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:25:38.913 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:25:38.913 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:25:38.913 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-12-19T13:25:38.913 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:25:38.913 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:25:38.913 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:25:38.913 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:25:38.913 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2023-12-19T13:25:38.914 DEBUG:teuthology.parallel:result is None 2023-12-19T13:25:39.068 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com 2023-12-19T13:25:39.068 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:25:39.094 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2023-12-19T13:25:39.094 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T13:25:39.120 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:25:39.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-12-19T13:25:39.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:25:39.190 DEBUG:teuthology.orchestra.run.smithi028:> true 2023-12-19T13:25:39.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-12-19T13:25:39.333 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2023-12-19T13:25:39.395 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2023-12-19T13:25:39.395 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2023-12-19T13:25:39.457 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:25:39.457 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:25:39.457 INFO:teuthology.orchestra.run.smithi028.stdout:ID="rhel" 2023-12-19T13:25:39.457 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="fedora" 2023-12-19T13:25:39.457 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="8.6" 2023-12-19T13:25:39.457 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:25:39.457 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:25:39.457 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2023-12-19T13:25:39.457 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:25:39.457 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:25:39.457 INFO:teuthology.orchestra.run.smithi028.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:25:39.457 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:25:39.457 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-19T13:25:39.458 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:25:39.458 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:25:39.458 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:25:39.458 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:25:39.458 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2023-12-19T13:25:39.485 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2023-12-19T13:25:39.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-12-19T13:25:39.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T13:25:39.552 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-12-19T13:25:39.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-12-19T13:25:39.622 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-12-19T13:25:39.680 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-12-19T13:25:39.680 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-12-19T13:25:39.737 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.6 (Ootpa)" 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.6" 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T13:25:39.738 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-19T13:25:39.739 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T13:25:39.739 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-19T13:25:39.739 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-12-19T13:25:39.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:25:39.867 INFO:teuthology.dispatcher.supervisor:Running job 7496759 2023-12-19T13:25:39.867 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496759 --name rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} -- /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496759/orig.config.yaml 2023-12-19T13:25:39.870 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496759 2023-12-19T13:25:39.871 INFO:teuthology.dispatcher.supervisor:Job PID: 1112733 2023-12-19T13:25:39.871 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T13:27:39.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:29:40.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:31:40.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:33:40.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:35:40.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T13:35:40.726 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T13:35:40.833 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T13:35:40.833 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T13:35:40.886 DEBUG:teuthology.nuke:shortname: smithi028 2023-12-19T13:35:40.886 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:35:40.900 DEBUG:teuthology.nuke:shortname: smithi118 2023-12-19T13:35:40.900 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T13:35:40.907 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496759', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:20:02.346115', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqO4QAeQ83zMPKA4tEaPJjFNVJL/7g7RgHPlh72m7iF78e+SvZNOGJVFGAfapEoF8Tro6fF3VcATlpk9jpefhk='} 2023-12-19T13:35:40.919 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496759', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:20:02.347535', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOhQfSu+L123mzuHJjZ7sJ8HXPnblD159CWnAmrmu4NtgzV9wz3I0p07mrt+sKAw+KDAJ7zGE9WBh6ZQh8r6jGo='} 2023-12-19T13:35:40.957 INFO:teuthology.orchestra.console.smithi028:Power off 2023-12-19T13:35:40.957 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:35:40.971 INFO:teuthology.orchestra.console.smithi118:Power off 2023-12-19T13:35:40.971 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T13:35:40.979 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off 2023-12-19T13:35:40.979 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:35:40.992 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-12-19T13:35:40.992 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T13:35:41.001 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2023-12-19T13:35:41.015 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-12-19T13:35:41.102 INFO:teuthology.orchestra.console.smithi028:Power off completed 2023-12-19T13:35:41.116 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-12-19T13:35:41.249 INFO:teuthology.lock.ops:unlocked: smithi028.front.sepia.ceph.com 2023-12-19T13:35:41.266 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com