2023-12-25T06:43:39.861 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-25T06:43:39.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-25T06:43:40.023 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f23bea92940>, signals=[15]) 2023-12-25T06:43:40.023 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging 2023-12-25T06:43:40.023 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server 2023-12-25T06:43:40.024 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2023-12-25T06:43:40.044 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2023-12-25T06:43:40.044 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2023-12-25T06:43:40.044 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-12-25T06:43:40.060 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-12-25T06:43:40.060 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-12-25T06:43:40.060 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-12-25T06:43:40.150 DEBUG:teuthology.provision.fog.smithi047:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-25T06:43:40.164 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-25T06:43:40.203 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-25T06:43:40.208 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of rhel 8.4 2023-12-25T06:43:40.213 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of rhel 8.4 2023-12-25T06:43:40.255 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of rhel 8.4 2023-12-25T06:43:40.836 INFO:teuthology.orchestra.console.smithi110:Power off 2023-12-25T06:43:40.836 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-25T06:43:40.857 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-12-25T06:43:40.857 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:40.875 INFO:teuthology.orchestra.console.smithi047:Power off 2023-12-25T06:43:40.876 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-25T06:43:40.883 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-12-25T06:43:40.896 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2023-12-25T06:43:40.897 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:40.918 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2023-12-25T06:43:40.924 INFO:teuthology.orchestra.console.smithi152:Power off 2023-12-25T06:43:40.925 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-25T06:43:40.947 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-12-25T06:43:40.947 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:40.968 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-25T06:43:44.885 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:44.919 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:44.969 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:44.994 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-12-25T06:43:45.027 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2023-12-25T06:43:45.077 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-25T06:43:48.997 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:49.027 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:49.078 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:49.105 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-12-25T06:43:49.138 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2023-12-25T06:43:49.185 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-25T06:43:49.240 INFO:teuthology.orchestra.console.smithi047:Power off completed 2023-12-25T06:43:49.340 INFO:teuthology.orchestra.console.smithi047:Power on 2023-12-25T06:43:49.340 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-25T06:43:49.362 DEBUG:teuthology.orchestra.console.smithi047:power on output: Chassis Power Control: Up/On 2023-12-25T06:43:49.362 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:49.383 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2023-12-25T06:43:53.110 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:53.186 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:53.218 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-12-25T06:43:53.293 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-25T06:43:53.320 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-12-25T06:43:53.384 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:53.395 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-12-25T06:43:53.420 INFO:teuthology.orchestra.console.smithi110:Power on 2023-12-25T06:43:53.420 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-25T06:43:53.440 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On 2023-12-25T06:43:53.441 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:53.459 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-12-25T06:43:53.491 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2023-12-25T06:43:53.496 INFO:teuthology.orchestra.console.smithi152:Power on 2023-12-25T06:43:53.496 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-25T06:43:53.514 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On 2023-12-25T06:43:53.515 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:53.534 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-25T06:43:57.464 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:57.492 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:57.535 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:43:57.574 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-12-25T06:43:57.600 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2023-12-25T06:43:57.643 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-25T06:43:57.674 INFO:teuthology.orchestra.console.smithi110:Power on completed 2023-12-25T06:43:57.701 INFO:teuthology.orchestra.console.smithi047:Power on completed 2023-12-25T06:43:57.775 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2023-12-25T06:43:57.801 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish 2023-12-25T06:44:01.647 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T06:44:01.757 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-25T06:44:01.857 INFO:teuthology.orchestra.console.smithi152:Power on completed 2023-12-25T06:44:01.958 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-12-25T06:47:33.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:47:36.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:47:39.538 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-25T06:47:45.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:47:48.625 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-25T06:47:51.570 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-12-25T06:47:54.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:47:57.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:47:57.681 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-25T06:48:00.626 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-12-25T06:48:03.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:48:06.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:48:06.741 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-25T06:48:09.682 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-12-25T06:48:12.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:48:15.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:48:15.825 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-25T06:48:21.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:48:24.881 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-25T06:48:30.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:48:34.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:48:52.498 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-12-25T06:48:58.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:49:01.553 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-12-25T06:49:07.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:49:10.610 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-12-25T06:49:15.691 WARNING:teuthology.provision.fog.smithi047:timed out 2023-12-25T06:49:16.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:49:19.665 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-12-25T06:49:21.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:49:22.101 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-25T06:49:22.102 DEBUG:teuthology.orchestra.run.smithi047:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-25T06:49:22.362 INFO:teuthology.provision.fog.smithi047:Node is ready 2023-12-25T06:49:22.362 DEBUG:teuthology.orchestra.run.smithi047:> hostname 2023-12-25T06:49:22.376 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com 2023-12-25T06:49:22.376 DEBUG:teuthology.orchestra.run.smithi047:> grep smithi047.front.sepia.ceph.com /etc/hosts 2023-12-25T06:49:22.430 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047 2023-12-25T06:49:22.430 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2023-12-25T06:49:22.555 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hosts 2023-12-25T06:49:22.579 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/172.21.15.47/172.21.15.47/g' /etc/hosts 2023-12-25T06:49:22.644 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hostname 2023-12-25T06:49:22.708 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2023-12-25T06:49:22.773 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2023-12-25T06:49:22.827 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Red Hat Enterprise Linux" 2023-12-25T06:49:22.828 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8.4 (Ootpa)" 2023-12-25T06:49:22.828 INFO:teuthology.orchestra.run.smithi047.stdout:ID="rhel" 2023-12-25T06:49:22.828 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="fedora" 2023-12-25T06:49:22.828 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8.4" 2023-12-25T06:49:22.828 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8" 2023-12-25T06:49:22.828 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-25T06:49:22.828 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2023-12-25T06:49:22.828 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-25T06:49:22.828 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.redhat.com/" 2023-12-25T06:49:22.828 INFO:teuthology.orchestra.run.smithi047.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-25T06:49:22.828 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-25T06:49:22.828 INFO:teuthology.orchestra.run.smithi047.stdout: 2023-12-25T06:49:22.829 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-25T06:49:22.829 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-25T06:49:22.829 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-25T06:49:22.829 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-25T06:49:22.829 INFO:teuthology.provision.fog.smithi047:Deploy complete! 2023-12-25T06:49:22.831 DEBUG:teuthology.parallel:result is None 2023-12-25T06:49:25.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:49:30.891 WARNING:teuthology.provision.fog.smithi152:timed out 2023-12-25T06:49:36.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:49:37.318 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-25T06:49:37.318 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-25T06:49:37.538 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-12-25T06:49:37.539 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2023-12-25T06:49:37.596 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2023-12-25T06:49:37.596 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2023-12-25T06:49:37.653 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2023-12-25T06:49:37.653 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-12-25T06:49:37.792 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2023-12-25T06:49:37.816 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2023-12-25T06:49:37.883 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2023-12-25T06:49:37.949 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-12-25T06:49:38.016 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-12-25T06:49:38.073 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2023-12-25T06:49:38.073 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.4 (Ootpa)" 2023-12-25T06:49:38.073 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2023-12-25T06:49:38.073 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2023-12-25T06:49:38.073 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.4" 2023-12-25T06:49:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-12-25T06:49:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-25T06:49:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-12-25T06:49:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-25T06:49:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2023-12-25T06:49:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-25T06:49:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-25T06:49:38.074 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-25T06:49:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-25T06:49:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-25T06:49:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-25T06:49:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-25T06:49:38.075 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-12-25T06:49:38.075 DEBUG:teuthology.parallel:result is None 2023-12-25T06:49:44.210 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-12-25T06:49:50.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:49:53.298 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-12-25T06:49:59.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:50:02.353 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-12-25T06:50:08.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:50:08.855 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-25T06:50:08.855 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-25T06:50:24.719 INFO:teuthology.provision.fog.smithi110:Node is ready 2023-12-25T06:50:24.719 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2023-12-25T06:50:24.735 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2023-12-25T06:50:24.735 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts 2023-12-25T06:50:24.791 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2023-12-25T06:50:24.791 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-12-25T06:50:24.955 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts 2023-12-25T06:50:24.980 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2023-12-25T06:50:25.044 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname 2023-12-25T06:50:25.107 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-12-25T06:50:25.170 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-12-25T06:50:25.224 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2023-12-25T06:50:25.224 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.4 (Ootpa)" 2023-12-25T06:50:25.224 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2023-12-25T06:50:25.224 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2023-12-25T06:50:25.224 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.4" 2023-12-25T06:50:25.224 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-12-25T06:50:25.224 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-25T06:50:25.224 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-12-25T06:50:25.224 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-25T06:50:25.224 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2023-12-25T06:50:25.224 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-25T06:50:25.225 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-25T06:50:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-12-25T06:50:25.225 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-25T06:50:25.225 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-25T06:50:25.225 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-25T06:50:25.225 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-25T06:50:25.225 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2023-12-25T06:50:25.225 DEBUG:teuthology.parallel:result is None 2023-12-25T06:50:25.445 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com 2023-12-25T06:50:25.445 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-25T06:50:25.465 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2023-12-25T06:50:25.466 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-25T06:50:25.482 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2023-12-25T06:50:25.482 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-25T06:50:25.499 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server 2023-12-25T06:50:25.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2023-12-25T06:50:25.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:50:25.567 DEBUG:teuthology.orchestra.run.smithi047:> true 2023-12-25T06:50:25.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2023-12-25T06:50:25.689 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2023-12-25T06:50:25.743 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2023-12-25T06:50:25.744 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2023-12-25T06:50:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Red Hat Enterprise Linux" 2023-12-25T06:50:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8.4 (Ootpa)" 2023-12-25T06:50:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:ID="rhel" 2023-12-25T06:50:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="fedora" 2023-12-25T06:50:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8.4" 2023-12-25T06:50:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8" 2023-12-25T06:50:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-25T06:50:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2023-12-25T06:50:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-25T06:50:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.redhat.com/" 2023-12-25T06:50:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-25T06:50:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-25T06:50:25.799 INFO:teuthology.orchestra.run.smithi047.stdout: 2023-12-25T06:50:25.800 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-25T06:50:25.800 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-25T06:50:25.800 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-25T06:50:25.800 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-25T06:50:25.800 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2023-12-25T06:50:25.832 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2023-12-25T06:50:25.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-12-25T06:50:25.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:50:25.897 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-12-25T06:50:25.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-12-25T06:50:25.919 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2023-12-25T06:50:25.974 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-12-25T06:50:25.975 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-12-25T06:50:26.029 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2023-12-25T06:50:26.030 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.4 (Ootpa)" 2023-12-25T06:50:26.030 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2023-12-25T06:50:26.030 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2023-12-25T06:50:26.030 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.4" 2023-12-25T06:50:26.030 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-12-25T06:50:26.030 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-25T06:50:26.030 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-12-25T06:50:26.030 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-25T06:50:26.030 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2023-12-25T06:50:26.030 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-25T06:50:26.030 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-25T06:50:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-12-25T06:50:26.031 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-25T06:50:26.031 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-25T06:50:26.031 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-25T06:50:26.031 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-25T06:50:26.031 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-12-25T06:50:26.065 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2023-12-25T06:50:26.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-25T06:50:26.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-25T06:50:26.135 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-12-25T06:50:26.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-25T06:50:26.256 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-12-25T06:50:26.311 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-12-25T06:50:26.311 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-12-25T06:50:26.366 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2023-12-25T06:50:26.366 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.4 (Ootpa)" 2023-12-25T06:50:26.366 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2023-12-25T06:50:26.366 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2023-12-25T06:50:26.366 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.4" 2023-12-25T06:50:26.366 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-12-25T06:50:26.366 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-25T06:50:26.367 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-12-25T06:50:26.367 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-25T06:50:26.367 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2023-12-25T06:50:26.367 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-25T06:50:26.367 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-25T06:50:26.367 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-25T06:50:26.367 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-25T06:50:26.367 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-25T06:50:26.367 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-25T06:50:26.367 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-25T06:50:26.367 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-12-25T06:50:26.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-25T06:50:26.472 INFO:teuthology.dispatcher.supervisor:Running job 7500586 2023-12-25T06:50:26.472 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-25_06:42:26-fs-rishabh-mdscap-pacific-testing-default-smithi/7500586 --name rishabh-2023-12-25_06:42:26-fs-rishabh-mdscap-pacific-testing-default-smithi --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/yes standby-replay subvolume/{with-namespace-isolated-and-quota} tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{yes}} -- /home/teuthworker/archive/rishabh-2023-12-25_06:42:26-fs-rishabh-mdscap-pacific-testing-default-smithi/7500586/orig.config.yaml 2023-12-25T06:50:26.475 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-25_06:42:26-fs-rishabh-mdscap-pacific-testing-default-smithi/7500586 2023-12-25T06:50:26.476 INFO:teuthology.dispatcher.supervisor:Job PID: 3059846 2023-12-25T06:50:26.476 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-25T06:52:26.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-25T06:54:26.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-25T06:56:26.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-25T06:58:27.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-25T07:00:27.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-25T07:00:27.334 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-25T07:00:27.495 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-25T07:00:27.496 INFO:teuthology.nuke:Checking targets against current locks 2023-12-25T07:00:27.547 DEBUG:teuthology.nuke:shortname: smithi047 2023-12-25T07:00:27.548 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-25T07:00:27.573 DEBUG:teuthology.nuke:shortname: smithi110 2023-12-25T07:00:27.573 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-25T07:00:27.576 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-25_06:42:26-fs-rishabh-mdscap-pacific-testing-default-smithi/7500586', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-25 06:43:39.038536', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIOptOLG2ro65mcbXXvwcJSJVuTPBGvlRlTqZsMRphD2ILKG+nJYYHABsffG2IuyrnA0xISkZmBFemE0+3z/6Q='} 2023-12-25T07:00:27.600 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-25_06:42:26-fs-rishabh-mdscap-pacific-testing-default-smithi/7500586', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-25 06:43:39.035211', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNO+GS7qcQ+V4R1o3srQlc+zdhLftLtpiI54tZcXa4YiZgvKR0PyUqSNvKE1pSpggVWkRdqKznT3U4cC+KgNgXA='} 2023-12-25T07:00:27.605 DEBUG:teuthology.nuke:shortname: smithi152 2023-12-25T07:00:27.605 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-25T07:00:27.632 INFO:teuthology.orchestra.console.smithi047:Power off 2023-12-25T07:00:27.632 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-25T07:00:27.646 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-25_06:42:26-fs-rishabh-mdscap-pacific-testing-default-smithi/7500586', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-25 06:43:39.037031', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCaE9seKt9GlG6VCJ7+CscB1eDisuY5Ux19X7caw8C6wbyszwd+mCsZzD6Dopx71mt/Os4Bgc7tGIy+T3kIcwWo='} 2023-12-25T07:00:27.658 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2023-12-25T07:00:27.658 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T07:00:27.683 INFO:teuthology.orchestra.console.smithi110:Power off 2023-12-25T07:00:27.683 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-25T07:00:27.692 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2023-12-25T07:00:27.704 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-12-25T07:00:27.705 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T07:00:27.721 INFO:teuthology.orchestra.console.smithi152:Power off 2023-12-25T07:00:27.721 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-25T07:00:27.730 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-12-25T07:00:27.746 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-12-25T07:00:27.746 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-25T07:00:27.768 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-25T07:00:27.793 INFO:teuthology.orchestra.console.smithi047:Power off completed 2023-12-25T07:00:27.831 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-12-25T07:00:27.869 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-12-25T07:00:27.944 INFO:teuthology.lock.ops:unlocked: smithi047.front.sepia.ceph.com 2023-12-25T07:00:27.975 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2023-12-25T07:00:28.015 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com