2024-01-18T08:12:27.760 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-18T08:12:27.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T08:12:27.936 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fae6a7abc10>, signals=[15]) 2024-01-18T08:12:27.937 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2024-01-18T08:12:27.937 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2024-01-18T08:12:27.937 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-01-18T08:12:27.956 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2024-01-18T08:12:27.957 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2024-01-18T08:12:27.957 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-01-18T08:12:27.980 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2024-01-18T08:12:27.980 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2024-01-18T08:12:27.981 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-01-18T08:12:28.076 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-18T08:12:28.094 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-18T08:12:28.113 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-18T08:12:28.124 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of rhel 8.6 2024-01-18T08:12:28.141 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of rhel 8.6 2024-01-18T08:12:28.160 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of rhel 8.6 2024-01-18T08:12:28.365 INFO:teuthology.orchestra.console.smithi029:Power off 2024-01-18T08:12:28.365 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T08:12:28.387 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2024-01-18T08:12:28.387 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:28.403 INFO:teuthology.orchestra.console.smithi049:Power off 2024-01-18T08:12:28.403 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T08:12:28.416 INFO:teuthology.orchestra.console.smithi084:Power off 2024-01-18T08:12:28.416 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T08:12:28.422 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-01-18T08:12:28.425 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-01-18T08:12:28.426 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:28.437 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-01-18T08:12:28.438 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:28.446 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-01-18T08:12:28.458 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-01-18T08:12:28.548 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-01-18T08:12:28.648 INFO:teuthology.orchestra.console.smithi049:Power on 2024-01-18T08:12:28.649 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-18T08:12:28.670 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2024-01-18T08:12:28.670 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:28.691 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-01-18T08:12:32.424 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:32.460 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:32.534 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-01-18T08:12:32.569 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-01-18T08:12:32.692 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:32.800 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-01-18T08:12:36.536 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:36.570 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:36.647 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-01-18T08:12:36.679 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-01-18T08:12:36.749 INFO:teuthology.orchestra.console.smithi029:Power off completed 2024-01-18T08:12:36.802 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:36.850 INFO:teuthology.orchestra.console.smithi029:Power on 2024-01-18T08:12:36.850 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-18T08:12:36.884 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On 2024-01-18T08:12:36.884 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:36.906 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-01-18T08:12:36.910 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-01-18T08:12:37.011 INFO:teuthology.orchestra.console.smithi049:Power on completed 2024-01-18T08:12:37.112 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2024-01-18T08:12:40.684 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:40.792 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-01-18T08:12:40.893 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-01-18T08:12:40.906 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:40.994 INFO:teuthology.orchestra.console.smithi084:Power on 2024-01-18T08:12:40.995 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-18T08:12:41.015 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-01-18T08:12:41.017 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2024-01-18T08:12:41.017 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:41.039 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-01-18T08:12:45.018 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:45.040 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:45.127 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-01-18T08:12:45.148 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-01-18T08:12:45.229 INFO:teuthology.orchestra.console.smithi029:Power on completed 2024-01-18T08:12:45.330 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2024-01-18T08:12:49.152 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:12:49.263 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-01-18T08:12:49.364 INFO:teuthology.orchestra.console.smithi084:Power on completed 2024-01-18T08:12:49.464 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2024-01-18T08:15:35.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:15:52.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:15:53.660 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-18T08:15:59.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:16:02.716 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-18T08:16:08.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:16:11.324 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-18T08:16:11.772 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-18T08:16:16.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:16:17.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:16:17.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:16:20.384 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-18T08:16:20.828 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-18T08:16:26.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:16:26.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:16:29.468 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-18T08:16:29.884 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-18T08:16:34.876 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-18T08:16:35.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:16:35.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:16:38.528 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-18T08:16:40.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:16:43.932 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-18T08:16:44.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:16:47.580 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-18T08:16:49.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:16:52.988 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-18T08:16:53.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:16:56.640 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-18T08:16:58.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:17:02.044 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-18T08:17:02.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:17:05.696 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-01-18T08:17:08.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:17:11.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:17:35.896 WARNING:teuthology.provision.fog.smithi084:timed out 2024-01-18T08:17:41.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:17:42.156 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-18T08:17:42.156 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-18T08:17:42.429 INFO:teuthology.provision.fog.smithi084:Node is ready 2024-01-18T08:17:42.429 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2024-01-18T08:17:42.446 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2024-01-18T08:17:42.446 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2024-01-18T08:17:42.504 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2024-01-18T08:17:42.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-01-18T08:17:42.616 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2024-01-18T08:17:42.645 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2024-01-18T08:17:42.713 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2024-01-18T08:17:42.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-01-18T08:17:42.851 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-01-18T08:17:42.913 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2024-01-18T08:17:42.913 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.6 (Ootpa)" 2024-01-18T08:17:42.914 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2024-01-18T08:17:42.914 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2024-01-18T08:17:42.914 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.6" 2024-01-18T08:17:42.914 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2024-01-18T08:17:42.914 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-18T08:17:42.914 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-01-18T08:17:42.914 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-18T08:17:42.915 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2024-01-18T08:17:42.915 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-18T08:17:42.915 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-18T08:17:42.915 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-18T08:17:42.915 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-18T08:17:42.916 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-18T08:17:42.916 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-18T08:17:42.916 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-18T08:17:42.917 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2024-01-18T08:17:42.920 DEBUG:teuthology.parallel:result is None 2024-01-18T08:18:08.068 WARNING:teuthology.provision.fog.smithi029:timed out 2024-01-18T08:18:11.704 WARNING:teuthology.provision.fog.smithi049:timed out 2024-01-18T08:18:14.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:18:14.308 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-18T08:18:14.308 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-18T08:18:14.615 INFO:teuthology.provision.fog.smithi029:Node is ready 2024-01-18T08:18:14.615 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2024-01-18T08:18:14.636 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2024-01-18T08:18:14.636 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts 2024-01-18T08:18:14.697 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2024-01-18T08:18:14.698 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-01-18T08:18:14.822 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts 2024-01-18T08:18:14.856 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts 2024-01-18T08:18:14.930 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname 2024-01-18T08:18:15.004 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-01-18T08:18:15.077 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-01-18T08:18:15.139 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux" 2024-01-18T08:18:15.139 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.6 (Ootpa)" 2024-01-18T08:18:15.139 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel" 2024-01-18T08:18:15.139 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora" 2024-01-18T08:18:15.139 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.6" 2024-01-18T08:18:15.139 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2024-01-18T08:18:15.139 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-18T08:18:15.139 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-01-18T08:18:15.139 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-18T08:18:15.140 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/" 2024-01-18T08:18:15.140 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-18T08:18:15.140 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-18T08:18:15.140 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-18T08:18:15.140 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-18T08:18:15.140 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-18T08:18:15.140 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-18T08:18:15.140 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-18T08:18:15.140 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2024-01-18T08:18:15.141 DEBUG:teuthology.parallel:result is None 2024-01-18T08:18:17.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:18:18.004 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-18T08:18:18.004 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-18T08:18:18.262 INFO:teuthology.provision.fog.smithi049:Node is ready 2024-01-18T08:18:18.262 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2024-01-18T08:18:18.280 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2024-01-18T08:18:18.280 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2024-01-18T08:18:18.339 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2024-01-18T08:18:18.339 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2024-01-18T08:18:18.458 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2024-01-18T08:18:18.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2024-01-18T08:18:18.557 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2024-01-18T08:18:18.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2024-01-18T08:18:18.692 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-01-18T08:18:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Red Hat Enterprise Linux" 2024-01-18T08:18:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8.6 (Ootpa)" 2024-01-18T08:18:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:ID="rhel" 2024-01-18T08:18:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="fedora" 2024-01-18T08:18:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8.6" 2024-01-18T08:18:18.749 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2024-01-18T08:18:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-18T08:18:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-01-18T08:18:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-18T08:18:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.redhat.com/" 2024-01-18T08:18:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-18T08:18:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-18T08:18:18.750 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-18T08:18:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-18T08:18:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-18T08:18:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-18T08:18:18.750 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-18T08:18:18.750 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2024-01-18T08:18:18.751 DEBUG:teuthology.parallel:result is None 2024-01-18T08:18:18.956 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2024-01-18T08:18:18.956 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-18T08:18:18.983 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2024-01-18T08:18:18.983 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-18T08:18:19.008 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2024-01-18T08:18:19.008 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-18T08:18:19.026 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2024-01-18T08:18:19.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-18T08:18:19.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:18:19.099 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-01-18T08:18:19.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-18T08:18:19.175 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-01-18T08:18:19.236 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-01-18T08:18:19.236 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-01-18T08:18:19.298 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux" 2024-01-18T08:18:19.298 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.6 (Ootpa)" 2024-01-18T08:18:19.298 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel" 2024-01-18T08:18:19.298 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora" 2024-01-18T08:18:19.298 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.6" 2024-01-18T08:18:19.298 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2024-01-18T08:18:19.298 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-18T08:18:19.298 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-01-18T08:18:19.298 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-18T08:18:19.299 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/" 2024-01-18T08:18:19.299 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-18T08:18:19.299 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-18T08:18:19.299 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-01-18T08:18:19.299 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-18T08:18:19.299 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-18T08:18:19.299 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-18T08:18:19.299 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-18T08:18:19.299 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-01-18T08:18:19.325 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2024-01-18T08:18:19.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-18T08:18:19.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:18:19.394 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-01-18T08:18:19.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-01-18T08:18:19.463 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-01-18T08:18:19.521 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-01-18T08:18:19.521 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-01-18T08:18:19.579 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Red Hat Enterprise Linux" 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8.6 (Ootpa)" 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout:ID="rhel" 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="fedora" 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8.6" 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.redhat.com/" 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-18T08:18:19.580 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-18T08:18:19.581 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-18T08:18:19.581 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-18T08:18:19.581 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-01-18T08:18:19.600 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2024-01-18T08:18:19.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-18T08:18:19.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T08:18:19.677 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-01-18T08:18:19.817 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-18T08:18:19.817 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-01-18T08:18:19.874 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-01-18T08:18:19.874 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-01-18T08:18:19.931 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2024-01-18T08:18:19.931 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.6 (Ootpa)" 2024-01-18T08:18:19.931 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2024-01-18T08:18:19.931 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2024-01-18T08:18:19.932 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.6" 2024-01-18T08:18:19.932 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2024-01-18T08:18:19.932 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-18T08:18:19.932 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-01-18T08:18:19.932 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-18T08:18:19.932 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2024-01-18T08:18:19.932 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-18T08:18:19.932 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-18T08:18:19.932 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-18T08:18:19.932 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-18T08:18:19.932 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-18T08:18:19.932 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-18T08:18:19.932 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-18T08:18:19.933 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-01-18T08:18:19.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T08:18:20.067 INFO:teuthology.dispatcher.supervisor:Running job 7519937 2024-01-18T08:18:20.068 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_khiremat@teuthology --archive /home/teuthworker/archive/khiremat-2024-01-18_06:28:17-fs:workload-wip-khiremat-49945-referent-inode-1-distro-default-smithi/7519937 --name khiremat-2024-01-18_06:28:17-fs:workload-wip-khiremat-49945-referent-inode-1-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout single_mds} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/iogen}} -- /home/teuthworker/archive/khiremat-2024-01-18_06:28:17-fs:workload-wip-khiremat-49945-referent-inode-1-distro-default-smithi/7519937/orig.config.yaml 2024-01-18T08:18:20.070 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/khiremat-2024-01-18_06:28:17-fs:workload-wip-khiremat-49945-referent-inode-1-distro-default-smithi/7519937 2024-01-18T08:18:20.071 INFO:teuthology.dispatcher.supervisor:Job PID: 84204 2024-01-18T08:18:20.071 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-18T08:20:20.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T08:22:20.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T08:24:20.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T08:26:20.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T08:28:20.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T08:30:20.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T08:32:21.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T08:34:21.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T08:36:21.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T08:38:21.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T08:38:21.624 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-18T08:38:21.778 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-18T08:38:21.779 INFO:teuthology.nuke:Checking targets against current locks 2024-01-18T08:38:21.835 DEBUG:teuthology.nuke:shortname: smithi029 2024-01-18T08:38:21.836 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-18T08:38:21.859 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-01-18_06:28:17-fs:workload-wip-khiremat-49945-referent-inode-1-distro-default-smithi/7519937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-18 08:12:26.612461', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD1UiDmFYerOAaIpzGBhuSi4Dhq8I8+J18dWKF/dHl9LAqcBwFFrw4noe1LxqJvGefF0faLgBfT54TptqPjwXZA='} 2024-01-18T08:38:21.864 DEBUG:teuthology.nuke:shortname: smithi049 2024-01-18T08:38:21.864 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-18T08:38:21.876 DEBUG:teuthology.nuke:shortname: smithi084 2024-01-18T08:38:21.876 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-18T08:38:21.886 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-01-18_06:28:17-fs:workload-wip-khiremat-49945-referent-inode-1-distro-default-smithi/7519937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-18 08:12:26.615206', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD4iyujGNHm2zpHX5VTF6W2T27WQvMhdqwNCnq9Z/dRvVKemM4ZNI79Q1/tCLiIZv56ZvPvpEpgkGSWXc9D6+2M='} 2024-01-18T08:38:21.903 INFO:teuthology.orchestra.console.smithi029:Power off 2024-01-18T08:38:21.904 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T08:38:21.916 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-01-18_06:28:17-fs:workload-wip-khiremat-49945-referent-inode-1-distro-default-smithi/7519937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-18 08:12:26.613941', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE7OQ0r8xwyVfVttu/+vwpFkGZCpSpReAycFjOlBSnVDxL9smFlSE3OUo7Yl1FpJfg7Z+DztiLW6xCby3PiO0gE='} 2024-01-18T08:38:21.925 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2024-01-18T08:38:21.926 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:38:21.950 INFO:teuthology.orchestra.console.smithi049:Power off 2024-01-18T08:38:21.950 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T08:38:21.960 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-01-18T08:38:21.970 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-01-18T08:38:21.970 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:38:21.984 INFO:teuthology.orchestra.console.smithi084:Power off 2024-01-18T08:38:21.984 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T08:38:21.992 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-01-18T08:38:22.005 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-01-18T08:38:22.005 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T08:38:22.026 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-01-18T08:38:22.060 INFO:teuthology.orchestra.console.smithi029:Power off completed 2024-01-18T08:38:22.093 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-01-18T08:38:22.126 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-01-18T08:38:22.215 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2024-01-18T08:38:22.239 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com 2024-01-18T08:38:22.272 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com