2024-01-17T06:36:28.694 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-17T06:36:28.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T06:36:28.859 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ffbe1e66f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ffbe2eccc10>, signals=[15])
2024-01-17T06:36:28.859 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging
2024-01-17T06:36:28.859 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server
2024-01-17T06:36:28.859 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2024-01-17T06:36:28.882 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging
2024-01-17T06:36:28.883 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server
2024-01-17T06:36:28.883 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2024-01-17T06:36:28.899 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2024-01-17T06:36:28.899 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2024-01-17T06:36:28.900 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2024-01-17T06:36:28.989 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-17T06:36:29.014 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-17T06:36:29.032 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of rhel 8.6
2024-01-17T06:36:29.054 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-17T06:36:29.059 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of rhel 8.6
2024-01-17T06:36:29.092 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of rhel 8.6
2024-01-17T06:36:29.323 INFO:teuthology.orchestra.console.smithi032:Power off
2024-01-17T06:36:29.324 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T06:36:29.351 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off
2024-01-17T06:36:29.351 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:29.375 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-01-17T06:36:29.386 INFO:teuthology.orchestra.console.smithi196:Power off
2024-01-17T06:36:29.386 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T06:36:29.397 INFO:teuthology.orchestra.console.smithi135:Power off
2024-01-17T06:36:29.398 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T06:36:29.408 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2024-01-17T06:36:29.408 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:29.419 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off
2024-01-17T06:36:29.419 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:29.429 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-01-17T06:36:29.440 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on
2024-01-17T06:36:33.380 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:33.431 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:33.441 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:33.490 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-01-17T06:36:33.541 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-01-17T06:36:33.554 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on
2024-01-17T06:36:37.493 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:37.542 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:37.555 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:37.602 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-01-17T06:36:37.652 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-01-17T06:36:37.664 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on
2024-01-17T06:36:37.703 INFO:teuthology.orchestra.console.smithi032:Power off completed
2024-01-17T06:36:37.752 INFO:teuthology.orchestra.console.smithi196:Power off completed
2024-01-17T06:36:37.804 INFO:teuthology.orchestra.console.smithi032:Power on
2024-01-17T06:36:37.804 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-17T06:36:37.824 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On
2024-01-17T06:36:37.824 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:37.843 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-01-17T06:36:37.853 INFO:teuthology.orchestra.console.smithi196:Power on
2024-01-17T06:36:37.853 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-17T06:36:37.872 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On
2024-01-17T06:36:37.873 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:37.891 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-01-17T06:36:41.668 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:41.778 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off
2024-01-17T06:36:41.844 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:41.878 INFO:teuthology.orchestra.console.smithi135:Power off completed
2024-01-17T06:36:41.892 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:41.953 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-01-17T06:36:41.979 INFO:teuthology.orchestra.console.smithi135:Power on
2024-01-17T06:36:41.979 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-17T06:36:42.000 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-01-17T06:36:42.001 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On
2024-01-17T06:36:42.001 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:42.021 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off
2024-01-17T06:36:45.958 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:46.002 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:46.022 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:46.068 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-01-17T06:36:46.131 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off
2024-01-17T06:36:46.168 INFO:teuthology.orchestra.console.smithi032:Power on completed
2024-01-17T06:36:46.191 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-01-17T06:36:46.270 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish
2024-01-17T06:36:46.292 INFO:teuthology.orchestra.console.smithi196:Power on completed
2024-01-17T06:36:46.393 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2024-01-17T06:36:50.133 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:36:50.241 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on
2024-01-17T06:36:50.342 INFO:teuthology.orchestra.console.smithi135:Power on completed
2024-01-17T06:36:50.442 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish
2024-01-17T06:39:18.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:39:33.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:39:36.764 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-01-17T06:39:42.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:39:45.852 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-01-17T06:39:51.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:39:52.124 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-17T06:39:54.940 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-01-17T06:39:58.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:40:00.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:40:01.180 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-17T06:40:07.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:40:10.236 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-17T06:40:16.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:40:19.324 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-01-17T06:40:25.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:41:00.954 WARNING:teuthology.provision.fog.smithi032:timed out
2024-01-17T06:41:06.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:41:07.207 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-17T06:41:07.208 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-17T06:41:07.482 INFO:teuthology.provision.fog.smithi032:Node is ready
2024-01-17T06:41:07.483 DEBUG:teuthology.orchestra.run.smithi032:> hostname
2024-01-17T06:41:07.503 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com
2024-01-17T06:41:07.503 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts
2024-01-17T06:41:07.564 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032
2024-01-17T06:41:07.564 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2024-01-17T06:41:07.692 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts
2024-01-17T06:41:07.726 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts
2024-01-17T06:41:07.801 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname
2024-01-17T06:41:07.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2024-01-17T06:41:07.950 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2024-01-17T06:41:08.011 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux"
2024-01-17T06:41:08.011 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)"
2024-01-17T06:41:08.011 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel"
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora"
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6"
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8"
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/"
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-17T06:41:08.012 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-17T06:41:08.013 INFO:teuthology.provision.fog.smithi032:Deploy complete!
2024-01-17T06:41:08.015 DEBUG:teuthology.parallel:result is None
2024-01-17T06:41:25.332 WARNING:teuthology.provision.fog.smithi196:timed out
2024-01-17T06:41:31.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:41:31.548 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-17T06:41:31.548 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-17T06:41:31.854 INFO:teuthology.provision.fog.smithi196:Node is ready
2024-01-17T06:41:31.855 DEBUG:teuthology.orchestra.run.smithi196:> hostname
2024-01-17T06:41:31.871 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2024-01-17T06:41:31.872 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts
2024-01-17T06:41:31.928 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2024-01-17T06:41:31.929 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2024-01-17T06:41:32.063 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts
2024-01-17T06:41:32.089 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts
2024-01-17T06:41:32.157 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname
2024-01-17T06:41:32.224 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2024-01-17T06:41:32.289 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux"
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.6 (Ootpa)"
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel"
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora"
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.6"
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/"
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:
2024-01-17T06:41:32.347 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-17T06:41:32.348 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-17T06:41:32.348 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-17T06:41:32.348 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-17T06:41:32.348 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2024-01-17T06:41:32.348 DEBUG:teuthology.parallel:result is None
2024-01-17T06:42:08.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:42:27.004 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-01-17T06:42:33.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:42:36.060 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-01-17T06:42:42.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:42:45.152 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-01-17T06:42:51.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:42:54.236 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-01-17T06:43:00.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:43:18.716 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-01-17T06:43:24.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:43:27.772 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-01-17T06:43:33.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:43:36.828 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-01-17T06:43:42.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:43:43.098 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-17T06:43:43.098 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-17T06:44:03.324 INFO:teuthology.provision.fog.smithi135:Node is ready
2024-01-17T06:44:03.325 DEBUG:teuthology.orchestra.run.smithi135:> hostname
2024-01-17T06:44:03.347 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com
2024-01-17T06:44:03.348 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts
2024-01-17T06:44:03.408 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135
2024-01-17T06:44:03.408 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135
2024-01-17T06:44:03.534 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts
2024-01-17T06:44:03.564 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts
2024-01-17T06:44:03.634 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname
2024-01-17T06:44:03.703 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135
2024-01-17T06:44:03.771 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release
2024-01-17T06:44:03.828 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux"
2024-01-17T06:44:03.829 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)"
2024-01-17T06:44:03.829 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel"
2024-01-17T06:44:03.829 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora"
2024-01-17T06:44:03.829 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6"
2024-01-17T06:44:03.829 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8"
2024-01-17T06:44:03.829 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-17T06:44:03.829 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31"
2024-01-17T06:44:03.829 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-17T06:44:03.829 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/"
2024-01-17T06:44:03.829 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-17T06:44:03.829 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-17T06:44:03.829 INFO:teuthology.orchestra.run.smithi135.stdout:
2024-01-17T06:44:03.830 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-17T06:44:03.830 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-17T06:44:03.830 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-17T06:44:03.830 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-17T06:44:03.830 INFO:teuthology.provision.fog.smithi135:Deploy complete!
2024-01-17T06:44:03.831 DEBUG:teuthology.parallel:result is None
2024-01-17T06:44:04.027 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com
2024-01-17T06:44:04.028 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-17T06:44:04.051 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com
2024-01-17T06:44:04.051 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-17T06:44:04.067 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2024-01-17T06:44:04.067 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-17T06:44:04.085 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server
2024-01-17T06:44:04.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2024-01-17T06:44:04.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:44:04.161 DEBUG:teuthology.orchestra.run.smithi032:> true
2024-01-17T06:44:04.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com'
2024-01-17T06:44:04.304 DEBUG:teuthology.orchestra.run.smithi032:> uname -m
2024-01-17T06:44:04.365 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64
2024-01-17T06:44:04.365 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2024-01-17T06:44:04.427 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux"
2024-01-17T06:44:04.428 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)"
2024-01-17T06:44:04.428 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel"
2024-01-17T06:44:04.428 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora"
2024-01-17T06:44:04.428 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6"
2024-01-17T06:44:04.428 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8"
2024-01-17T06:44:04.428 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-17T06:44:04.428 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2024-01-17T06:44:04.428 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-17T06:44:04.428 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/"
2024-01-17T06:44:04.428 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-17T06:44:04.428 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-17T06:44:04.428 INFO:teuthology.orchestra.run.smithi032.stdout:
2024-01-17T06:44:04.428 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-17T06:44:04.429 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-17T06:44:04.429 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-17T06:44:04.429 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-17T06:44:04.429 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2024-01-17T06:44:04.451 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server
2024-01-17T06:44:04.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com'
2024-01-17T06:44:04.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:44:04.525 DEBUG:teuthology.orchestra.run.smithi135:> true
2024-01-17T06:44:04.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com'
2024-01-17T06:44:04.595 DEBUG:teuthology.orchestra.run.smithi135:> uname -m
2024-01-17T06:44:04.654 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64
2024-01-17T06:44:04.654 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release
2024-01-17T06:44:04.713 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux"
2024-01-17T06:44:04.713 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)"
2024-01-17T06:44:04.713 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel"
2024-01-17T06:44:04.713 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora"
2024-01-17T06:44:04.713 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6"
2024-01-17T06:44:04.713 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8"
2024-01-17T06:44:04.713 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-17T06:44:04.713 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31"
2024-01-17T06:44:04.713 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-17T06:44:04.713 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/"
2024-01-17T06:44:04.713 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-17T06:44:04.714 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-17T06:44:04.714 INFO:teuthology.orchestra.run.smithi135.stdout:
2024-01-17T06:44:04.714 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-17T06:44:04.714 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-17T06:44:04.714 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-17T06:44:04.714 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-17T06:44:04.714 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2024-01-17T06:44:04.734 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2024-01-17T06:44:04.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2024-01-17T06:44:04.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T06:44:04.804 DEBUG:teuthology.orchestra.run.smithi196:> true
2024-01-17T06:44:04.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com'
2024-01-17T06:44:04.950 DEBUG:teuthology.orchestra.run.smithi196:> uname -m
2024-01-17T06:44:05.007 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2024-01-17T06:44:05.007 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2024-01-17T06:44:05.064 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux"
2024-01-17T06:44:05.064 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.6 (Ootpa)"
2024-01-17T06:44:05.064 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel"
2024-01-17T06:44:05.064 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora"
2024-01-17T06:44:05.064 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.6"
2024-01-17T06:44:05.065 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2024-01-17T06:44:05.065 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-17T06:44:05.065 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2024-01-17T06:44:05.065 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-17T06:44:05.065 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/"
2024-01-17T06:44:05.065 INFO:teuthology.orchestra.run.smithi196.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-17T06:44:05.065 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-17T06:44:05.065 INFO:teuthology.orchestra.run.smithi196.stdout:
2024-01-17T06:44:05.065 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-17T06:44:05.065 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-17T06:44:05.065 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-17T06:44:05.065 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-17T06:44:05.066 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2024-01-17T06:44:05.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T06:44:05.185 INFO:teuthology.dispatcher.supervisor:Running job 7518721
2024-01-17T06:44:05.186 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_khiremat@teuthology --archive /home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518721 --name khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout single_mds} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/iogen}} -- /home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518721/orig.config.yaml
2024-01-17T06:44:05.188 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518721
2024-01-17T06:44:05.189 INFO:teuthology.dispatcher.supervisor:Job PID: 725657
2024-01-17T06:44:05.189 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-17T06:46:05.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T06:48:05.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T06:50:05.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T06:52:05.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T06:54:05.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T06:56:06.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T06:58:06.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T06:58:06.328 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-17T06:58:06.476 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-17T06:58:06.476 INFO:teuthology.nuke:Checking targets against current locks
2024-01-17T06:58:06.515 DEBUG:teuthology.nuke:shortname: smithi032
2024-01-17T06:58:06.516 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-17T06:58:06.535 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 06:36:27.611886', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHDN9WZu2ji6TfNVV4DcyBybDrZ92UAsjW67R/6yZqjKPzZXcjWQtQKsHaoWX9tK25b1tMF3/BGayLTCk/SRaR0='}
2024-01-17T06:58:06.546 DEBUG:teuthology.nuke:shortname: smithi135
2024-01-17T06:58:06.546 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-17T06:58:06.561 DEBUG:teuthology.nuke:shortname: smithi196
2024-01-17T06:58:06.561 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-17T06:58:06.568 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 06:36:27.613031', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ+PHThqB1C07Xkk269bNyT342fKJGW2/rskkq6g3EefNuofD1CpYP5n/dOBNoOHAEwxI4PwadjG/ASJEz5oRuE='}
2024-01-17T06:58:06.580 INFO:teuthology.orchestra.console.smithi032:Power off
2024-01-17T06:58:06.580 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T06:58:06.591 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-01-17_06:35:36-fs:workload-wip-khiremat-49945-referent-inode-0-distro-default-smithi/7518721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 06:36:27.610539', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJtIkjoRVX09SRcwLoEI0KhEtTrUe2bWtMnehP3+yKrtR75iFIf7ZUyZ2O0SKoGBvkBHaAP0Ta2Dn94U0rIIiGg='}
2024-01-17T06:58:06.603 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off
2024-01-17T06:58:06.603 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:58:06.621 INFO:teuthology.orchestra.console.smithi135:Power off
2024-01-17T06:58:06.622 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T06:58:06.629 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-01-17T06:58:06.642 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off
2024-01-17T06:58:06.642 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:58:06.656 INFO:teuthology.orchestra.console.smithi196:Power off
2024-01-17T06:58:06.656 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T06:58:06.663 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off
2024-01-17T06:58:06.676 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2024-01-17T06:58:06.676 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T06:58:06.695 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-01-17T06:58:06.730 INFO:teuthology.orchestra.console.smithi032:Power off completed
2024-01-17T06:58:06.763 INFO:teuthology.orchestra.console.smithi135:Power off completed
2024-01-17T06:58:06.797 INFO:teuthology.orchestra.console.smithi196:Power off completed
2024-01-17T06:58:06.888 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com
2024-01-17T06:58:06.910 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com
2024-01-17T06:58:06.942 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com