2024-01-08T08:53:26.741 INFO:root:teuthology version: 0.0.1.dev228+g01dd171
2024-01-08T08:53:26.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T08:53:26.916 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa2500b9340>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa251013940>, signals=[15])
2024-01-08T08:53:26.916 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging
2024-01-08T08:53:26.916 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server
2024-01-08T08:53:26.917 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server
2024-01-08T08:53:26.938 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging
2024-01-08T08:53:26.938 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server
2024-01-08T08:53:26.938 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2024-01-08T08:53:26.962 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2024-01-08T08:53:26.963 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2024-01-08T08:53:26.963 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2024-01-08T08:53:27.068 DEBUG:teuthology.provision.fog.smithi080:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-08T08:53:27.081 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-08T08:53:27.094 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-08T08:53:27.114 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of rhel 8.6
2024-01-08T08:53:27.120 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of rhel 8.6
2024-01-08T08:53:27.139 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of rhel 8.6
2024-01-08T08:53:27.347 INFO:teuthology.orchestra.console.smithi084:Power off
2024-01-08T08:53:27.347 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-08T08:53:27.363 INFO:teuthology.orchestra.console.smithi099:Power off
2024-01-08T08:53:27.363 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-08T08:53:27.375 INFO:teuthology.orchestra.console.smithi080:Power off
2024-01-08T08:53:27.375 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-08T08:53:27.384 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2024-01-08T08:53:27.385 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:27.391 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off
2024-01-08T08:53:27.391 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:27.404 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off
2024-01-08T08:53:27.404 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:27.411 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-01-08T08:53:27.414 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off
2024-01-08T08:53:27.425 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on
2024-01-08T08:53:27.513 INFO:teuthology.orchestra.console.smithi099:Power off completed
2024-01-08T08:53:27.514 INFO:teuthology.orchestra.console.smithi084:Power off completed
2024-01-08T08:53:27.614 INFO:teuthology.orchestra.console.smithi099:Power on
2024-01-08T08:53:27.614 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-08T08:53:27.622 INFO:teuthology.orchestra.console.smithi084:Power on
2024-01-08T08:53:27.622 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-08T08:53:27.638 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On
2024-01-08T08:53:27.638 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:27.646 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On
2024-01-08T08:53:27.646 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:27.658 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-01-08T08:53:27.668 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off
2024-01-08T08:53:31.428 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:31.539 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on
2024-01-08T08:53:31.659 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:31.669 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:31.771 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-01-08T08:53:31.780 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off
2024-01-08T08:53:35.541 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:35.651 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on
2024-01-08T08:53:35.772 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:35.780 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:35.891 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on
2024-01-08T08:53:35.898 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2024-01-08T08:53:35.992 INFO:teuthology.orchestra.console.smithi084:Power on completed
2024-01-08T08:53:35.999 INFO:teuthology.orchestra.console.smithi099:Power on completed
2024-01-08T08:53:36.093 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish
2024-01-08T08:53:36.100 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2024-01-08T08:53:39.654 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:39.763 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2024-01-08T08:53:39.864 INFO:teuthology.orchestra.console.smithi080:Power off completed
2024-01-08T08:53:39.965 INFO:teuthology.orchestra.console.smithi080:Power on
2024-01-08T08:53:39.965 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-08T08:53:39.989 DEBUG:teuthology.orchestra.console.smithi080:power on output: Chassis Power Control: Up/On
2024-01-08T08:53:39.989 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:40.010 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2024-01-08T08:53:44.014 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:44.124 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2024-01-08T08:53:48.128 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T08:53:48.237 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on
2024-01-08T08:53:48.338 INFO:teuthology.orchestra.console.smithi080:Power on completed
2024-01-08T08:53:48.439 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish
2024-01-08T08:56:21.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:56:21.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:56:24.860 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-01-08T08:56:24.861 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2024-01-08T08:56:30.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:56:30.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:56:33.920 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-01-08T08:56:33.920 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2024-01-08T08:56:34.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:56:37.276 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2024-01-08T08:56:39.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:56:39.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:56:43.008 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-01-08T08:56:43.008 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2024-01-08T08:56:43.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:56:46.332 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2024-01-08T08:56:49.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:56:49.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:56:52.092 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-01-08T08:56:52.092 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2024-01-08T08:56:52.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:56:55.392 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2024-01-08T08:56:58.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:56:58.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:57:01.148 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-01-08T08:57:01.148 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2024-01-08T08:57:01.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:57:04.480 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2024-01-08T08:57:07.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:57:07.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:57:10.208 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-01-08T08:57:10.208 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2024-01-08T08:57:10.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:57:13.536 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2024-01-08T08:57:16.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:57:16.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:57:19.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:57:22.620 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80
2024-01-08T08:57:28.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:58:16.263 WARNING:teuthology.provision.fog.smithi099:timed out
2024-01-08T08:58:16.263 WARNING:teuthology.provision.fog.smithi084:timed out
2024-01-08T08:58:22.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:58:22.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:58:22.487 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-08T08:58:22.487 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-08T08:58:22.540 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-08T08:58:22.540 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-08T08:58:22.768 INFO:teuthology.provision.fog.smithi099:Node is ready
2024-01-08T08:58:22.769 DEBUG:teuthology.orchestra.run.smithi099:> hostname
2024-01-08T08:58:22.776 INFO:teuthology.provision.fog.smithi084:Node is ready
2024-01-08T08:58:22.776 DEBUG:teuthology.orchestra.run.smithi084:> hostname
2024-01-08T08:58:22.786 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2024-01-08T08:58:22.786 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts
2024-01-08T08:58:22.793 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com
2024-01-08T08:58:22.793 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts
2024-01-08T08:58:22.844 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2024-01-08T08:58:22.844 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2024-01-08T08:58:22.850 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084
2024-01-08T08:58:22.851 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084
2024-01-08T08:58:22.962 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts
2024-01-08T08:58:22.964 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts
2024-01-08T08:58:22.992 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts
2024-01-08T08:58:22.994 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts
2024-01-08T08:58:23.059 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname
2024-01-08T08:58:23.061 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname
2024-01-08T08:58:23.126 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084
2024-01-08T08:58:23.129 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2024-01-08T08:58:23.192 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release
2024-01-08T08:58:23.195 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2024-01-08T08:58:23.249 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux"
2024-01-08T08:58:23.249 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.6 (Ootpa)"
2024-01-08T08:58:23.249 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel"
2024-01-08T08:58:23.249 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora"
2024-01-08T08:58:23.249 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.6"
2024-01-08T08:58:23.250 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8"
2024-01-08T08:58:23.250 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-08T08:58:23.250 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31"
2024-01-08T08:58:23.250 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-08T08:58:23.250 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/"
2024-01-08T08:58:23.250 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-08T08:58:23.250 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-08T08:58:23.250 INFO:teuthology.orchestra.run.smithi084.stdout:
2024-01-08T08:58:23.250 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-08T08:58:23.250 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-08T08:58:23.250 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-08T08:58:23.250 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-08T08:58:23.251 INFO:teuthology.provision.fog.smithi084:Deploy complete!
2024-01-08T08:58:23.252 DEBUG:teuthology.parallel:result is None
2024-01-08T08:58:23.253 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux"
2024-01-08T08:58:23.253 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)"
2024-01-08T08:58:23.253 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel"
2024-01-08T08:58:23.253 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora"
2024-01-08T08:58:23.253 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6"
2024-01-08T08:58:23.253 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2024-01-08T08:58:23.254 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-08T08:58:23.254 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2024-01-08T08:58:23.254 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-08T08:58:23.254 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/"
2024-01-08T08:58:23.254 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-08T08:58:23.254 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-08T08:58:23.254 INFO:teuthology.orchestra.run.smithi099.stdout:
2024-01-08T08:58:23.254 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-08T08:58:23.254 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-08T08:58:23.254 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-08T08:58:23.254 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-08T08:58:23.254 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2024-01-08T08:58:23.255 DEBUG:teuthology.parallel:result is None
2024-01-08T08:58:28.628 WARNING:teuthology.provision.fog.smithi080:timed out
2024-01-08T08:58:34.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:58:34.874 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-08T08:58:34.874 DEBUG:teuthology.orchestra.run.smithi080:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-08T08:58:35.138 INFO:teuthology.provision.fog.smithi080:Node is ready
2024-01-08T08:58:35.138 DEBUG:teuthology.orchestra.run.smithi080:> hostname
2024-01-08T08:58:35.157 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com
2024-01-08T08:58:35.157 DEBUG:teuthology.orchestra.run.smithi080:> grep smithi080.front.sepia.ceph.com /etc/hosts
2024-01-08T08:58:35.215 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080
2024-01-08T08:58:35.215 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080
2024-01-08T08:58:35.319 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hosts
2024-01-08T08:58:35.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts
2024-01-08T08:58:35.415 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hostname
2024-01-08T08:58:35.483 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080
2024-01-08T08:58:35.549 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release
2024-01-08T08:58:35.605 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux"
2024-01-08T08:58:35.606 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8.6 (Ootpa)"
2024-01-08T08:58:35.606 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel"
2024-01-08T08:58:35.606 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora"
2024-01-08T08:58:35.606 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8.6"
2024-01-08T08:58:35.606 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8"
2024-01-08T08:58:35.606 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-08T08:58:35.606 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31"
2024-01-08T08:58:35.606 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-08T08:58:35.606 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/"
2024-01-08T08:58:35.606 INFO:teuthology.orchestra.run.smithi080.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-08T08:58:35.606 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-08T08:58:35.606 INFO:teuthology.orchestra.run.smithi080.stdout:
2024-01-08T08:58:35.607 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-08T08:58:35.607 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-08T08:58:35.607 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-08T08:58:35.607 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-08T08:58:35.607 INFO:teuthology.provision.fog.smithi080:Deploy complete!
2024-01-08T08:58:35.608 DEBUG:teuthology.parallel:result is None
2024-01-08T08:58:35.793 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com
2024-01-08T08:58:35.793 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-08T08:58:35.816 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com
2024-01-08T08:58:35.816 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-08T08:58:35.832 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2024-01-08T08:58:35.832 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-08T08:58:35.850 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server
2024-01-08T08:58:35.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com'
2024-01-08T08:58:35.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:58:35.918 DEBUG:teuthology.orchestra.run.smithi080:> true
2024-01-08T08:58:35.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com'
2024-01-08T08:58:35.984 DEBUG:teuthology.orchestra.run.smithi080:> uname -m
2024-01-08T08:58:36.042 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64
2024-01-08T08:58:36.042 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release
2024-01-08T08:58:36.098 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux"
2024-01-08T08:58:36.098 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8.6 (Ootpa)"
2024-01-08T08:58:36.098 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel"
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora"
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8.6"
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8"
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31"
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/"
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-08T08:58:36.099 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-08T08:58:36.100 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server
2024-01-08T08:58:36.124 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server
2024-01-08T08:58:36.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com'
2024-01-08T08:58:36.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:58:36.193 DEBUG:teuthology.orchestra.run.smithi084:> true
2024-01-08T08:58:36.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com'
2024-01-08T08:58:36.330 DEBUG:teuthology.orchestra.run.smithi084:> uname -m
2024-01-08T08:58:36.387 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64
2024-01-08T08:58:36.388 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release
2024-01-08T08:58:36.445 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux"
2024-01-08T08:58:36.445 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.6 (Ootpa)"
2024-01-08T08:58:36.445 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel"
2024-01-08T08:58:36.445 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora"
2024-01-08T08:58:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.6"
2024-01-08T08:58:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8"
2024-01-08T08:58:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-08T08:58:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31"
2024-01-08T08:58:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-08T08:58:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/"
2024-01-08T08:58:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-08T08:58:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-08T08:58:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:
2024-01-08T08:58:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-08T08:58:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-08T08:58:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-08T08:58:36.446 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-08T08:58:36.447 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2024-01-08T08:58:36.474 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2024-01-08T08:58:36.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2024-01-08T08:58:36.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-08T08:58:36.543 DEBUG:teuthology.orchestra.run.smithi099:> true
2024-01-08T08:58:36.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com'
2024-01-08T08:58:36.678 DEBUG:teuthology.orchestra.run.smithi099:> uname -m
2024-01-08T08:58:36.736 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2024-01-08T08:58:36.736 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2024-01-08T08:58:36.793 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux"
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)"
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel"
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora"
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6"
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/"
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-08T08:58:36.794 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-08T08:58:36.795 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-08T08:58:36.795 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-08T08:58:36.795 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2024-01-08T08:58:36.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T08:58:36.919 INFO:teuthology.dispatcher.supervisor:Running job 7509039
2024-01-08T08:58:36.919 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7509039 --name vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/iogen}} -- /home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7509039/orig.config.yaml
2024-01-08T08:58:36.923 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7509039
2024-01-08T08:58:36.923 INFO:teuthology.dispatcher.supervisor:Job PID: 1672819
2024-01-08T08:58:36.923 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-08T09:00:37.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T09:02:37.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T09:04:37.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T09:06:37.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T09:08:37.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T09:10:37.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T09:12:38.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T09:14:38.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T09:16:38.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T09:18:38.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-08T09:18:38.595 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-08T09:18:38.757 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-08T09:18:38.757 INFO:teuthology.nuke:Checking targets against current locks
2024-01-08T09:18:38.809 DEBUG:teuthology.nuke:shortname: smithi080
2024-01-08T09:18:38.810 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-08T09:18:38.839 DEBUG:teuthology.nuke:shortname: smithi084
2024-01-08T09:18:38.839 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-08T09:18:38.840 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7509039', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-08 08:53:25.849232', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMRp6tN4i5B1rxpgtTa5A825UNaJ4EoFzU1ZzovEhFOQCUDAdyfalkunW8BQ2LiRwZiSBUYPgqJHpFtvddwYazQ='}
2024-01-08T09:18:38.866 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7509039', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-08 08:53:25.847902', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJttffh74ZUADkjzNyksTsftr2MTpmztCDIjEGiCM+CME96ny+SQXtdYkEX1x2IeCTJHPpJ/rbvQyXuqSrtNY/k='}
2024-01-08T09:18:38.867 DEBUG:teuthology.nuke:shortname: smithi099
2024-01-08T09:18:38.867 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-08T09:18:38.893 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-08_06:50:55-fs-wip-vshankar-testing-20240103.072409-testing-default-smithi/7509039', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-08 08:53:25.846380', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyEwyAQYrawPLGb99bnaV6puODqPH4YZs7RqJPdlWpO4C5qYQHhByDPMV13+6fUaHcJ+I3WaHXH11ywzWWQrL8='}
2024-01-08T09:18:38.899 INFO:teuthology.orchestra.console.smithi080:Power off
2024-01-08T09:18:38.900 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-08T09:18:38.923 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off
2024-01-08T09:18:38.924 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T09:18:38.938 INFO:teuthology.orchestra.console.smithi084:Power off
2024-01-08T09:18:38.938 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-08T09:18:38.949 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off
2024-01-08T09:18:38.961 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off
2024-01-08T09:18:38.961 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T09:18:38.977 INFO:teuthology.orchestra.console.smithi099:Power off
2024-01-08T09:18:38.977 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-08T09:18:38.987 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off
2024-01-08T09:18:38.999 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2024-01-08T09:18:38.999 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-08T09:18:39.022 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-01-08T09:18:39.050 INFO:teuthology.orchestra.console.smithi080:Power off completed
2024-01-08T09:18:39.088 INFO:teuthology.orchestra.console.smithi084:Power off completed
2024-01-08T09:18:39.123 INFO:teuthology.orchestra.console.smithi099:Power off completed
2024-01-08T09:18:39.201 INFO:teuthology.lock.ops:unlocked: smithi080.front.sepia.ceph.com
2024-01-08T09:18:39.236 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com
2024-01-08T09:18:39.268 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com