2024-01-24T12:40:28.091 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-24T12:40:28.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T12:40:28.273 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6e4f7dcf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6e50842c10>, signals=[15])
2024-01-24T12:40:28.274 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging
2024-01-24T12:40:28.274 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T12:40:28.274 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2024-01-24T12:40:28.304 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2024-01-24T12:40:28.304 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T12:40:28.304 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-01-24T12:40:28.328 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging
2024-01-24T12:40:28.328 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T12:40:28.329 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2024-01-24T12:40:28.415 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-24T12:40:28.437 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-24T12:40:28.458 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of rhel 8.6
2024-01-24T12:40:28.461 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-24T12:40:28.475 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of rhel 8.6
2024-01-24T12:40:28.501 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of rhel 8.6
2024-01-24T12:40:28.694 INFO:teuthology.orchestra.console.smithi072:Power off
2024-01-24T12:40:28.695 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T12:40:28.717 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off
2024-01-24T12:40:28.718 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:28.731 INFO:teuthology.orchestra.console.smithi119:Power off
2024-01-24T12:40:28.731 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T12:40:28.743 INFO:teuthology.orchestra.console.smithi159:Power off
2024-01-24T12:40:28.743 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T12:40:28.751 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-01-24T12:40:28.751 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2024-01-24T12:40:28.752 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:28.764 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2024-01-24T12:40:28.764 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:28.775 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-01-24T12:40:28.787 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2024-01-24T12:40:32.756 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:32.776 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:32.787 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:32.869 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-01-24T12:40:32.885 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-01-24T12:40:32.896 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2024-01-24T12:40:36.872 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:36.885 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:36.897 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:36.982 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-01-24T12:40:36.994 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-01-24T12:40:37.008 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2024-01-24T12:40:37.083 INFO:teuthology.orchestra.console.smithi072:Power off completed
2024-01-24T12:40:37.108 INFO:teuthology.orchestra.console.smithi159:Power off completed
2024-01-24T12:40:37.185 INFO:teuthology.orchestra.console.smithi072:Power on
2024-01-24T12:40:37.185 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T12:40:37.208 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On
2024-01-24T12:40:37.209 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:37.217 INFO:teuthology.orchestra.console.smithi159:Power on
2024-01-24T12:40:37.217 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T12:40:37.230 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-01-24T12:40:37.238 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On
2024-01-24T12:40:37.238 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:37.260 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2024-01-24T12:40:40.996 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:41.106 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-01-24T12:40:41.206 INFO:teuthology.orchestra.console.smithi119:Power off completed
2024-01-24T12:40:41.231 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:41.261 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:41.307 INFO:teuthology.orchestra.console.smithi119:Power on
2024-01-24T12:40:41.308 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T12:40:41.332 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On
2024-01-24T12:40:41.332 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:41.341 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-01-24T12:40:41.355 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-01-24T12:40:41.371 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2024-01-24T12:40:45.344 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:45.355 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:45.371 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:45.453 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-01-24T12:40:45.464 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-01-24T12:40:45.480 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2024-01-24T12:40:45.554 INFO:teuthology.orchestra.console.smithi072:Power on completed
2024-01-24T12:40:45.583 INFO:teuthology.orchestra.console.smithi159:Power on completed
2024-01-24T12:40:45.655 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish
2024-01-24T12:40:45.684 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2024-01-24T12:40:49.468 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T12:40:49.581 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-01-24T12:40:49.681 INFO:teuthology.orchestra.console.smithi119:Power on completed
2024-01-24T12:40:49.782 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2024-01-24T12:43:31.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:43:34.624 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-24T12:43:35.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:43:38.588 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-01-24T12:43:40.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:43:43.712 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-24T12:43:44.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:43:47.646 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-01-24T12:43:49.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:43:52.796 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-24T12:43:53.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:43:56.700 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-01-24T12:43:58.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:44:01.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:44:01.856 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-24T12:44:02.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:44:04.732 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-01-24T12:44:05.760 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-01-24T12:44:07.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:44:10.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:44:10.944 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-24T12:44:11.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:44:13.788 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-01-24T12:44:14.848 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-01-24T12:44:16.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:44:19.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:44:19.996 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-24T12:44:20.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:44:22.848 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-01-24T12:44:26.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:44:28.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:44:29.052 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-24T12:44:31.936 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-01-24T12:44:35.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:44:37.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:44:41.024 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-01-24T12:44:47.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:45:20.887 WARNING:teuthology.provision.fog.smithi119:timed out
2024-01-24T12:45:26.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:45:27.106 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T12:45:27.106 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T12:45:27.356 INFO:teuthology.provision.fog.smithi119:Node is ready
2024-01-24T12:45:27.356 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2024-01-24T12:45:27.373 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119
2024-01-24T12:45:27.373 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119 /etc/hosts
2024-01-24T12:45:27.430 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2024-01-24T12:45:27.431 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-01-24T12:45:27.542 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119/smithi119/g' /etc/hosts
2024-01-24T12:45:27.569 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2024-01-24T12:45:27.636 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119/smithi119/g' /etc/hostname
2024-01-24T12:45:27.703 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-01-24T12:45:27.769 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-01-24T12:45:27.826 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T12:45:27.826 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T12:45:27.826 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2024-01-24T12:45:27.826 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2024-01-24T12:45:27.826 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6"
2024-01-24T12:45:27.827 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2024-01-24T12:45:27.827 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T12:45:27.827 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-01-24T12:45:27.827 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T12:45:27.827 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T12:45:27.827 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T12:45:27.827 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T12:45:27.827 INFO:teuthology.orchestra.run.smithi119.stdout:
2024-01-24T12:45:27.827 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T12:45:27.827 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T12:45:27.827 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T12:45:27.827 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T12:45:27.828 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2024-01-24T12:45:27.829 DEBUG:teuthology.parallel:result is None
2024-01-24T12:45:35.064 WARNING:teuthology.provision.fog.smithi159:timed out
2024-01-24T12:45:41.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:45:41.333 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T12:45:41.334 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T12:45:41.582 INFO:teuthology.provision.fog.smithi159:Node is ready
2024-01-24T12:45:41.582 DEBUG:teuthology.orchestra.run.smithi159:> hostname
2024-01-24T12:45:41.641 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com
2024-01-24T12:45:41.641 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts
2024-01-24T12:45:41.700 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2024-01-24T12:45:41.700 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2024-01-24T12:45:41.824 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts
2024-01-24T12:45:41.853 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts
2024-01-24T12:45:41.922 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname
2024-01-24T12:45:41.990 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2024-01-24T12:45:42.057 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2024-01-24T12:45:42.115 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T12:45:42.115 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T12:45:42.115 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2024-01-24T12:45:42.115 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2024-01-24T12:45:42.115 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.6"
2024-01-24T12:45:42.115 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2024-01-24T12:45:42.115 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T12:45:42.115 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2024-01-24T12:45:42.115 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T12:45:42.116 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T12:45:42.116 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T12:45:42.116 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T12:45:42.116 INFO:teuthology.orchestra.run.smithi159.stdout:
2024-01-24T12:45:42.116 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T12:45:42.116 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T12:45:42.116 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T12:45:42.116 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T12:45:42.116 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2024-01-24T12:45:42.117 DEBUG:teuthology.parallel:result is None
2024-01-24T12:45:47.032 WARNING:teuthology.provision.fog.smithi072:timed out
2024-01-24T12:45:53.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:45:53.316 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T12:45:53.316 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T12:45:58.589 INFO:teuthology.provision.fog.smithi072:Node is ready
2024-01-24T12:45:58.590 DEBUG:teuthology.orchestra.run.smithi072:> hostname
2024-01-24T12:45:58.651 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com
2024-01-24T12:45:58.652 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts
2024-01-24T12:45:58.711 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072
2024-01-24T12:45:58.711 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072
2024-01-24T12:45:58.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts
2024-01-24T12:45:58.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts
2024-01-24T12:45:58.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname
2024-01-24T12:45:59.019 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072
2024-01-24T12:45:59.086 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release
2024-01-24T12:45:59.144 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T12:45:59.144 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T12:45:59.144 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel"
2024-01-24T12:45:59.144 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora"
2024-01-24T12:45:59.144 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6"
2024-01-24T12:45:59.145 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8"
2024-01-24T12:45:59.145 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T12:45:59.145 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31"
2024-01-24T12:45:59.145 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T12:45:59.145 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T12:45:59.145 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T12:45:59.145 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T12:45:59.145 INFO:teuthology.orchestra.run.smithi072.stdout:
2024-01-24T12:45:59.145 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T12:45:59.145 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T12:45:59.145 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T12:45:59.145 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T12:45:59.146 INFO:teuthology.provision.fog.smithi072:Deploy complete!
2024-01-24T12:45:59.146 DEBUG:teuthology.parallel:result is None
2024-01-24T12:45:59.387 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com
2024-01-24T12:45:59.387 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T12:45:59.412 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2024-01-24T12:45:59.412 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T12:45:59.438 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2024-01-24T12:45:59.439 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T12:45:59.455 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server
2024-01-24T12:45:59.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com'
2024-01-24T12:45:59.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:45:59.535 DEBUG:teuthology.orchestra.run.smithi072:> true
2024-01-24T12:45:59.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com'
2024-01-24T12:45:59.601 DEBUG:teuthology.orchestra.run.smithi072:> uname -m
2024-01-24T12:45:59.657 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64
2024-01-24T12:45:59.657 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release
2024-01-24T12:45:59.715 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T12:45:59.715 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T12:45:59.715 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel"
2024-01-24T12:45:59.715 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora"
2024-01-24T12:45:59.715 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6"
2024-01-24T12:45:59.715 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8"
2024-01-24T12:45:59.715 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T12:45:59.716 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31"
2024-01-24T12:45:59.716 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T12:45:59.716 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T12:45:59.716 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T12:45:59.716 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T12:45:59.716 INFO:teuthology.orchestra.run.smithi072.stdout:
2024-01-24T12:45:59.716 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T12:45:59.716 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T12:45:59.716 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T12:45:59.716 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T12:45:59.717 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2024-01-24T12:45:59.738 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2024-01-24T12:45:59.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-01-24T12:45:59.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:45:59.812 DEBUG:teuthology.orchestra.run.smithi119:> true
2024-01-24T12:45:59.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-01-24T12:45:59.950 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2024-01-24T12:46:00.008 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2024-01-24T12:46:00.008 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-01-24T12:46:00.065 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T12:46:00.065 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T12:46:00.065 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2024-01-24T12:46:00.065 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2024-01-24T12:46:00.066 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6"
2024-01-24T12:46:00.066 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2024-01-24T12:46:00.066 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T12:46:00.066 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-01-24T12:46:00.066 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T12:46:00.066 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T12:46:00.066 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T12:46:00.066 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T12:46:00.066 INFO:teuthology.orchestra.run.smithi119.stdout:
2024-01-24T12:46:00.066 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T12:46:00.066 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T12:46:00.066 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T12:46:00.066 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T12:46:00.067 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-01-24T12:46:00.087 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2024-01-24T12:46:00.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2024-01-24T12:46:00.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T12:46:00.177 DEBUG:teuthology.orchestra.run.smithi159:> true
2024-01-24T12:46:00.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com'
2024-01-24T12:46:00.319 DEBUG:teuthology.orchestra.run.smithi159:> uname -m
2024-01-24T12:46:00.378 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2024-01-24T12:46:00.379 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2024-01-24T12:46:00.437 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T12:46:00.438 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T12:46:00.438 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2024-01-24T12:46:00.438 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2024-01-24T12:46:00.438 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.6"
2024-01-24T12:46:00.438 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2024-01-24T12:46:00.438 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T12:46:00.438 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2024-01-24T12:46:00.438 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T12:46:00.438 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T12:46:00.438 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T12:46:00.438 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T12:46:00.438 INFO:teuthology.orchestra.run.smithi159.stdout:
2024-01-24T12:46:00.439 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T12:46:00.439 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T12:46:00.439 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T12:46:00.439 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T12:46:00.439 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2024-01-24T12:46:00.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T12:46:00.559 INFO:teuthology.dispatcher.supervisor:Running job 7530788
2024-01-24T12:46:00.559 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530788 --name vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530788/orig.config.yaml
2024-01-24T12:46:00.561 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530788
2024-01-24T12:46:00.562 INFO:teuthology.dispatcher.supervisor:Job PID: 2827257
2024-01-24T12:46:00.562 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-24T12:48:00.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T12:50:00.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T12:52:00.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T12:54:01.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T12:56:01.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T12:58:01.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T13:00:01.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T13:02:01.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T13:04:01.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T13:06:02.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T13:08:02.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T13:10:02.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T13:10:02.528 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-24T13:10:02.663 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-24T13:10:02.663 INFO:teuthology.nuke:Checking targets against current locks
2024-01-24T13:10:02.714 DEBUG:teuthology.nuke:shortname: smithi072
2024-01-24T13:10:02.715 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T13:10:02.736 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530788', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 12:40:26.981901', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH1pFuN0ac6Mp3ZwMih2VJLeHGtsJhUpg9RByUGjV57ksU33bBE6a6yc0aq5VSwDUHhN/kZUHTr8pY0pEMSUOaI='}
2024-01-24T13:10:02.739 DEBUG:teuthology.nuke:shortname: smithi119
2024-01-24T13:10:02.739 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T13:10:02.755 DEBUG:teuthology.nuke:shortname: smithi159
2024-01-24T13:10:02.755 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T13:10:02.759 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530788', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 12:40:26.980095', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP7F1Ep6aW88ke7B4ROKjSHW1UuJSbwhugzajwO+8Fk/vkEqvi1VFpg+UtpgIeX+NNda+Z9f81tbY9KQ4YNp3gw='}
2024-01-24T13:10:02.778 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530788', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 12:40:26.978118', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBmBPziAu7xGq8+kdZoxPipXdxxmGNP5QY2+QvzCFev66dPvu8GRya9JFtnRj11ZTXyxFBxCeX3gaFgT980K6nY='}
2024-01-24T13:10:02.787 INFO:teuthology.orchestra.console.smithi072:Power off
2024-01-24T13:10:02.787 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T13:10:02.808 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off
2024-01-24T13:10:02.809 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T13:10:02.824 INFO:teuthology.orchestra.console.smithi119:Power off
2024-01-24T13:10:02.825 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T13:10:02.834 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-01-24T13:10:02.846 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2024-01-24T13:10:02.846 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T13:10:02.860 INFO:teuthology.orchestra.console.smithi159:Power off
2024-01-24T13:10:02.861 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T13:10:02.869 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-01-24T13:10:02.881 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2024-01-24T13:10:02.882 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T13:10:02.904 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2024-01-24T13:10:02.934 INFO:teuthology.orchestra.console.smithi072:Power off completed
2024-01-24T13:10:02.970 INFO:teuthology.orchestra.console.smithi119:Power off completed
2024-01-24T13:10:03.005 INFO:teuthology.orchestra.console.smithi159:Power off completed
2024-01-24T13:10:03.085 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com
2024-01-24T13:10:03.110 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com
2024-01-24T13:10:03.151 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com