2023-07-20T15:22:06.629 INFO:root:teuthology version: 0.0.1.dev153+g79491cb
2023-07-20T15:22:06.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:22:06.631 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:22:06.772 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb70c240550>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb70bbc6f70>, signals=[15])
2023-07-20T15:22:06.774 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging
2023-07-20T15:22:06.775 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server
2023-07-20T15:22:06.775 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2023-07-20T15:22:06.815 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging
2023-07-20T15:22:06.816 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server
2023-07-20T15:22:06.816 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2023-07-20T15:22:06.817 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /host {"name": "smithi061"}
2023-07-20T15:22:06.871 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"}
2023-07-20T15:22:06.889 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-07-20T15:22:06.937 DEBUG:teuthology.provision.fog.smithi061:Requesting image smithi_rhel_8.4 (ID 7)
2023-07-20T15:22:06.937 DEBUG:teuthology.provision.fog.smithi061:FOG request: PUT /host/166 {"imageID": 7}
2023-07-20T15:22:06.940 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-07-20T15:22:06.979 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_rhel_8.4 (ID 7)
2023-07-20T15:22:06.979 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 7}
2023-07-20T15:22:06.982 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of rhel 8.4
2023-07-20T15:22:06.982 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:22:07.026 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of rhel 8.4
2023-07-20T15:22:07.026 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:22:07.047 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /tasktype {"name": "deploy"}
2023-07-20T15:22:07.091 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"}
2023-07-20T15:22:07.093 DEBUG:teuthology.provision.fog.smithi061:FOG request: POST /host/166/task {"taskTypeID": 1}
2023-07-20T15:22:07.130 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1}
2023-07-20T15:22:07.138 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:22:07.193 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:22:07.255 INFO:teuthology.orchestra.console:Power off smithi061
2023-07-20T15:22:07.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T15:22:07.278 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T15:22:07.303 INFO:teuthology.orchestra.console:Power off smithi186
2023-07-20T15:22:07.304 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T15:22:07.325 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T15:22:11.314 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T15:22:11.349 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T15:22:15.428 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T15:22:15.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T15:22:15.639 INFO:teuthology.orchestra.console:Power off for smithi061 completed
2023-07-20T15:22:15.740 INFO:teuthology.orchestra.console:Power on smithi061
2023-07-20T15:22:15.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-20T15:22:15.761 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T15:22:19.573 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T15:22:19.781 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T15:22:19.789 INFO:teuthology.orchestra.console:Power off for smithi186 completed
2023-07-20T15:22:19.892 INFO:teuthology.orchestra.console:Power on smithi186
2023-07-20T15:22:19.893 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-20T15:22:19.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T15:22:20.001 INFO:teuthology.orchestra.console:Power on for smithi061 completed
2023-07-20T15:22:20.102 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish
2023-07-20T15:22:20.102 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:22:23.939 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T15:22:24.148 INFO:teuthology.orchestra.console:Power on for smithi186 completed
2023-07-20T15:22:24.249 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish
2023-07-20T15:22:24.250 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:22:35.189 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:22:39.327 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:22:50.282 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:22:54.422 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:23:05.376 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:23:09.522 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:23:20.486 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:23:24.620 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:23:35.600 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:23:39.728 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:23:50.724 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:23:54.808 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:24:05.820 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:24:09.896 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:24:20.942 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:24:24.971 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:24:36.042 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:24:40.068 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:24:51.140 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:24:55.152 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:25:06.244 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:25:10.220 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:25:21.324 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None
2023-07-20T15:25:21.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:25:24.464 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-07-20T15:25:25.288 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-20T15:25:25.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:25:28.432 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-07-20T15:25:30.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:25:33.520 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-07-20T15:25:34.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:25:37.488 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-07-20T15:25:39.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:25:42.576 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-07-20T15:25:43.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:25:46.544 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-07-20T15:25:48.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:25:51.632 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-07-20T15:25:52.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:25:55.604 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-07-20T15:25:57.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:26:00.688 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-07-20T15:26:01.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:26:04.656 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-07-20T15:26:06.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:26:09.744 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61
2023-07-20T15:26:10.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:26:13.716 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-07-20T15:26:15.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:26:19.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:26:22.804 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-07-20T15:26:28.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:27:15.797 WARNING:teuthology.provision.fog.smithi061:timed out
2023-07-20T15:27:21.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:27:22.103 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-20T15:27:22.104 DEBUG:teuthology.orchestra.run.smithi061:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-20T15:27:22.405 INFO:teuthology.provision.fog.smithi061:Node is ready
2023-07-20T15:27:22.406 DEBUG:teuthology.orchestra.run.smithi061:> hostname
2023-07-20T15:27:22.459 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com
2023-07-20T15:27:22.459 DEBUG:teuthology.orchestra.run.smithi061:> grep smithi061.front.sepia.ceph.com /etc/hosts
2023-07-20T15:27:22.513 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061
2023-07-20T15:27:22.514 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061
2023-07-20T15:27:22.627 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hosts
2023-07-20T15:27:22.652 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/172.21.15.61/172.21.15.61/g' /etc/hosts
2023-07-20T15:27:22.720 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hostname
2023-07-20T15:27:22.788 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061
2023-07-20T15:27:22.855 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release
2023-07-20T15:27:22.912 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux"
2023-07-20T15:27:22.912 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.4 (Ootpa)"
2023-07-20T15:27:22.912 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel"
2023-07-20T15:27:22.912 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora"
2023-07-20T15:27:22.912 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.4"
2023-07-20T15:27:22.913 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8"
2023-07-20T15:27:22.913 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-20T15:27:22.913 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31"
2023-07-20T15:27:22.913 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-20T15:27:22.913 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/"
2023-07-20T15:27:22.913 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-20T15:27:22.914 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T15:27:22.914 INFO:teuthology.orchestra.run.smithi061.stdout:
2023-07-20T15:27:22.914 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-20T15:27:22.914 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-20T15:27:22.914 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-20T15:27:22.914 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-20T15:27:22.915 INFO:teuthology.provision.fog.smithi061:Deploy complete!
2023-07-20T15:27:22.916 DEBUG:teuthology.parallel:result is None
2023-07-20T15:27:28.816 WARNING:teuthology.provision.fog.smithi186:timed out
2023-07-20T15:27:34.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:27:35.131 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-20T15:27:35.132 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-20T15:27:35.388 INFO:teuthology.provision.fog.smithi186:Node is ready
2023-07-20T15:27:35.388 DEBUG:teuthology.orchestra.run.smithi186:> hostname
2023-07-20T15:27:35.444 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186
2023-07-20T15:27:35.445 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186 /etc/hosts
2023-07-20T15:27:35.500 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186
2023-07-20T15:27:35.501 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186
2023-07-20T15:27:35.615 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186/smithi186/g' /etc/hosts
2023-07-20T15:27:35.641 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts
2023-07-20T15:27:35.706 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186/smithi186/g' /etc/hostname
2023-07-20T15:27:35.771 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186
2023-07-20T15:27:35.836 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release
2023-07-20T15:27:35.891 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux"
2023-07-20T15:27:35.891 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.4 (Ootpa)"
2023-07-20T15:27:35.891 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel"
2023-07-20T15:27:35.891 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora"
2023-07-20T15:27:35.891 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.4"
2023-07-20T15:27:35.892 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8"
2023-07-20T15:27:35.892 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-20T15:27:35.892 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31"
2023-07-20T15:27:35.892 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-20T15:27:35.892 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/"
2023-07-20T15:27:35.892 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-20T15:27:35.892 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T15:27:35.893 INFO:teuthology.orchestra.run.smithi186.stdout:
2023-07-20T15:27:35.893 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-20T15:27:35.893 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-20T15:27:35.893 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-20T15:27:35.893 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-20T15:27:35.893 INFO:teuthology.provision.fog.smithi186:Deploy complete!
2023-07-20T15:27:35.894 DEBUG:teuthology.parallel:result is None
2023-07-20T15:27:36.050 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com
2023-07-20T15:27:36.051 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-20T15:27:36.077 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com
2023-07-20T15:27:36.077 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-20T15:27:36.095 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server
2023-07-20T15:27:36.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com'
2023-07-20T15:27:36.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:27:36.161 DEBUG:teuthology.orchestra.run.smithi061:> true
2023-07-20T15:27:36.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi061.front.sepia.ceph.com'
2023-07-20T15:27:36.280 DEBUG:teuthology.orchestra.run.smithi061:> uname -m
2023-07-20T15:27:36.335 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64
2023-07-20T15:27:36.335 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release
2023-07-20T15:27:36.389 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux"
2023-07-20T15:27:36.390 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.4 (Ootpa)"
2023-07-20T15:27:36.390 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel"
2023-07-20T15:27:36.390 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora"
2023-07-20T15:27:36.390 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.4"
2023-07-20T15:27:36.390 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8"
2023-07-20T15:27:36.390 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-20T15:27:36.390 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31"
2023-07-20T15:27:36.391 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-20T15:27:36.391 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/"
2023-07-20T15:27:36.391 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-20T15:27:36.391 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T15:27:36.391 INFO:teuthology.orchestra.run.smithi061.stdout:
2023-07-20T15:27:36.391 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-20T15:27:36.391 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-20T15:27:36.392 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-20T15:27:36.392 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-20T15:27:36.392 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2023-07-20T15:27:36.419 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server
2023-07-20T15:27:36.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com'
2023-07-20T15:27:36.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T15:27:36.482 DEBUG:teuthology.orchestra.run.smithi186:> true
2023-07-20T15:27:36.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com'
2023-07-20T15:27:36.548 DEBUG:teuthology.orchestra.run.smithi186:> uname -m
2023-07-20T15:27:36.602 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64
2023-07-20T15:27:36.603 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release
2023-07-20T15:27:36.657 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux"
2023-07-20T15:27:36.657 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.4 (Ootpa)"
2023-07-20T15:27:36.658 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel"
2023-07-20T15:27:36.658 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora"
2023-07-20T15:27:36.658 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.4"
2023-07-20T15:27:36.658 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8"
2023-07-20T15:27:36.658 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-20T15:27:36.658 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31"
2023-07-20T15:27:36.658 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-20T15:27:36.659 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/"
2023-07-20T15:27:36.659 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-20T15:27:36.659 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T15:27:36.659 INFO:teuthology.orchestra.run.smithi186.stdout:
2023-07-20T15:27:36.659 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-20T15:27:36.659 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-20T15:27:36.659 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-20T15:27:36.660 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-20T15:27:36.660 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2023-07-20T15:27:36.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:27:36.686 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:27:36.783 INFO:teuthology.dispatcher.supervisor:Running job 7344792
2023-07-20T15:27:36.783 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-20_14:36:46-fs-wip-yuri-testing-2023-07-19-1340-pacific-distro-default-smithi/7344792 --name yuriw-2023-07-20_14:36:46-fs-wip-yuri-testing-2023-07-19-1340-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} -- /home/teuthworker/archive/yuriw-2023-07-20_14:36:46-fs-wip-yuri-testing-2023-07-19-1340-pacific-distro-default-smithi/7344792/orig.config.yaml
2023-07-20T15:27:36.786 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-20_14:36:46-fs-wip-yuri-testing-2023-07-19-1340-pacific-distro-default-smithi/7344792
2023-07-20T15:27:36.787 INFO:teuthology.dispatcher.supervisor:Job PID: 3004
2023-07-20T15:27:36.787 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-20T15:29:36.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:29:36.879 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:31:37.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:31:37.060 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:33:37.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:33:37.242 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:35:37.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:35:37.418 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:37:37.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:37:37.582 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:39:37.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:39:37.757 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:41:37.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:41:37.929 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:43:38.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:43:38.096 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:45:38.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:45:38.267 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:47:38.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:47:38.437 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:49:38.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:49:38.609 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:51:38.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:51:38.786 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:53:38.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:53:38.961 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:55:39.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:55:39.134 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:57:39.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:57:39.312 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T15:59:39.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T15:59:39.476 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T16:01:39.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T16:01:39.650 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T16:03:39.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T16:03:39.835 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T16:05:40.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T16:05:40.006 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T16:07:40.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T16:07:40.182 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T16:09:40.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T16:09:40.354 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T16:11:40.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T16:11:40.530 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T16:13:40.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T16:13:40.701 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T16:13:40.772 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-20T16:13:40.880 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-20T16:13:40.881 INFO:teuthology.nuke:Checking targets against current locks
2023-07-20T16:13:40.930 DEBUG:teuthology.nuke:shortname: smithi061
2023-07-20T16:13:40.931 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-20T16:13:40.956 DEBUG:teuthology.nuke:shortname: smithi186
2023-07-20T16:13:40.957 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-20T16:13:40.961 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-20_14:36:46-fs-wip-yuri-testing-2023-07-19-1340-pacific-distro-default-smithi/7344792', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 15:22:05.825429', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOkgQgwCT2K9Y6y4nJ0deiaDQsThNXKPerc33lLJ058/5jW/P2Z+mc0QsPIbIffGqokIr9GwV7/8Fwxy3zcNtiyfBGb9YbjGHMsy6+zi90PA8lK2gnbWozLZYlIoUoIbe0fPmrIMIxV4UDLtpuiG4rD2rPhAZRBa0HlQhq4DbfZMZ+6Yhn0+PR+SAndFnFK5oGyqHalWizLKrHyQheOQmfHhNnM5zo91FfO7JfIRnzBicWXCL2UlRJdG6olQ0vhFFhlHNE8ek10ixJzEuT0Y0ItVsvDHfrQr+BHHWjudU6SYtj1BE7hUVVphyt1NBf04jMlAbhx0DusYonxxCgrKGZsGDbbxC4WG5FUNu5CV6EsClOSRoylApZnsfIsJdnxzjcR7SfKZK0bqVfCPRiv5OjyBB3AUX31juoQRFm148+o5w9rTLtdmn1YWBYr6kDrp+kwMGIDmWSf3py2bDK8qyusBJsOGKaXFU46XrLQ8XIpAhwpq540B1oLZujVj32wTU='}
2023-07-20T16:13:40.984 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-20_14:36:46-fs-wip-yuri-testing-2023-07-19-1340-pacific-distro-default-smithi/7344792', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 15:22:05.823068', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL2tMDmhDkqfefyWvhUPjFJDUo6hnkZpoGT7LlpWAS29obw3Q+URrpwPZfTqkuDR6+KHY4Q3tWriHagn1bEbF9Y='}
2023-07-20T16:13:41.014 INFO:teuthology.orchestra.console:Power off smithi061
2023-07-20T16:13:41.014 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T16:13:41.035 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T16:13:41.058 INFO:teuthology.orchestra.console:Power off smithi186
2023-07-20T16:13:41.058 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T16:13:41.081 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T16:13:41.169 INFO:teuthology.orchestra.console:Power off for smithi061 completed
2023-07-20T16:13:41.205 INFO:teuthology.orchestra.console:Power off for smithi186 completed
2023-07-20T16:13:41.329 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com
2023-07-20T16:13:41.354 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com