2023-06-22T17:43:44.534 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-22T17:43:44.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T17:43:44.538 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T17:43:44.739 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fac2e2db700>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fac2f4f98b0>, signals=[15])
2023-06-22T17:43:44.741 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging
2023-06-22T17:43:44.741 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server
2023-06-22T17:43:44.742 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2023-06-22T17:43:44.768 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging
2023-06-22T17:43:44.769 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server
2023-06-22T17:43:44.769 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server
2023-06-22T17:43:44.770 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /host {"name": "smithi110"}
2023-06-22T17:43:44.793 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /host {"name": "smithi116"}
2023-06-22T17:43:44.851 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-06-22T17:43:44.861 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-06-22T17:43:44.889 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_rhel_8.4 (ID 7)
2023-06-22T17:43:44.890 DEBUG:teuthology.provision.fog.smithi110:FOG request: PUT /host/215 {"imageID": 7}
2023-06-22T17:43:44.910 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_rhel_8.4 (ID 7)
2023-06-22T17:43:44.910 DEBUG:teuthology.provision.fog.smithi116:FOG request: PUT /host/221 {"imageID": 7}
2023-06-22T17:43:44.951 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of rhel 8.4
2023-06-22T17:43:44.951 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:43:44.969 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of rhel 8.4
2023-06-22T17:43:44.970 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:43:45.004 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /tasktype {"name": "deploy"}
2023-06-22T17:43:45.015 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /tasktype {"name": "deploy"}
2023-06-22T17:43:45.040 DEBUG:teuthology.provision.fog.smithi110:FOG request: POST /host/215/task {"taskTypeID": 1}
2023-06-22T17:43:45.050 DEBUG:teuthology.provision.fog.smithi116:FOG request: POST /host/221/task {"taskTypeID": 1}
2023-06-22T17:43:45.089 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:43:45.103 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:43:45.184 INFO:teuthology.orchestra.console:Power off smithi110
2023-06-22T17:43:45.185 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-22T17:43:45.202 INFO:teuthology.orchestra.console:Power off smithi116
2023-06-22T17:43:45.203 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-22T17:43:45.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T17:43:45.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T17:43:45.339 INFO:teuthology.orchestra.console:Power off for smithi110 completed
2023-06-22T17:43:45.351 INFO:teuthology.orchestra.console:Power off for smithi116 completed
2023-06-22T17:43:45.441 INFO:teuthology.orchestra.console:Power on smithi110
2023-06-22T17:43:45.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-22T17:43:45.452 INFO:teuthology.orchestra.console:Power on smithi116
2023-06-22T17:43:45.453 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-22T17:43:45.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T17:43:45.474 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T17:43:49.493 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T17:43:49.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T17:43:49.704 INFO:teuthology.orchestra.console:Power on for smithi110 completed
2023-06-22T17:43:49.805 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish
2023-06-22T17:43:49.805 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:43:53.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T17:43:53.822 INFO:teuthology.orchestra.console:Power on for smithi116 completed
2023-06-22T17:43:53.924 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish
2023-06-22T17:43:53.924 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:44:04.876 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:44:08.980 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:44:19.938 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:44:24.028 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:44:34.998 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:44:39.080 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:44:50.057 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:44:54.144 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:45:05.115 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:45:09.208 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:45:20.166 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:45:24.260 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:45:35.232 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:45:39.314 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:45:50.291 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:45:54.365 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:46:05.360 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:46:09.420 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:46:20.424 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:46:24.472 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:46:35.485 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-06-22T17:46:35.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:46:39.524 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-22T17:46:39.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:46:53.936 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-06-22T17:46:58.032 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-06-22T17:46:59.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:47:02.992 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-06-22T17:47:04.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:47:07.088 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-06-22T17:47:08.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:47:12.048 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-06-22T17:47:13.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:47:16.144 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-06-22T17:47:18.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:47:21.104 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-06-22T17:47:22.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:47:25.200 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-06-22T17:47:27.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:47:31.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:48:27.122 WARNING:teuthology.provision.fog.smithi110:timed out
2023-06-22T17:48:31.208 WARNING:teuthology.provision.fog.smithi116:timed out
2023-06-22T17:48:33.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:48:33.420 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-22T17:48:33.421 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-22T17:48:33.708 INFO:teuthology.provision.fog.smithi110:Node is ready
2023-06-22T17:48:33.708 DEBUG:teuthology.orchestra.run.smithi110:> hostname
2023-06-22T17:48:33.723 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com
2023-06-22T17:48:33.723 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts
2023-06-22T17:48:33.782 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110
2023-06-22T17:48:33.782 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2023-06-22T17:48:33.889 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts
2023-06-22T17:48:33.913 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts
2023-06-22T17:48:33.981 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname
2023-06-22T17:48:34.048 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2023-06-22T17:48:34.115 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2023-06-22T17:48:34.172 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux"
2023-06-22T17:48:34.173 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.4 (Ootpa)"
2023-06-22T17:48:34.173 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel"
2023-06-22T17:48:34.173 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora"
2023-06-22T17:48:34.173 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.4"
2023-06-22T17:48:34.173 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8"
2023-06-22T17:48:34.173 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-22T17:48:34.173 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2023-06-22T17:48:34.174 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-22T17:48:34.174 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/"
2023-06-22T17:48:34.174 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-22T17:48:34.174 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-22T17:48:34.174 INFO:teuthology.orchestra.run.smithi110.stdout:
2023-06-22T17:48:34.174 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-22T17:48:34.174 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-22T17:48:34.175 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-22T17:48:34.175 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-22T17:48:34.175 INFO:teuthology.provision.fog.smithi110:Deploy complete!
2023-06-22T17:48:34.177 DEBUG:teuthology.parallel:result is None
2023-06-22T17:48:37.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:48:37.601 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-22T17:48:37.601 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-22T17:48:37.873 INFO:teuthology.provision.fog.smithi116:Node is ready
2023-06-22T17:48:37.873 DEBUG:teuthology.orchestra.run.smithi116:> hostname
2023-06-22T17:48:37.926 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com
2023-06-22T17:48:37.926 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts
2023-06-22T17:48:37.979 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116
2023-06-22T17:48:37.980 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116
2023-06-22T17:48:38.082 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts
2023-06-22T17:48:38.105 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts
2023-06-22T17:48:38.169 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname
2023-06-22T17:48:38.232 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116
2023-06-22T17:48:38.294 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release
2023-06-22T17:48:38.347 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux"
2023-06-22T17:48:38.347 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.4 (Ootpa)"
2023-06-22T17:48:38.347 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel"
2023-06-22T17:48:38.347 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora"
2023-06-22T17:48:38.347 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.4"
2023-06-22T17:48:38.348 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8"
2023-06-22T17:48:38.348 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-22T17:48:38.348 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31"
2023-06-22T17:48:38.348 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-22T17:48:38.348 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/"
2023-06-22T17:48:38.349 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-22T17:48:38.349 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-22T17:48:38.349 INFO:teuthology.orchestra.run.smithi116.stdout:
2023-06-22T17:48:38.349 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-22T17:48:38.349 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-22T17:48:38.349 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-22T17:48:38.350 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-22T17:48:38.350 INFO:teuthology.provision.fog.smithi116:Deploy complete!
2023-06-22T17:48:38.350 DEBUG:teuthology.parallel:result is None
2023-06-22T17:48:38.500 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com
2023-06-22T17:48:38.501 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-22T17:48:38.525 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com
2023-06-22T17:48:38.526 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-22T17:48:38.551 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server
2023-06-22T17:48:38.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2023-06-22T17:48:38.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:48:38.621 DEBUG:teuthology.orchestra.run.smithi110:> true
2023-06-22T17:48:38.693 DEBUG:teuthology.orchestra.run.smithi110:> uname -m
2023-06-22T17:48:38.749 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64
2023-06-22T17:48:38.749 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2023-06-22T17:48:38.805 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux"
2023-06-22T17:48:38.805 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.4 (Ootpa)"
2023-06-22T17:48:38.805 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel"
2023-06-22T17:48:38.805 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora"
2023-06-22T17:48:38.805 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.4"
2023-06-22T17:48:38.806 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8"
2023-06-22T17:48:38.806 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-22T17:48:38.806 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2023-06-22T17:48:38.806 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-22T17:48:38.806 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/"
2023-06-22T17:48:38.806 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-22T17:48:38.806 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-22T17:48:38.807 INFO:teuthology.orchestra.run.smithi110.stdout:
2023-06-22T17:48:38.807 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-22T17:48:38.807 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-22T17:48:38.807 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-22T17:48:38.807 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-22T17:48:38.808 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2023-06-22T17:48:38.833 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server
2023-06-22T17:48:38.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com'
2023-06-22T17:48:38.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T17:48:38.899 DEBUG:teuthology.orchestra.run.smithi116:> true
2023-06-22T17:48:38.962 DEBUG:teuthology.orchestra.run.smithi116:> uname -m
2023-06-22T17:48:39.015 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64
2023-06-22T17:48:39.015 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release
2023-06-22T17:48:39.067 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux"
2023-06-22T17:48:39.067 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.4 (Ootpa)"
2023-06-22T17:48:39.067 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel"
2023-06-22T17:48:39.067 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora"
2023-06-22T17:48:39.068 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.4"
2023-06-22T17:48:39.068 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8"
2023-06-22T17:48:39.068 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-22T17:48:39.068 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31"
2023-06-22T17:48:39.068 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-22T17:48:39.068 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/"
2023-06-22T17:48:39.069 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-22T17:48:39.069 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-22T17:48:39.069 INFO:teuthology.orchestra.run.smithi116.stdout:
2023-06-22T17:48:39.069 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-22T17:48:39.069 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-22T17:48:39.069 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-22T17:48:39.069 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-22T17:48:39.070 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server
2023-06-22T17:48:39.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T17:48:39.101 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T17:48:39.209 INFO:teuthology.dispatcher.supervisor:Running job 7311857
2023-06-22T17:48:39.209 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311857 --name yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} -- /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311857/orig.config.yaml
2023-06-22T17:48:39.213 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311857
2023-06-22T17:48:39.215 INFO:teuthology.dispatcher.supervisor:Job PID: 32085
2023-06-22T17:48:39.215 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-22T17:50:39.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T17:50:39.313 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T17:52:39.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T17:52:39.496 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T17:54:39.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T17:54:39.946 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T17:56:40.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T17:56:40.076 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T17:58:40.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T17:58:40.254 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T18:00:40.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T18:00:40.429 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T18:02:40.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T18:02:40.598 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T18:04:40.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T18:04:40.775 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T18:06:40.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T18:06:40.954 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T18:08:41.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T18:08:41.109 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T18:08:41.175 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-06-22T18:08:41.298 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-06-22T18:08:41.299 INFO:teuthology.nuke:Checking targets against current locks
2023-06-22T18:08:41.350 DEBUG:teuthology.nuke:shortname: smithi110
2023-06-22T18:08:41.350 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-22T18:08:41.369 DEBUG:teuthology.nuke:shortname: smithi116
2023-06-22T18:08:41.369 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-22T18:08:41.373 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311857', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 17:43:43.671000', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE8qRhuRUXj1iFiQd/Gr7ahxAb/xrAR5aYNjNZNzG8lND1ManSzV5hIdYStVClXN02MXcaxubtpjWEjQm1azrps='}
2023-06-22T18:08:41.390 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311857', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 17:43:43.672957', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOlY0LD4+AaVWVxqWRbI1ZOcEjeJnJyA/uEqjVQqVqKkgaSUHAk8XiDdozZLzJuZTuX+5Sc911PDBBIpIciEguKTBN1jMRTf4XX0SDPQbjZfukPSSEBZGxWzuVyfPk1UlCGdlHbkGHH0xwvWBerXFjA7qSH4rXOR7NizG70cnbCdih0S/hzVNGJDLVSvJ5gAiqE6PxjQ7Zf3zLNiwzvMhD4dolr7HwhSnAOddGaqSo8ZU+6VM+BYWFy2syLN7tDV1f8UCYt26ItcV6MMvwQRI4usWpNssQnI8J2j2Dn2PmPBdNFnmwFp4UyKK7Aq0lT032ygSvVdD7Oa5ZKlFg1UaZcNXfAZudG/qXwN0rzebd4cvKVq0Hw3jpHiTLqYGqQtE2Cz1iFmmoD7LSoVBXGItMBZJw+L+UhlkM0+wXAk/44WSV0CRMOcR8aDx5NiCnHv5Vw3NED+SpkjGsLzFTwwWQQoWIf39TilTSGqpZrWnp9ulvrgIv7VAVEAD6fiaVPqU='}
2023-06-22T18:08:41.424 INFO:teuthology.orchestra.console:Power off smithi110
2023-06-22T18:08:41.424 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-22T18:08:41.443 INFO:teuthology.orchestra.console:Power off smithi116
2023-06-22T18:08:41.444 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-22T18:08:41.453 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T18:08:41.465 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T18:08:41.574 INFO:teuthology.orchestra.console:Power off for smithi110 completed
2023-06-22T18:08:41.588 INFO:teuthology.orchestra.console:Power off for smithi116 completed
2023-06-22T18:08:41.734 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com
2023-06-22T18:08:41.740 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com