2023-07-11T20:34:28.898 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-11T20:34:28.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:34:28.899 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:34:29.042 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f294af3c5e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f294a8c1e50>, signals=[15])
2023-07-11T20:34:29.044 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging
2023-07-11T20:34:29.045 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T20:34:29.046 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2023-07-11T20:34:29.065 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging
2023-07-11T20:34:29.065 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T20:34:29.066 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2023-07-11T20:34:29.067 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /host {"name": "smithi097"}
2023-07-11T20:34:29.090 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"}
2023-07-11T20:34:29.139 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-07-11T20:34:29.149 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-07-11T20:34:29.183 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_rhel_8.4 (ID 7)
2023-07-11T20:34:29.184 DEBUG:teuthology.provision.fog.smithi097:FOG request: PUT /host/202 {"imageID": 7}
2023-07-11T20:34:29.187 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_rhel_8.4 (ID 7)
2023-07-11T20:34:29.187 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 7}
2023-07-11T20:34:29.218 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of rhel 8.4
2023-07-11T20:34:29.218 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T20:34:29.229 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of rhel 8.4
2023-07-11T20:34:29.229 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:34:29.265 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T20:34:29.270 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T20:34:29.301 DEBUG:teuthology.provision.fog.smithi097:FOG request: POST /host/202/task {"taskTypeID": 1}
2023-07-11T20:34:29.303 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1}
2023-07-11T20:34:29.355 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:34:29.363 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T20:34:29.429 INFO:teuthology.orchestra.console:Power off smithi167
2023-07-11T20:34:29.430 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T20:34:29.445 INFO:teuthology.orchestra.console:Power off smithi097
2023-07-11T20:34:29.446 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T20:34:29.456 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:34:29.468 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:34:29.580 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2023-07-11T20:34:29.590 INFO:teuthology.orchestra.console:Power off for smithi097 completed
2023-07-11T20:34:29.682 INFO:teuthology.orchestra.console:Power on smithi167
2023-07-11T20:34:29.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T20:34:29.691 INFO:teuthology.orchestra.console:Power on smithi097
2023-07-11T20:34:29.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T20:34:29.707 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:34:29.720 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:34:33.736 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:34:33.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:34:37.851 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:34:37.859 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:34:38.061 INFO:teuthology.orchestra.console:Power on for smithi167 completed
2023-07-11T20:34:38.068 INFO:teuthology.orchestra.console:Power on for smithi097 completed
2023-07-11T20:34:38.163 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish
2023-07-11T20:34:38.163 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:34:38.170 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish
2023-07-11T20:34:38.170 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T20:34:53.252 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:34:53.253 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T20:35:08.336 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T20:35:08.337 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:35:23.417 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T20:35:23.418 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:35:38.524 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T20:35:38.530 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:35:53.646 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:35:53.647 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T20:36:08.789 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T20:36:08.791 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:36:23.893 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:36:23.898 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T20:36:39.026 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T20:36:39.028 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:36:54.141 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:36:54.164 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T20:37:09.258 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:37:09.261 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T20:37:09.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:37:24.376 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:37:27.792 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T20:37:33.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:37:36.880 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T20:37:39.477 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:37:42.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:37:45.936 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T20:37:51.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:37:54.587 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:37:54.992 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T20:38:00.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:38:04.048 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T20:38:09.693 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:38:10.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:38:24.779 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:38:39.886 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:38:54.973 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:39:10.064 WARNING:teuthology.provision.fog.smithi097:timed out
2023-07-11T20:39:10.067 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:39:16.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:39:16.400 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T20:39:16.401 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T20:39:16.657 INFO:teuthology.provision.fog.smithi097:Node is ready
2023-07-11T20:39:16.658 DEBUG:teuthology.orchestra.run.smithi097:> hostname
2023-07-11T20:39:16.673 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com
2023-07-11T20:39:16.673 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts
2023-07-11T20:39:16.728 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097
2023-07-11T20:39:16.728 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2023-07-11T20:39:16.837 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts
2023-07-11T20:39:16.862 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts
2023-07-11T20:39:16.926 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname
2023-07-11T20:39:16.990 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2023-07-11T20:39:17.052 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2023-07-11T20:39:17.105 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux"
2023-07-11T20:39:17.106 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.4 (Ootpa)"
2023-07-11T20:39:17.106 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel"
2023-07-11T20:39:17.106 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora"
2023-07-11T20:39:17.106 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.4"
2023-07-11T20:39:17.106 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8"
2023-07-11T20:39:17.106 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-11T20:39:17.106 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2023-07-11T20:39:17.106 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-11T20:39:17.107 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/"
2023-07-11T20:39:17.107 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-11T20:39:17.107 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T20:39:17.107 INFO:teuthology.orchestra.run.smithi097.stdout:
2023-07-11T20:39:17.107 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T20:39:17.107 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-11T20:39:17.107 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-11T20:39:17.108 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-11T20:39:17.108 INFO:teuthology.provision.fog.smithi097:Deploy complete!
2023-07-11T20:39:17.109 DEBUG:teuthology.parallel:result is None
2023-07-11T20:39:25.140 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-11T20:39:25.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:39:28.272 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-11T20:39:34.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:39:37.360 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-11T20:39:43.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:39:46.448 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-11T20:39:52.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:39:55.536 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-11T20:40:01.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:40:04.592 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-11T20:40:10.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:40:13.680 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-11T20:40:19.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:41:19.740 WARNING:teuthology.provision.fog.smithi167:timed out
2023-07-11T20:41:25.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:41:26.061 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T20:41:26.062 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T20:41:26.294 INFO:teuthology.provision.fog.smithi167:Node is ready
2023-07-11T20:41:26.295 DEBUG:teuthology.orchestra.run.smithi167:> hostname
2023-07-11T20:41:26.347 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com
2023-07-11T20:41:26.348 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts
2023-07-11T20:41:26.402 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167
2023-07-11T20:41:26.403 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2023-07-11T20:41:26.504 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts
2023-07-11T20:41:26.531 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts
2023-07-11T20:41:26.594 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname
2023-07-11T20:41:26.657 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2023-07-11T20:41:26.720 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release
2023-07-11T20:41:26.772 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux"
2023-07-11T20:41:26.772 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.4 (Ootpa)"
2023-07-11T20:41:26.772 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel"
2023-07-11T20:41:26.772 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora"
2023-07-11T20:41:26.772 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.4"
2023-07-11T20:41:26.773 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8"
2023-07-11T20:41:26.773 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-11T20:41:26.773 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2023-07-11T20:41:26.773 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-11T20:41:26.773 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/"
2023-07-11T20:41:26.773 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-11T20:41:26.773 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T20:41:26.774 INFO:teuthology.orchestra.run.smithi167.stdout:
2023-07-11T20:41:26.774 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T20:41:26.774 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-11T20:41:26.774 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-11T20:41:26.774 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-11T20:41:26.774 INFO:teuthology.provision.fog.smithi167:Deploy complete!
2023-07-11T20:41:26.775 DEBUG:teuthology.parallel:result is None
2023-07-11T20:41:26.952 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com
2023-07-11T20:41:26.953 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-11T20:41:26.981 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com
2023-07-11T20:41:26.982 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-11T20:41:27.007 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server
2023-07-11T20:41:27.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2023-07-11T20:41:27.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:41:27.072 DEBUG:teuthology.orchestra.run.smithi097:> true
2023-07-11T20:41:27.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com'
2023-07-11T20:41:27.191 DEBUG:teuthology.orchestra.run.smithi097:> uname -m
2023-07-11T20:41:27.243 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64
2023-07-11T20:41:27.244 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2023-07-11T20:41:27.298 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux"
2023-07-11T20:41:27.298 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.4 (Ootpa)"
2023-07-11T20:41:27.298 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel"
2023-07-11T20:41:27.298 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora"
2023-07-11T20:41:27.298 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.4"
2023-07-11T20:41:27.298 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8"
2023-07-11T20:41:27.299 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-11T20:41:27.299 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2023-07-11T20:41:27.299 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-11T20:41:27.299 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/"
2023-07-11T20:41:27.299 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-11T20:41:27.299 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T20:41:27.299 INFO:teuthology.orchestra.run.smithi097.stdout:
2023-07-11T20:41:27.300 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T20:41:27.300 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-11T20:41:27.300 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-11T20:41:27.300 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-11T20:41:27.300 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2023-07-11T20:41:27.322 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server
2023-07-11T20:41:27.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2023-07-11T20:41:27.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:41:27.385 DEBUG:teuthology.orchestra.run.smithi167:> true
2023-07-11T20:41:27.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com'
2023-07-11T20:41:27.453 DEBUG:teuthology.orchestra.run.smithi167:> uname -m
2023-07-11T20:41:27.506 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64
2023-07-11T20:41:27.506 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release
2023-07-11T20:41:27.559 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux"
2023-07-11T20:41:27.559 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.4 (Ootpa)"
2023-07-11T20:41:27.560 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel"
2023-07-11T20:41:27.560 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora"
2023-07-11T20:41:27.560 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.4"
2023-07-11T20:41:27.560 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8"
2023-07-11T20:41:27.560 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-11T20:41:27.560 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2023-07-11T20:41:27.560 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-11T20:41:27.560 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/"
2023-07-11T20:41:27.561 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-11T20:41:27.561 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T20:41:27.561 INFO:teuthology.orchestra.run.smithi167.stdout:
2023-07-11T20:41:27.561 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T20:41:27.561 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-11T20:41:27.561 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-11T20:41:27.561 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-11T20:41:27.562 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2023-07-11T20:41:27.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:41:27.581 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:41:27.781 INFO:teuthology.dispatcher.supervisor:Running job 7334200
2023-07-11T20:41:27.781 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-11_20:33:37-fs:functional-quincy_release-distro-default-smithi/7334200 --name pdonnell-2023-07-11_20:33:37-fs:functional-quincy_release-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays} -- /home/teuthworker/archive/pdonnell-2023-07-11_20:33:37-fs:functional-quincy_release-distro-default-smithi/7334200/orig.config.yaml
2023-07-11T20:41:27.784 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-11_20:33:37-fs:functional-quincy_release-distro-default-smithi/7334200
2023-07-11T20:41:27.785 INFO:teuthology.dispatcher.supervisor:Job PID: 21099
2023-07-11T20:41:27.786 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-11T20:43:27.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:43:27.886 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:45:28.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:45:28.057 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:47:28.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:47:28.246 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:49:28.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:49:28.410 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:51:28.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:51:28.579 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:53:28.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:53:28.769 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:55:28.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:55:28.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:57:29.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:57:29.139 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:59:29.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:59:29.310 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T21:01:29.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T21:01:29.486 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T21:03:29.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T21:03:29.656 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T21:05:29.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T21:05:29.828 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T21:05:29.903 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-11T21:05:30.014 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-11T21:05:30.015 INFO:teuthology.nuke:Checking targets against current locks
2023-07-11T21:05:30.064 DEBUG:teuthology.nuke:shortname: smithi097
2023-07-11T21:05:30.064 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T21:05:30.082 DEBUG:teuthology.nuke:shortname: smithi167
2023-07-11T21:05:30.082 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T21:05:30.089 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-11_20:33:37-fs:functional-quincy_release-distro-default-smithi/7334200', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 20:34:28.085743', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmtmuacKyNqKgLauJdlYQk9cMIvaQ3rs1r48rqERoQzZvbDbTjIsHddeVdwvp4WquRZtcfoAvhJJnB2vDYg+Ffbc4n+P+g31PvDEptr0I9h6MwC3jJpQfbeoo0pc6v7ymw+WEp50QhyJUqPoUboYG7O8o+IZXEdZSV25WLhyIC6Jopi8zI9cpSsJsx2/Nnv/Rsmv0jKSWwLBjRVS+qEIwYfn+G3u81q1ajDWBTycT+h6TapPDgpLi+QMAF5Nap3lzsw/WnoGQA8cm3usfbECSqjXcCvz78KG2TRsKWZprqBGe+MTvrtVJ2AHrSd5UDHa5cebWfTBZy8f3scANg2LdYQ4q4uPXWCo/WqDK0m6et23tJf+Tek7VZnt5on8i8jU9SeKHvN5ZUQCtCXPZlbYMo+8v/yJsUFq2i7sUHuD7GurPwC7AKC/uO+a4Ycd/bYp3qIuirwxCqvcA1juqwAyPb3HXLKlBnVRwt+ZcdX90tCkIoduza3rkPtnRo66oBBdM='}
2023-07-11T21:05:30.107 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-11_20:33:37-fs:functional-quincy_release-distro-default-smithi/7334200', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 20:34:28.087821', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/COh7hEfnwhH/xQ0CeEZ+ZSbqwpfOKy8NmunRhlAdxzfOMtSN/+OOR8oTVNJBrf0x0viY+vNFIVlrkhdBTbAA68hbEHPfTpqNuQqpFWxCSpuJp3/7KZMWpewR6B/c2NoyKFALVwyDGxzu+OT5+82LCU6DhunvdF6AweBJ67W5BYoYsZ7JxklIY+fu+Dv8XBnfE29WNQa9WYTtywHir5wdAjOoveUQnidU7ldprKrrBMP0dH37VhvsauT6uf2GzgW7ffC26EqDVZIIHcGknjqM4C2n+LUI4vsS0MjApIw7o+vGs0KbKd+BT/dbvrb7GbKDFOZXwbz09aV7jWpQ1glr8PKQt/DfrZ6N7PmP1WJggC5f8WEAsL1vU+/9cggUpI+HKyaTqso19q9Wqh/n23PSWtm+L/OAqmv5Or4FH3S/1/+IJuANL6KR14Z2ayjwPwTm9nVBZ+lz6oOHXnaNxyqIX+c3I7N7kwPHcnQ7nlaQeYTscByISz7mHUQruuO5sCU='}
2023-07-11T21:05:30.137 INFO:teuthology.orchestra.console:Power off smithi097
2023-07-11T21:05:30.138 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T21:05:30.155 INFO:teuthology.orchestra.console:Power off smithi167
2023-07-11T21:05:30.155 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T21:05:30.164 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T21:05:30.175 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T21:05:30.285 INFO:teuthology.orchestra.console:Power off for smithi097 completed
2023-07-11T21:05:30.295 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2023-07-11T21:05:30.443 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com
2023-07-11T21:05:30.453 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com