2023-06-23T00:50:54.666 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-23T00:50:54.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T00:50:54.668 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T00:50:54.834 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f305b9dd640>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f305b386430>, signals=[15])
2023-06-23T00:50:54.835 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging
2023-06-23T00:50:54.836 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server
2023-06-23T00:50:54.836 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2023-06-23T00:50:54.860 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging
2023-06-23T00:50:54.860 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server
2023-06-23T00:50:54.860 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-06-23T00:50:54.862 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /host {"name": "smithi138"}
2023-06-23T00:50:54.885 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"}
2023-06-23T00:50:54.944 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-06-23T00:50:54.956 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-06-23T00:50:54.979 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_rhel_8.4 (ID 7)
2023-06-23T00:50:54.980 DEBUG:teuthology.provision.fog.smithi138:FOG request: PUT /host/243 {"imageID": 7}
2023-06-23T00:50:54.993 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_rhel_8.4 (ID 7)
2023-06-23T00:50:54.994 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 7}
2023-06-23T00:50:55.025 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of rhel 8.4
2023-06-23T00:50:55.025 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:50:55.032 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of rhel 8.4
2023-06-23T00:50:55.032 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:50:55.072 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /tasktype {"name": "deploy"}
2023-06-23T00:50:55.084 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"}
2023-06-23T00:50:55.103 DEBUG:teuthology.provision.fog.smithi138:FOG request: POST /host/243/task {"taskTypeID": 1}
2023-06-23T00:50:55.120 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1}
2023-06-23T00:50:55.153 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:50:55.168 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:50:55.237 INFO:teuthology.orchestra.console:Power off smithi138
2023-06-23T00:50:55.238 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T00:50:55.262 INFO:teuthology.orchestra.console:Power off smithi159
2023-06-23T00:50:55.263 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T00:50:55.273 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:50:55.288 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:50:55.399 INFO:teuthology.orchestra.console:Power off for smithi138 completed
2023-06-23T00:50:55.413 INFO:teuthology.orchestra.console:Power off for smithi159 completed
2023-06-23T00:50:55.501 INFO:teuthology.orchestra.console:Power on smithi138
2023-06-23T00:50:55.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-23T00:50:55.515 INFO:teuthology.orchestra.console:Power on smithi159
2023-06-23T00:50:55.515 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-23T00:50:55.526 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:50:55.540 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:50:59.552 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:50:59.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:50:59.774 INFO:teuthology.orchestra.console:Power on for smithi159 completed
2023-06-23T00:50:59.876 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2023-06-23T00:50:59.876 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:51:03.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:51:03.993 INFO:teuthology.orchestra.console:Power on for smithi138 completed
2023-06-23T00:51:04.094 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish
2023-06-23T00:51:04.095 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:51:14.944 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:51:19.159 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:51:30.012 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:51:34.230 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:51:45.077 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:51:49.292 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:52:00.152 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:52:04.362 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:52:15.232 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:52:19.433 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:52:30.316 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:52:34.513 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:52:45.416 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:52:49.614 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:53:00.514 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:53:04.696 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:53:15.608 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:53:19.788 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:53:30.692 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:53:34.876 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:53:45.784 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-06-23T00:53:45.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:53:49.956 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-06-23T00:53:50.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:54:04.400 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-06-23T00:54:08.496 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-06-23T00:54:10.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:54:13.488 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-06-23T00:54:14.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:54:17.552 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-06-23T00:54:19.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:54:22.544 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-06-23T00:54:23.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:54:26.608 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-06-23T00:54:28.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:54:31.605 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-06-23T00:54:32.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:54:35.664 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-06-23T00:54:37.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:54:40.688 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-06-23T00:54:41.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:54:46.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:55:00.216 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-06-23T00:55:06.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:55:09.296 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-06-23T00:55:15.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:55:18.352 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-06-23T00:55:24.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:55:25.546 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-23T00:55:25.547 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-23T00:55:41.488 INFO:teuthology.provision.fog.smithi138:Node is ready
2023-06-23T00:55:41.489 DEBUG:teuthology.orchestra.run.smithi138:> hostname
2023-06-23T00:55:41.505 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com
2023-06-23T00:55:41.505 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts
2023-06-23T00:55:41.559 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138
2023-06-23T00:55:41.560 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-06-23T00:55:41.677 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts
2023-06-23T00:55:41.701 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts
2023-06-23T00:55:41.766 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname
2023-06-23T00:55:41.830 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-06-23T00:55:41.895 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2023-06-23T00:55:41.948 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux"
2023-06-23T00:55:41.949 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.4 (Ootpa)"
2023-06-23T00:55:41.949 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel"
2023-06-23T00:55:41.949 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora"
2023-06-23T00:55:41.949 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.4"
2023-06-23T00:55:41.949 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8"
2023-06-23T00:55:41.950 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-23T00:55:41.950 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31"
2023-06-23T00:55:41.950 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-23T00:55:41.950 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/"
2023-06-23T00:55:41.950 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-23T00:55:41.950 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T00:55:41.951 INFO:teuthology.orchestra.run.smithi138.stdout:
2023-06-23T00:55:41.951 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T00:55:41.951 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-23T00:55:41.951 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-23T00:55:41.951 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-23T00:55:41.952 INFO:teuthology.provision.fog.smithi138:Deploy complete!
2023-06-23T00:55:41.953 DEBUG:teuthology.parallel:result is None
2023-06-23T00:55:46.696 WARNING:teuthology.provision.fog.smithi159:timed out
2023-06-23T00:55:52.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:55:52.954 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-23T00:55:52.954 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-23T00:55:53.187 INFO:teuthology.provision.fog.smithi159:Node is ready
2023-06-23T00:55:53.187 DEBUG:teuthology.orchestra.run.smithi159:> hostname
2023-06-23T00:55:53.240 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com
2023-06-23T00:55:53.240 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts
2023-06-23T00:55:53.292 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2023-06-23T00:55:53.292 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-06-23T00:55:53.407 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts
2023-06-23T00:55:53.431 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts
2023-06-23T00:55:53.493 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname
2023-06-23T00:55:53.555 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-06-23T00:55:53.616 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-06-23T00:55:53.668 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2023-06-23T00:55:53.669 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.4 (Ootpa)"
2023-06-23T00:55:53.669 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2023-06-23T00:55:53.669 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2023-06-23T00:55:53.669 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.4"
2023-06-23T00:55:53.669 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2023-06-23T00:55:53.669 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-23T00:55:53.670 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-06-23T00:55:53.670 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-23T00:55:53.670 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2023-06-23T00:55:53.670 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-23T00:55:53.670 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T00:55:53.670 INFO:teuthology.orchestra.run.smithi159.stdout:
2023-06-23T00:55:53.670 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T00:55:53.671 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-23T00:55:53.671 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-23T00:55:53.671 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-23T00:55:53.671 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2023-06-23T00:55:53.672 DEBUG:teuthology.parallel:result is None
2023-06-23T00:55:53.832 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com
2023-06-23T00:55:53.833 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-23T00:55:53.857 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2023-06-23T00:55:53.858 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-23T00:55:53.883 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server
2023-06-23T00:55:53.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com'
2023-06-23T00:55:53.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:55:53.953 DEBUG:teuthology.orchestra.run.smithi138:> true
2023-06-23T00:55:54.067 DEBUG:teuthology.orchestra.run.smithi138:> uname -m
2023-06-23T00:55:54.121 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64
2023-06-23T00:55:54.122 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2023-06-23T00:55:54.175 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux"
2023-06-23T00:55:54.175 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.4 (Ootpa)"
2023-06-23T00:55:54.176 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel"
2023-06-23T00:55:54.176 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora"
2023-06-23T00:55:54.176 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.4"
2023-06-23T00:55:54.176 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8"
2023-06-23T00:55:54.176 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-23T00:55:54.176 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31"
2023-06-23T00:55:54.177 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-23T00:55:54.177 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/"
2023-06-23T00:55:54.177 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-23T00:55:54.177 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T00:55:54.177 INFO:teuthology.orchestra.run.smithi138.stdout:
2023-06-23T00:55:54.177 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T00:55:54.177 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-23T00:55:54.177 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-23T00:55:54.178 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-23T00:55:54.178 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2023-06-23T00:55:54.198 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2023-06-23T00:55:54.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-06-23T00:55:54.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T00:55:54.265 DEBUG:teuthology.orchestra.run.smithi159:> true
2023-06-23T00:55:54.326 DEBUG:teuthology.orchestra.run.smithi159:> uname -m
2023-06-23T00:55:54.380 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2023-06-23T00:55:54.381 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-06-23T00:55:54.434 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2023-06-23T00:55:54.435 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.4 (Ootpa)"
2023-06-23T00:55:54.435 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2023-06-23T00:55:54.435 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2023-06-23T00:55:54.435 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.4"
2023-06-23T00:55:54.435 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2023-06-23T00:55:54.436 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-23T00:55:54.436 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-06-23T00:55:54.436 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-23T00:55:54.436 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2023-06-23T00:55:54.436 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-23T00:55:54.436 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T00:55:54.436 INFO:teuthology.orchestra.run.smithi159.stdout:
2023-06-23T00:55:54.437 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T00:55:54.437 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-23T00:55:54.437 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-23T00:55:54.437 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-23T00:55:54.438 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-06-23T00:55:54.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T00:55:54.467 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T00:55:54.594 INFO:teuthology.dispatcher.supervisor:Running job 7311933
2023-06-23T00:55:54.594 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311933 --name yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311933/orig.config.yaml
2023-06-23T00:55:54.598 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311933
2023-06-23T00:55:54.598 INFO:teuthology.dispatcher.supervisor:Job PID: 17308
2023-06-23T00:55:54.599 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-23T00:57:54.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T00:57:54.698 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T00:59:54.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T00:59:54.874 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:01:55.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:01:55.053 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:03:55.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:03:55.252 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:05:55.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:05:55.418 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:07:55.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:07:55.598 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:09:55.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:09:55.765 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:09:55.836 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-06-23T01:09:55.947 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-06-23T01:09:55.948 INFO:teuthology.nuke:Checking targets against current locks
2023-06-23T01:09:56.006 DEBUG:teuthology.nuke:shortname: smithi138
2023-06-23T01:09:56.006 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-23T01:09:56.033 DEBUG:teuthology.nuke:shortname: smithi159
2023-06-23T01:09:56.034 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-23T01:09:56.037 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311933', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:50:53.853529', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/CUZnRYZVN8He6tHOYZbyqgRsarJx+okFcer8xtNFttvjayBcJpJL9OpTJHiJDHHGrUAFVPQX2348ZUyow9I0OrdXcMs2WK3oJvp6ajKbm4u5iwv8sMy2ylhzzELcd3+t+cBReQlB9y5EAvXWOyWLvmoxX+jegc4JLDCcISwfKPSFzPne8qJWgcSZSytSXhhAedOLODxRzdCb6UhsPjQx7b298qGvA4GZDiOaYcHVnLcAPcDSlM2TzR9iH3nH3GpGkYFdWPk0cwpV6WVNQue+IgvaM/6sDprzIs1lkr9Ts9ZMcbW/85IWlmvjlbWvkj3kvungUhOOTZnrzVEoL8F58Yb+UuJhjad9/o6L3OjhvKnW+ZHhUjT/lW3Ig9gRJ+zDMDIjUMn/Yv2kfum/IuMTixhePD0mYJdodPoALr/H5QyBX9ZZPRndvL9n6niGS77QRjdzZf4Bx8gb17AVXDBq/LFs/Hamm6elpB/6pkyB9ZRZxqxTYTK+EjBuEkaFEd0='}
2023-06-23T01:09:56.062 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311933', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:50:53.855476', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuqR8KuOaOYmKfYInWpZwTVGIPjDBwpSfhiuS916DYSH77jDk99QOyiaWl2xobqzcsRREvsV9zJ7KL0cYHM5y3JzwXhjxheesSBr8KcvvQJ7o/k66GiOh8WwU07IjDi1nu/T4kAT4PjqQ29AOlKChBYBzhpahQTGPjCfUYmPzyFQLvaO7SYzNmuzDtwGWx2eDubEFtLg7WHEFR2/NwMYpjfZiClVzajkX7kqUgB6UgCPOAIejM7aF4mJQ1Vty+2+HawExA+qFwR7AJEdD3htH1U4eSl4/MR01cx80rws8Sky4eRzKuRshNjHhCpLepquTGU7zwKP30Pion19NXdnKPRmxepA2RBvntjHFeBziSPnvptDANUsRx9oUQRFxzNHur3S6z2GymGPQmO2hEHvFJGT5c82Mjywvzr1Dr5+xmpJo5yX39sEbxX069vyJ8ZbcfRV/WDv13aujE7J8oLzzDlMRdiPXvGJe5nr8p4hrG3QQKiZW8QZmRLfT+TCeco0E='}
2023-06-23T01:09:56.092 INFO:teuthology.orchestra.console:Power off smithi138
2023-06-23T01:09:56.093 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T01:09:56.115 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:09:56.134 INFO:teuthology.orchestra.console:Power off smithi159
2023-06-23T01:09:56.135 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T01:09:56.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:09:56.246 INFO:teuthology.orchestra.console:Power off for smithi138 completed
2023-06-23T01:09:56.278 INFO:teuthology.orchestra.console:Power off for smithi159 completed
2023-06-23T01:09:56.402 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com
2023-06-23T01:09:56.417 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com