2023-07-14T17:37:21.958 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e
2023-07-14T17:37:21.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:37:21.960 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:37:22.146 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3c2709a610>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3c282b68b0>, signals=[15])
2023-07-14T17:37:22.148 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging
2023-07-14T17:37:22.149 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server
2023-07-14T17:37:22.149 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2023-07-14T17:37:22.179 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2023-07-14T17:37:22.180 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2023-07-14T17:37:22.180 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-07-14T17:37:22.182 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /host {"name": "smithi133"}
2023-07-14T17:37:22.267 INFO:teuthology.lock.ops:Start node 'smithi171.front.sepia.ceph.com' reimaging
2023-07-14T17:37:22.267 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: reset os type and version on server
2023-07-14T17:37:22.268 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2023-07-14T17:37:22.269 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"}
2023-07-14T17:37:22.292 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /host {"name": "smithi171"}
2023-07-14T17:37:22.308 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-14T17:37:22.340 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-14T17:37:22.340 DEBUG:teuthology.provision.fog.smithi133:FOG request: PUT /host/238 {"imageID": 5}
2023-07-14T17:37:22.344 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-14T17:37:22.369 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-14T17:37:22.392 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-14T17:37:22.392 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 5}
2023-07-14T17:37:22.405 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of rhel 8.6
2023-07-14T17:37:22.406 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-07-14T17:37:22.411 DEBUG:teuthology.provision.fog.smithi171:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-14T17:37:22.411 DEBUG:teuthology.provision.fog.smithi171:FOG request: PUT /host/276 {"imageID": 5}
2023-07-14T17:37:22.446 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of rhel 8.6
2023-07-14T17:37:22.446 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-14T17:37:22.463 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of rhel 8.6
2023-07-14T17:37:22.463 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-07-14T17:37:22.477 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /tasktype {"name": "deploy"}
2023-07-14T17:37:22.501 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"}
2023-07-14T17:37:22.514 DEBUG:teuthology.provision.fog.smithi133:FOG request: POST /host/238/task {"taskTypeID": 1}
2023-07-14T17:37:22.527 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /tasktype {"name": "deploy"}
2023-07-14T17:37:22.543 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1}
2023-07-14T17:37:22.566 DEBUG:teuthology.provision.fog.smithi171:FOG request: POST /host/276/task {"taskTypeID": 1}
2023-07-14T17:37:22.580 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-07-14T17:37:22.601 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-14T17:37:22.694 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-07-14T17:37:22.749 INFO:teuthology.orchestra.console:Power off smithi133
2023-07-14T17:37:22.750 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T17:37:22.767 INFO:teuthology.orchestra.console:Power off smithi161
2023-07-14T17:37:22.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T17:37:22.780 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:22.792 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:22.811 INFO:teuthology.orchestra.console:Power off smithi171
2023-07-14T17:37:22.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T17:37:22.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:22.954 INFO:teuthology.orchestra.console:Power off for smithi171 completed
2023-07-14T17:37:23.055 INFO:teuthology.orchestra.console:Power on smithi171
2023-07-14T17:37:23.056 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-14T17:37:26.808 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:26.823 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:28.081 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:30.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:30.935 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:31.148 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-07-14T17:37:31.249 INFO:teuthology.orchestra.console:Power on smithi161
2023-07-14T17:37:31.250 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-14T17:37:31.274 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:33.092 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:35.033 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:35.246 INFO:teuthology.orchestra.console:Power off for smithi133 completed
2023-07-14T17:37:35.297 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:35.348 INFO:teuthology.orchestra.console:Power on smithi133
2023-07-14T17:37:35.348 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-14T17:37:38.204 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:40.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:40.408 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:43.316 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:45.385 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:45.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:45.728 INFO:teuthology.orchestra.console:Power on for smithi161 completed
2023-07-14T17:37:45.829 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2023-07-14T17:37:45.829 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-14T17:37:55.841 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:37:59.853 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:38:00.607 INFO:teuthology.orchestra.console:Power on for smithi133 completed
2023-07-14T17:38:00.708 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish
2023-07-14T17:38:00.709 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-07-14T17:38:05.717 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:38:10.828 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:38:10.923 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-14T17:38:16.107 INFO:teuthology.orchestra.console:Power on for smithi171 completed
2023-07-14T17:38:16.208 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish
2023-07-14T17:38:16.208 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-07-14T17:38:20.807 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-07-14T17:38:31.008 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-14T17:38:36.012 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-07-14T17:38:36.013 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-07-14T17:39:01.104 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-07-14T17:39:01.105 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-07-14T17:39:01.106 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-14T17:39:21.192 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-07-14T17:39:21.194 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-07-14T17:39:31.205 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-14T17:39:46.300 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-07-14T17:39:46.301 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-14T17:39:46.302 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-07-14T17:40:01.512 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-07-14T17:40:01.513 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-07-14T17:40:01.516 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-14T17:40:16.612 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-14T17:40:16.613 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-07-14T17:40:16.614 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-07-14T17:40:16.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:40:19.760 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-07-14T17:40:25.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:40:35.769 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None
2023-07-14T17:40:35.770 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-07-14T17:40:45.780 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-07-14T17:40:45.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:40:45.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:40:48.912 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-07-14T17:40:48.913 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2023-07-14T17:40:51.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:40:54.864 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-07-14T17:40:54.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:40:59.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:41:04.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:41:09.932 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-07-14T17:41:09.933 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171
2023-07-14T17:41:13.008 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-07-14T17:41:15.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:41:20.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:41:25.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:41:49.300 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-07-14T17:41:55.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:42:01.635 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-14T17:42:01.636 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-14T17:42:01.947 INFO:teuthology.provision.fog.smithi161:Node is ready
2023-07-14T17:42:01.947 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2023-07-14T17:42:01.963 INFO:teuthology.orchestra.run.smithi161.stdout:smithi022
2023-07-14T17:42:01.963 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi022 /etc/hosts
2023-07-14T17:42:02.019 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-07-14T17:42:02.020 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-07-14T17:42:02.127 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi022/smithi161/g' /etc/hosts
2023-07-14T17:42:02.153 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.22/172.21.15.161/g' /etc/hosts
2023-07-14T17:42:02.221 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi022/smithi161/g' /etc/hostname
2023-07-14T17:42:02.287 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-07-14T17:42:02.352 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-07-14T17:42:02.408 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T17:42:02.409 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T17:42:02.409 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel"
2023-07-14T17:42:02.409 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora"
2023-07-14T17:42:02.409 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6"
2023-07-14T17:42:02.409 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-07-14T17:42:02.409 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T17:42:02.410 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-07-14T17:42:02.410 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T17:42:02.410 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T17:42:02.410 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T17:42:02.410 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T17:42:02.410 INFO:teuthology.orchestra.run.smithi161.stdout:
2023-07-14T17:42:02.410 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T17:42:02.411 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T17:42:02.411 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T17:42:02.411 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T17:42:02.412 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2023-07-14T17:42:02.413 DEBUG:teuthology.parallel:result is None
2023-07-14T17:42:20.960 WARNING:teuthology.provision.fog.smithi133:timed out
2023-07-14T17:42:25.948 WARNING:teuthology.provision.fog.smithi171:timed out
2023-07-14T17:42:26.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:42:27.311 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-14T17:42:27.312 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-14T17:42:27.600 INFO:teuthology.provision.fog.smithi133:Node is ready
2023-07-14T17:42:27.600 DEBUG:teuthology.orchestra.run.smithi133:> hostname
2023-07-14T17:42:27.617 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com
2023-07-14T17:42:27.618 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts
2023-07-14T17:42:27.674 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133
2023-07-14T17:42:27.674 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133
2023-07-14T17:42:27.780 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts
2023-07-14T17:42:27.808 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts
2023-07-14T17:42:27.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname
2023-07-14T17:42:27.943 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133
2023-07-14T17:42:28.010 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release
2023-07-14T17:42:28.066 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T17:42:28.066 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T17:42:28.066 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel"
2023-07-14T17:42:28.066 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora"
2023-07-14T17:42:28.067 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6"
2023-07-14T17:42:28.067 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8"
2023-07-14T17:42:28.067 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T17:42:28.067 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31"
2023-07-14T17:42:28.067 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T17:42:28.067 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T17:42:28.067 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T17:42:28.068 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T17:42:28.068 INFO:teuthology.orchestra.run.smithi133.stdout:
2023-07-14T17:42:28.068 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T17:42:28.068 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T17:42:28.068 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T17:42:28.068 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T17:42:28.068 INFO:teuthology.provision.fog.smithi133:Deploy complete!
2023-07-14T17:42:28.069 DEBUG:teuthology.parallel:result is None
2023-07-14T17:42:31.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:42:37.301 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-14T17:42:37.301 DEBUG:teuthology.orchestra.run.smithi171:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-14T17:42:37.598 INFO:teuthology.provision.fog.smithi171:Node is ready
2023-07-14T17:42:37.598 DEBUG:teuthology.orchestra.run.smithi171:> hostname
2023-07-14T17:42:37.616 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com
2023-07-14T17:42:37.617 DEBUG:teuthology.orchestra.run.smithi171:> grep smithi171.front.sepia.ceph.com /etc/hosts
2023-07-14T17:42:37.673 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171
2023-07-14T17:42:37.674 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171
2023-07-14T17:42:37.800 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hosts
2023-07-14T17:42:37.831 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/172.21.15.171/172.21.15.171/g' /etc/hosts
2023-07-14T17:42:37.898 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hostname
2023-07-14T17:42:37.963 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171
2023-07-14T17:42:38.026 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release
2023-07-14T17:42:38.080 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T17:42:38.080 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T17:42:38.081 INFO:teuthology.orchestra.run.smithi171.stdout:ID="rhel"
2023-07-14T17:42:38.081 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="fedora"
2023-07-14T17:42:38.081 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8.6"
2023-07-14T17:42:38.081 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8"
2023-07-14T17:42:38.081 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T17:42:38.081 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2023-07-14T17:42:38.081 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T17:42:38.082 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T17:42:38.082 INFO:teuthology.orchestra.run.smithi171.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T17:42:38.082 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T17:42:38.082 INFO:teuthology.orchestra.run.smithi171.stdout:
2023-07-14T17:42:38.082 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T17:42:38.082 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T17:42:38.082 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T17:42:38.083 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T17:42:38.083 INFO:teuthology.provision.fog.smithi171:Deploy complete!
2023-07-14T17:42:38.083 DEBUG:teuthology.parallel:result is None
2023-07-14T17:42:43.276 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com
2023-07-14T17:42:43.277 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-14T17:42:47.000 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2023-07-14T17:42:47.001 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-14T17:42:47.025 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com
2023-07-14T17:42:47.025 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-14T17:42:47.043 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server
2023-07-14T17:42:47.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com'
2023-07-14T17:42:47.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:42:47.112 DEBUG:teuthology.orchestra.run.smithi133:> true
2023-07-14T17:42:47.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com'
2023-07-14T17:42:47.246 DEBUG:teuthology.orchestra.run.smithi133:> uname -m
2023-07-14T17:42:47.302 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64
2023-07-14T17:42:47.303 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release
2023-07-14T17:42:47.359 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T17:42:47.359 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T17:42:47.359 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel"
2023-07-14T17:42:47.359 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora"
2023-07-14T17:42:47.360 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6"
2023-07-14T17:42:47.360 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8"
2023-07-14T17:42:47.360 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T17:42:47.360 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31"
2023-07-14T17:42:47.360 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T17:42:47.360 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T17:42:47.360 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T17:42:47.361 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T17:42:47.361 INFO:teuthology.orchestra.run.smithi133.stdout:
2023-07-14T17:42:47.361 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T17:42:47.361 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T17:42:47.361 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T17:42:47.361 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T17:42:47.362 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2023-07-14T17:42:47.383 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2023-07-14T17:42:47.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-07-14T17:42:47.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:42:47.451 DEBUG:teuthology.orchestra.run.smithi161:> true
2023-07-14T17:42:47.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-07-14T17:42:47.586 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2023-07-14T17:42:47.644 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2023-07-14T17:42:47.645 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-07-14T17:42:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T17:42:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T17:42:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel"
2023-07-14T17:42:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora"
2023-07-14T17:42:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6"
2023-07-14T17:42:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-07-14T17:42:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T17:42:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-07-14T17:42:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T17:42:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T17:42:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T17:42:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T17:42:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:
2023-07-14T17:42:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T17:42:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T17:42:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T17:42:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T17:42:47.703 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-07-14T17:42:47.725 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server
2023-07-14T17:42:47.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com'
2023-07-14T17:42:47.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:42:47.793 DEBUG:teuthology.orchestra.run.smithi171:> true
2023-07-14T17:42:47.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com'
2023-07-14T17:42:47.864 DEBUG:teuthology.orchestra.run.smithi171:> uname -m
2023-07-14T17:42:47.921 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64
2023-07-14T17:42:47.922 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release
2023-07-14T17:42:47.980 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T17:42:47.980 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T17:42:47.980 INFO:teuthology.orchestra.run.smithi171.stdout:ID="rhel"
2023-07-14T17:42:47.980 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="fedora"
2023-07-14T17:42:47.980 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8.6"
2023-07-14T17:42:47.981 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8"
2023-07-14T17:42:47.981 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T17:42:47.981 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2023-07-14T17:42:47.981 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T17:42:47.981 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T17:42:47.981 INFO:teuthology.orchestra.run.smithi171.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T17:42:47.981 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T17:42:47.982 INFO:teuthology.orchestra.run.smithi171.stdout:
2023-07-14T17:42:47.982 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T17:42:47.982 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T17:42:47.982 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T17:42:47.982 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T17:42:47.982 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2023-07-14T17:42:48.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:42:48.009 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:42:48.112 INFO:teuthology.dispatcher.supervisor:Running job 7337992
2023-07-14T17:42:48.112 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337992 --name pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/postgres}} -- /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337992/orig.config.yaml
2023-07-14T17:42:48.115 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337992
2023-07-14T17:42:48.116 INFO:teuthology.dispatcher.supervisor:Job PID: 2053
2023-07-14T17:42:48.117 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-14T17:44:48.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:44:48.217 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:46:53.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:46:53.402 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:48:54.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:48:54.362 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:50:54.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:50:54.550 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:52:54.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:52:54.726 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:54:54.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:54:54.890 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:56:57.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:56:57.941 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:59:03.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:59:03.165 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:01:08.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:01:08.346 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:03:08.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:03:08.517 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:05:13.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:05:13.695 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:07:18.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:07:18.874 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:09:24.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:09:24.056 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:11:28.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:11:28.903 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:13:31.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:13:31.242 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:15:31.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:15:31.838 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:17:32.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:17:32.001 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:19:37.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:19:37.190 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:21:42.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:21:42.406 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:23:47.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:23:47.605 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:25:52.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:25:52.777 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:27:57.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:27:57.966 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:30:03.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:30:03.137 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:32:04.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:32:04.426 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:34:04.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:34:04.598 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:36:09.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:36:09.781 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:38:14.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:38:14.961 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:40:20.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:40:20.142 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:42:24.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:42:24.686 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:44:24.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:44:24.866 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:46:25.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:46:25.055 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:48:27.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:48:27.777 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:50:31.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:50:31.946 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:50:36.605 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-14T18:50:36.831 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-14T18:50:36.832 INFO:teuthology.nuke:Checking targets against current locks
2023-07-14T18:50:36.885 DEBUG:teuthology.nuke:shortname: smithi133
2023-07-14T18:50:36.886 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-14T18:50:36.906 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:37:21.090790', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-07-14T18:50:36.909 DEBUG:teuthology.nuke:shortname: smithi161
2023-07-14T18:50:36.909 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-14T18:50:36.918 DEBUG:teuthology.nuke:shortname: smithi171
2023-07-14T18:50:36.918 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-14T18:50:36.929 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:37:21.099246', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-07-14T18:50:36.937 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:37:21.101371', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-14T18:50:36.959 INFO:teuthology.orchestra.console:Power off smithi133
2023-07-14T18:50:36.960 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T18:50:36.979 INFO:teuthology.orchestra.console:Power off smithi161
2023-07-14T18:50:36.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T18:50:36.992 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:50:37.002 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:50:37.021 INFO:teuthology.orchestra.console:Power off smithi171
2023-07-14T18:50:37.022 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T18:50:37.043 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:50:37.131 INFO:teuthology.orchestra.console:Power off for smithi133 completed
2023-07-14T18:50:37.133 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-07-14T18:50:37.163 INFO:teuthology.orchestra.console:Power off for smithi171 completed
2023-07-14T18:50:37.281 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com
2023-07-14T18:50:37.296 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com
2023-07-14T18:50:37.312 INFO:teuthology.lock.ops:unlocked: smithi171.front.sepia.ceph.com