2023-07-12T01:24:57.277 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-12T01:24:57.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T01:24:57.279 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T01:24:57.467 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5765ea3520>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f57658178b0>, signals=[15])
2023-07-12T01:24:57.469 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging
2023-07-12T01:24:57.469 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server
2023-07-12T01:24:57.469 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2023-07-12T01:24:57.493 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging
2023-07-12T01:24:57.494 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server
2023-07-12T01:24:57.494 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2023-07-12T01:24:57.496 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /host {"name": "smithi072"}
2023-07-12T01:24:57.518 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging
2023-07-12T01:24:57.518 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server
2023-07-12T01:24:57.519 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2023-07-12T01:24:57.521 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"}
2023-07-12T01:24:57.543 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /host {"name": "smithi177"}
2023-07-12T01:24:57.572 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-12T01:24:57.587 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-12T01:24:57.612 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-12T01:24:57.612 DEBUG:teuthology.provision.fog.smithi072:FOG request: PUT /host/177 {"imageID": 5}
2023-07-12T01:24:57.614 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-12T01:24:57.630 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-12T01:24:57.631 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 5}
2023-07-12T01:24:57.657 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of rhel 8.6
2023-07-12T01:24:57.657 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:24:57.664 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-12T01:24:57.664 DEBUG:teuthology.provision.fog.smithi177:FOG request: PUT /host/282 {"imageID": 5}
2023-07-12T01:24:57.692 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of rhel 8.6
2023-07-12T01:24:57.692 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-07-12T01:24:57.702 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of rhel 8.6
2023-07-12T01:24:57.702 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:24:57.731 DEBUG:teuthology.provision.fog.smithi072:Canceling deploy task with ID 378674
2023-07-12T01:24:57.732 DEBUG:teuthology.provision.fog.smithi072:FOG request: DELETE /task/cancel {"id": 378674}
2023-07-12T01:24:57.754 DEBUG:teuthology.provision.fog.smithi177:Canceling deploy task with ID 378677
2023-07-12T01:24:57.754 DEBUG:teuthology.provision.fog.smithi177:FOG request: DELETE /task/cancel {"id": 378677}
2023-07-12T01:24:57.762 DEBUG:teuthology.provision.fog.smithi145:Canceling deploy task with ID 378675
2023-07-12T01:24:57.762 DEBUG:teuthology.provision.fog.smithi145:FOG request: DELETE /task/cancel {"id": 378675}
2023-07-12T01:24:57.888 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"}
2023-07-12T01:24:57.891 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /tasktype {"name": "deploy"}
2023-07-12T01:24:57.928 DEBUG:teuthology.provision.fog.smithi072:FOG request: POST /host/177/task {"taskTypeID": 1}
2023-07-12T01:24:57.935 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1}
2023-07-12T01:24:57.979 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:24:57.990 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-07-12T01:24:58.088 INFO:teuthology.orchestra.console:Power off smithi145
2023-07-12T01:24:58.089 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-12T01:24:58.105 INFO:teuthology.orchestra.console:Power off smithi072
2023-07-12T01:24:58.106 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-12T01:24:58.116 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:24:58.128 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:24:58.239 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2023-07-12T01:24:58.249 INFO:teuthology.orchestra.console:Power off for smithi072 completed
2023-07-12T01:24:58.340 INFO:teuthology.orchestra.console:Power on smithi145
2023-07-12T01:24:58.341 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-12T01:24:58.350 INFO:teuthology.orchestra.console:Power on smithi072
2023-07-12T01:24:58.351 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-12T01:24:58.362 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:24:58.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:24:58.425 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /tasktype {"name": "deploy"}
2023-07-12T01:24:58.468 DEBUG:teuthology.provision.fog.smithi177:FOG request: POST /host/282/task {"taskTypeID": 1}
2023-07-12T01:24:58.523 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:24:58.607 INFO:teuthology.orchestra.console:Power off smithi177
2023-07-12T01:24:58.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-12T01:24:58.631 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:25:02.388 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:25:02.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:25:02.653 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:25:06.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:25:06.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:25:06.713 INFO:teuthology.orchestra.console:Power on for smithi145 completed
2023-07-12T01:25:06.718 INFO:teuthology.orchestra.console:Power on for smithi072 completed
2023-07-12T01:25:06.767 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:25:06.815 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish
2023-07-12T01:25:06.816 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-07-12T01:25:06.819 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish
2023-07-12T01:25:06.819 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:25:10.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:25:11.089 INFO:teuthology.orchestra.console:Power off for smithi177 completed
2023-07-12T01:25:11.190 INFO:teuthology.orchestra.console:Power on smithi177
2023-07-12T01:25:11.191 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-12T01:25:11.215 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:25:15.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:25:15.447 INFO:teuthology.orchestra.console:Power on for smithi177 completed
2023-07-12T01:25:15.548 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish
2023-07-12T01:25:15.549 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:25:22.036 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-07-12T01:25:22.037 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:25:30.700 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:25:37.179 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-07-12T01:25:37.180 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:25:45.844 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:25:52.320 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-07-12T01:25:52.321 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:26:00.988 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:26:07.461 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:26:07.466 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-07-12T01:26:16.157 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:26:22.597 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:26:22.616 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-07-12T01:26:31.322 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:26:37.732 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:26:37.754 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-07-12T01:26:46.503 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:26:52.906 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:26:52.907 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-07-12T01:27:01.683 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:27:08.100 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:27:08.104 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-07-12T01:27:16.899 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:27:23.306 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:27:23.309 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-07-12T01:27:32.096 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:27:38.486 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:27:38.487 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None
2023-07-12T01:27:38.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:27:38.726 ERROR:teuthology.orchestra.connection:Error authenticating with smithi145.front.sepia.ceph.com: Authentication failed.
2023-07-12T01:27:38.727 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-12T01:27:38.728 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-12T01:27:38.729 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-12T01:27:47.281 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:27:53.645 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:28:02.483 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:28:08.799 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:28:17.666 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:28:23.949 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None
2023-07-12T01:28:24.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:28:32.845 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:28:48.011 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:29:03.179 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:29:18.329 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:29:24.117 WARNING:teuthology.provision.fog.smithi072:timed out
2023-07-12T01:29:29.968 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-12T01:29:29.969 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi145
2023-07-12T01:29:30.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:29:33.502 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:29:38.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2023-07-12T01:29:38.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:29:39.039 DEBUG:teuthology.orchestra.run.smithi145:> true
2023-07-12T01:29:39.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com'
2023-07-12T01:29:39.108 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-12T01:29:39.108 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-12T01:29:39.166 INFO:teuthology.provision.fog.smithi145:Node is ready
2023-07-12T01:29:39.166 DEBUG:teuthology.orchestra.run.smithi145:> hostname
2023-07-12T01:29:39.224 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145
2023-07-12T01:29:39.225 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145 /etc/hosts
2023-07-12T01:29:39.282 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145 smithi145
2023-07-12T01:29:39.283 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145
2023-07-12T01:29:39.353 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145/smithi145/g' /etc/hosts
2023-07-12T01:29:39.423 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts
2023-07-12T01:29:39.490 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145/smithi145/g' /etc/hostname
2023-07-12T01:29:39.558 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145
2023-07-12T01:29:39.625 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release
2023-07-12T01:29:39.681 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux"
2023-07-12T01:29:39.681 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)"
2023-07-12T01:29:39.681 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel"
2023-07-12T01:29:39.681 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora"
2023-07-12T01:29:39.681 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6"
2023-07-12T01:29:39.682 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8"
2023-07-12T01:29:39.682 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-12T01:29:39.682 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2023-07-12T01:29:39.682 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-12T01:29:39.682 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/"
2023-07-12T01:29:39.682 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-12T01:29:39.683 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-12T01:29:39.683 INFO:teuthology.orchestra.run.smithi145.stdout:
2023-07-12T01:29:39.683 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-12T01:29:39.683 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-12T01:29:39.683 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-12T01:29:39.683 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-12T01:29:39.684 INFO:teuthology.provision.fog.smithi145:Deploy complete!
2023-07-12T01:29:39.685 DEBUG:teuthology.parallel:result is None
2023-07-12T01:29:48.656 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:29:48.657 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2023-07-12T01:29:54.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:29:56.916 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-12T01:29:56.916 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-12T01:29:57.514 INFO:teuthology.provision.fog.smithi072:Node is ready
2023-07-12T01:29:57.515 DEBUG:teuthology.orchestra.run.smithi072:> hostname
2023-07-12T01:29:57.530 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com
2023-07-12T01:29:57.531 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts
2023-07-12T01:29:57.587 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072
2023-07-12T01:29:57.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072
2023-07-12T01:29:57.791 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts
2023-07-12T01:29:57.817 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts
2023-07-12T01:29:57.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname
2023-07-12T01:29:57.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072
2023-07-12T01:29:58.014 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release
2023-07-12T01:29:58.069 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux"
2023-07-12T01:29:58.070 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)"
2023-07-12T01:29:58.070 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel"
2023-07-12T01:29:58.070 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora"
2023-07-12T01:29:58.070 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6"
2023-07-12T01:29:58.070 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8"
2023-07-12T01:29:58.071 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-12T01:29:58.071 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31"
2023-07-12T01:29:58.071 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-12T01:29:58.071 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/"
2023-07-12T01:29:58.071 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-12T01:29:58.071 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-12T01:29:58.071 INFO:teuthology.orchestra.run.smithi072.stdout:
2023-07-12T01:29:58.072 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-12T01:29:58.072 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-12T01:29:58.072 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-12T01:29:58.072 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-12T01:29:58.072 INFO:teuthology.provision.fog.smithi072:Deploy complete!
2023-07-12T01:29:58.073 DEBUG:teuthology.parallel:result is None
2023-07-12T01:30:03.811 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:30:18.981 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:30:34.132 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:30:49.276 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:31:04.402 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:31:19.524 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:31:34.644 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:31:49.742 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:32:04.853 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:32:19.948 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:32:35.044 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:32:50.144 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:33:05.240 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-07-12T01:33:05.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:33:23.696 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-07-12T01:33:29.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:33:32.752 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-07-12T01:33:38.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:33:41.808 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-07-12T01:33:47.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:33:50.900 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-07-12T01:33:56.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:34:56.964 WARNING:teuthology.provision.fog.smithi177:timed out
2023-07-12T01:35:02.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:35:03.300 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-12T01:35:03.301 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-12T01:35:03.589 INFO:teuthology.provision.fog.smithi177:Node is ready
2023-07-12T01:35:03.589 DEBUG:teuthology.orchestra.run.smithi177:> hostname
2023-07-12T01:35:03.607 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com
2023-07-12T01:35:03.608 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts
2023-07-12T01:35:03.665 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177
2023-07-12T01:35:03.666 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2023-07-12T01:35:03.897 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts
2023-07-12T01:35:03.940 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts
2023-07-12T01:35:04.009 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname
2023-07-12T01:35:04.077 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2023-07-12T01:35:04.144 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2023-07-12T01:35:04.201 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux"
2023-07-12T01:35:04.201 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.6 (Ootpa)"
2023-07-12T01:35:04.201 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel"
2023-07-12T01:35:04.202 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora"
2023-07-12T01:35:04.202 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.6"
2023-07-12T01:35:04.202 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8"
2023-07-12T01:35:04.202 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-12T01:35:04.202 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2023-07-12T01:35:04.202 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-12T01:35:04.203 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/"
2023-07-12T01:35:04.203 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-12T01:35:04.203 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-12T01:35:04.203 INFO:teuthology.orchestra.run.smithi177.stdout:
2023-07-12T01:35:04.203 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-12T01:35:04.204 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-12T01:35:04.204 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-12T01:35:04.204 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-12T01:35:04.204 INFO:teuthology.provision.fog.smithi177:Deploy complete!
2023-07-12T01:35:04.205 DEBUG:teuthology.parallel:result is None
2023-07-12T01:35:04.429 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com
2023-07-12T01:35:04.430 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com
2023-07-12T01:35:04.430 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com
2023-07-12T01:35:04.431 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-12T01:35:04.458 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server
2023-07-12T01:35:04.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com'
2023-07-12T01:35:04.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:35:04.525 DEBUG:teuthology.orchestra.run.smithi072:> true
2023-07-12T01:35:04.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com'
2023-07-12T01:35:04.554 DEBUG:teuthology.orchestra.run.smithi072:> uname -m
2023-07-12T01:35:04.612 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64
2023-07-12T01:35:04.613 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release
2023-07-12T01:35:04.670 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux"
2023-07-12T01:35:04.670 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)"
2023-07-12T01:35:04.671 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel"
2023-07-12T01:35:04.671 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora"
2023-07-12T01:35:04.671 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6"
2023-07-12T01:35:04.671 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8"
2023-07-12T01:35:04.671 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-12T01:35:04.671 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31"
2023-07-12T01:35:04.671 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-12T01:35:04.672 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/"
2023-07-12T01:35:04.672 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-12T01:35:04.672 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-12T01:35:04.672 INFO:teuthology.orchestra.run.smithi072.stdout:
2023-07-12T01:35:04.672 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-12T01:35:04.672 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-12T01:35:04.672 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-12T01:35:04.673 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-12T01:35:04.673 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2023-07-12T01:35:04.698 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server
2023-07-12T01:35:04.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2023-07-12T01:35:04.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:35:04.765 DEBUG:teuthology.orchestra.run.smithi145:> true
2023-07-12T01:35:04.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com'
2023-07-12T01:35:04.840 DEBUG:teuthology.orchestra.run.smithi145:> uname -m
2023-07-12T01:35:04.898 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64
2023-07-12T01:35:04.899 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release
2023-07-12T01:35:04.957 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux"
2023-07-12T01:35:04.958 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)"
2023-07-12T01:35:04.958 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel"
2023-07-12T01:35:04.958 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora"
2023-07-12T01:35:04.958 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6"
2023-07-12T01:35:04.958 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8"
2023-07-12T01:35:04.958 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-12T01:35:04.959 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2023-07-12T01:35:04.959 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-12T01:35:04.959 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/"
2023-07-12T01:35:04.959 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-12T01:35:04.959 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-12T01:35:04.959 INFO:teuthology.orchestra.run.smithi145.stdout:
2023-07-12T01:35:04.959 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-12T01:35:04.960 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-12T01:35:04.960 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-12T01:35:04.960 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-12T01:35:04.960 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2023-07-12T01:35:04.981 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server
2023-07-12T01:35:04.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com'
2023-07-12T01:35:04.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T01:35:05.046 DEBUG:teuthology.orchestra.run.smithi177:> true
2023-07-12T01:35:05.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com'
2023-07-12T01:35:05.113 DEBUG:teuthology.orchestra.run.smithi177:> uname -m
2023-07-12T01:35:05.170 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64
2023-07-12T01:35:05.170 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2023-07-12T01:35:05.227 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux"
2023-07-12T01:35:05.228 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.6 (Ootpa)"
2023-07-12T01:35:05.228 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel"
2023-07-12T01:35:05.228 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora"
2023-07-12T01:35:05.228 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.6"
2023-07-12T01:35:05.228 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8"
2023-07-12T01:35:05.228 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-12T01:35:05.229 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2023-07-12T01:35:05.229 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-12T01:35:05.229 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/"
2023-07-12T01:35:05.229 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-12T01:35:05.229 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-12T01:35:05.229 INFO:teuthology.orchestra.run.smithi177.stdout:
2023-07-12T01:35:05.229 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-12T01:35:05.229 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-12T01:35:05.230 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-12T01:35:05.230 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-12T01:35:05.230 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2023-07-12T01:35:05.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T01:35:05.257 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T01:35:05.387 INFO:teuthology.dispatcher.supervisor:Running job 7334507
2023-07-12T01:35:05.388 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334507 --name pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334507/orig.config.yaml
2023-07-12T01:35:05.391 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334507
2023-07-12T01:35:05.392 INFO:teuthology.dispatcher.supervisor:Job PID: 10038
2023-07-12T01:35:05.392 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-12T01:37:05.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T01:37:05.493 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T01:37:05.557 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-12T01:37:05.710 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-12T01:37:05.711 INFO:teuthology.nuke:Checking targets against current locks
2023-07-12T01:37:05.774 DEBUG:teuthology.nuke:shortname: smithi072
2023-07-12T01:37:05.775 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-12T01:37:05.800 DEBUG:teuthology.nuke:shortname: smithi145
2023-07-12T01:37:05.800 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-12T01:37:05.804 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334507', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 01:24:56.442698', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-12T01:37:05.826 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334507', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 01:24:56.446124', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-12T01:37:05.830 DEBUG:teuthology.nuke:shortname: smithi177
2023-07-12T01:37:05.830 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-12T01:37:05.855 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334507', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 01:24:56.444803', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-12T01:37:05.863 INFO:teuthology.orchestra.console:Power off smithi072
2023-07-12T01:37:05.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-12T01:37:05.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:37:05.912 INFO:teuthology.orchestra.console:Power off smithi145
2023-07-12T01:37:05.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-12T01:37:05.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:37:05.956 INFO:teuthology.orchestra.console:Power off smithi177
2023-07-12T01:37:05.957 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-12T01:37:05.978 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T01:37:06.027 INFO:teuthology.orchestra.console:Power off for smithi072 completed
2023-07-12T01:37:06.068 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2023-07-12T01:37:06.101 INFO:teuthology.orchestra.console:Power off for smithi177 completed
2023-07-12T01:37:06.182 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com
2023-07-12T01:37:06.214 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com
2023-07-12T01:37:06.248 INFO:teuthology.lock.ops:unlocked: smithi177.front.sepia.ceph.com