2023-02-06T09:45:34.690 INFO:root:teuthology version: 0.0.1.dev37+g00690ec 2023-02-06T09:45:34.773 INFO:teuthology.lock.ops:Start node 'smithi165.front.sepia.ceph.com' reimaging 2023-02-06T09:45:34.774 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: reset os type and version on server 2023-02-06T09:45:34.775 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2023-02-06T09:45:34.790 INFO:teuthology.lock.ops:Node 'smithi165.front.sepia.ceph.com' reimaging is complete 2023-02-06T09:45:34.931 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 8.stream 2023-02-06T09:45:35.137 INFO:teuthology.orchestra.console:Power off smithi165 2023-02-06T09:45:35.273 INFO:teuthology.orchestra.console:Power off for smithi165 completed 2023-02-06T09:45:35.374 INFO:teuthology.orchestra.console:Power on smithi165 2023-02-06T09:45:43.731 INFO:teuthology.orchestra.console:Power on for smithi165 completed 2023-02-06T09:45:43.832 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish 2023-02-06T09:48:48.144 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165 2023-02-06T09:48:57.232 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165 2023-02-06T09:49:06.320 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165 2023-02-06T09:49:15.408 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165 2023-02-06T09:49:24.464 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.165 2023-02-06T09:50:30.528 WARNING:teuthology.provision.fog:timed out 2023-02-06T09:50:36.794 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-02-06T09:50:37.065 INFO:teuthology.provision.fog.smithi165:Node is ready 2023-02-06T09:50:37.083 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com 2023-02-06T09:50:37.141 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165 2023-02-06T09:50:37.494 INFO:teuthology.provision.fog.smithi165:Deploy complete! 2023-02-06T09:50:37.626 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com 2023-02-06T09:50:37.626 INFO:teuthology.lock.ops:New key found. Updating... 2023-02-06T09:50:37.644 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server 2023-02-06T09:50:37.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2023-02-06T09:50:37.833 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2023-02-06T09:50:37.890 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2023-02-06T09:50:37.890 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8" 2023-02-06T09:50:37.890 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2023-02-06T09:50:37.891 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2023-02-06T09:50:37.891 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8" 2023-02-06T09:50:37.891 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8" 2023-02-06T09:50:37.891 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8" 2023-02-06T09:50:37.892 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2023-02-06T09:50:37.892 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-02-06T09:50:37.892 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2023-02-06T09:50:37.892 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-02-06T09:50:37.892 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-02-06T09:50:37.893 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-02-06T09:50:37.893 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2023-02-06T09:50:37.978 INFO:teuthology.dispatcher.supervisor:Running job 7149321 2023-02-06T09:50:37.978 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology -v --owner scheduled_dparmar@teuthology --archive /home/teuthworker/archive/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/7149321 --name dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi --description orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_nfs} -- /home/teuthworker/archive/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/7149321/orig.config.yaml 2023-02-06T09:50:37.981 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/7149321 2023-02-06T09:50:37.981 INFO:teuthology.dispatcher.supervisor:Job PID: 15931 2023-02-06T09:50:37.982 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-02-06T09:52:44.145 WARNING:urllib3.connectionpool:Retrying (Retry(total=9, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:52:47.217 WARNING:urllib3.connectionpool:Retrying (Retry(total=8, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:52:50.289 WARNING:urllib3.connectionpool:Retrying (Retry(total=7, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:52:53.361 WARNING:urllib3.connectionpool:Retrying (Retry(total=6, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:52:56.432 WARNING:urllib3.connectionpool:Retrying (Retry(total=5, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:52:59.505 WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:53:02.577 WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:53:05.649 WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:53:08.721 WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:53:11.793 WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:53:14.865 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/ Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 169, in _new_conn conn = connection.create_connection( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 96, in create_connection raise err File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 86, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 607, in connect raise _SocketError(err, strerror(err)) OSError: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen httplib_response = self._make_request( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 394, in _make_request conn.request(method, url, **httplib_request_kw) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 234, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1234, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1280, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1229, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1008, in _send_output self.send(msg) File "/usr/lib/python3.8/http/client.py", line 948, in send self.connect() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 200, in connect conn = self._new_conn() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 181, in _new_conn raise NewConnectionError( urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 440, in send resp = conn.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( [Previous line repeated 7 more times] File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen retries = retries.increment( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/retry.py", line 574, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 508, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 473, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 299, in report_job response = self.session.post(run_uri, data=job_json, headers=headers) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 577, in post return self.request('POST', url, data=data, json=json, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 529, in request resp = self.send(prep, **send_kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 645, in send r = adapter.send(request, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 519, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) 2023-02-06T09:55:17.746 WARNING:urllib3.connectionpool:Retrying (Retry(total=9, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:55:20.816 WARNING:urllib3.connectionpool:Retrying (Retry(total=8, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:55:23.889 WARNING:urllib3.connectionpool:Retrying (Retry(total=7, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:55:26.961 WARNING:urllib3.connectionpool:Retrying (Retry(total=6, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:55:30.032 WARNING:urllib3.connectionpool:Retrying (Retry(total=5, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:55:33.105 WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:55:36.176 WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:55:39.249 WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:55:42.321 WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:55:45.392 WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ 2023-02-06T09:55:48.465 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/ Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 169, in _new_conn conn = connection.create_connection( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 96, in create_connection raise err File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 86, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 607, in connect raise _SocketError(err, strerror(err)) OSError: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen httplib_response = self._make_request( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 394, in _make_request conn.request(method, url, **httplib_request_kw) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 234, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1234, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1280, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1229, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1008, in _send_output self.send(msg) File "/usr/lib/python3.8/http/client.py", line 948, in send self.connect() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 200, in connect conn = self._new_conn() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 181, in _new_conn raise NewConnectionError( urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 440, in send resp = conn.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( [Previous line repeated 7 more times] File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen retries = retries.increment( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/retry.py", line 574, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 508, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 473, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 299, in report_job response = self.session.post(run_uri, data=job_json, headers=headers) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 577, in post return self.request('POST', url, data=data, json=json, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 529, in request resp = self.send(prep, **send_kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 645, in send r = adapter.send(request, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 519, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/dparmar-2023-02-06_09:44:49-orch:cephadm-wip-58228-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) 2023-02-06T09:55:48.466 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-02-06T09:55:51.537 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 169, in _new_conn conn = connection.create_connection( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 96, in create_connection raise err File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 86, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 607, in connect raise _SocketError(err, strerror(err)) OSError: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen httplib_response = self._make_request( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 394, in _make_request conn.request(method, url, **httplib_request_kw) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 234, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1234, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1280, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1229, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1008, in _send_output self.send(msg) File "/usr/lib/python3.8/http/client.py", line 948, in send self.connect() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 200, in connect conn = self._new_conn() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 181, in _new_conn raise NewConnectionError( urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 440, in send resp = conn.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen retries = retries.increment( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/retry.py", line 574, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /nodes/smithi165.front.sepia.ceph.com/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/__init__.py", line 63, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 57, in main return run_job( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 156, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 226, in unlock_targets machine_statuses = query.get_statuses(job_info['targets'].keys()) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/lock/query.py", line 34, in get_statuses status = get_status(machine) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/lock/query.py", line 21, in get_status response = requests.get(uri) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/api.py", line 75, in get return request('get', url, params=params, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/api.py", line 61, in request return session.request(method=method, url=url, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 529, in request resp = self.send(prep, **send_kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 645, in send r = adapter.send(request, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 519, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /nodes/smithi165.front.sepia.ceph.com/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host'))