2023-02-07T09:01:55.100 INFO:root:teuthology version: 0.0.1.dev37+g00690ec 2023-02-07T09:01:55.232 INFO:teuthology.lock.ops:Start node 'smithi085.front.sepia.ceph.com' reimaging 2023-02-07T09:01:55.233 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: reset os type and version on server 2023-02-07T09:01:55.233 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2023-02-07T09:01:55.259 INFO:teuthology.lock.ops:Node 'smithi085.front.sepia.ceph.com' reimaging is complete 2023-02-07T09:01:55.259 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-02-07T09:01:55.260 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-02-07T09:01:55.260 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-02-07T09:01:55.278 INFO:teuthology.lock.ops:Node 'smithi172.front.sepia.ceph.com' reimaging is complete 2023-02-07T09:01:55.443 INFO:teuthology.provision.fog.smithi085:Scheduling deploy of rhel 8.4 2023-02-07T09:01:55.447 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 8.4 2023-02-07T09:01:55.654 INFO:teuthology.orchestra.console:Power off smithi085 2023-02-07T09:01:55.667 INFO:teuthology.orchestra.console:Power off smithi172 2023-02-07T09:01:55.798 INFO:teuthology.orchestra.console:Power off for smithi085 completed 2023-02-07T09:01:55.811 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-02-07T09:01:55.899 INFO:teuthology.orchestra.console:Power on smithi085 2023-02-07T09:01:55.912 INFO:teuthology.orchestra.console:Power on smithi172 2023-02-07T09:02:00.160 INFO:teuthology.orchestra.console:Power on for smithi172 completed 2023-02-07T09:02:00.261 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-02-07T09:02:04.261 INFO:teuthology.orchestra.console:Power on for smithi085 completed 2023-02-07T09:02:04.362 INFO:teuthology.provision.fog.smithi085:Waiting for deploy to finish 2023-02-07T09:05:08.496 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.85 2023-02-07T09:05:17.552 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.85 2023-02-07T09:05:19.504 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-02-07T09:05:26.613 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.85 2023-02-07T09:05:28.560 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-02-07T09:05:35.696 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.85 2023-02-07T09:05:37.620 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-02-07T09:05:46.704 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-02-07T09:05:55.760 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-02-07T09:06:41.742 WARNING:teuthology.provision.fog:timed out 2023-02-07T09:06:48.042 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-02-07T09:06:48.347 INFO:teuthology.provision.fog.smithi085:Node is ready 2023-02-07T09:06:48.361 INFO:teuthology.orchestra.run.smithi085.stdout:smithi085.front.sepia.ceph.com 2023-02-07T09:06:48.415 INFO:teuthology.orchestra.run.smithi085.stdout:172.21.15.85 smithi085.front.sepia.ceph.com smithi085 2023-02-07T09:06:48.775 INFO:teuthology.provision.fog.smithi085:Deploy complete! 2023-02-07T09:07:01.772 WARNING:teuthology.provision.fog:timed out 2023-02-07T09:07:08.068 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-02-07T09:07:08.321 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-02-07T09:07:08.336 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172 2023-02-07T09:07:08.392 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2023-02-07T09:07:08.719 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-02-07T09:07:08.877 INFO:teuthology.lock.ops:Checking smithi085.front.sepia.ceph.com 2023-02-07T09:07:08.877 INFO:teuthology.lock.ops:New key found. Updating... 2023-02-07T09:07:08.971 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-02-07T09:07:08.971 INFO:teuthology.lock.ops:New key found. Updating... 2023-02-07T09:07:08.987 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: set os type and version on server 2023-02-07T09:07:08.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2023-02-07T09:07:09.222 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64 2023-02-07T09:07:09.277 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="Red Hat Enterprise Linux" 2023-02-07T09:07:09.277 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="8.4 (Ootpa)" 2023-02-07T09:07:09.278 INFO:teuthology.orchestra.run.smithi085.stdout:ID="rhel" 2023-02-07T09:07:09.278 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE="fedora" 2023-02-07T09:07:09.278 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="8.4" 2023-02-07T09:07:09.278 INFO:teuthology.orchestra.run.smithi085.stdout:PLATFORM_ID="platform:el8" 2023-02-07T09:07:09.278 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-02-07T09:07:09.278 INFO:teuthology.orchestra.run.smithi085.stdout:ANSI_COLOR="0;31" 2023-02-07T09:07:09.279 INFO:teuthology.orchestra.run.smithi085.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-02-07T09:07:09.279 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://www.redhat.com/" 2023-02-07T09:07:09.279 INFO:teuthology.orchestra.run.smithi085.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-02-07T09:07:09.279 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-02-07T09:07:09.279 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-02-07T09:07:09.280 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-02-07T09:07:09.280 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-02-07T09:07:09.280 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-02-07T09:07:09.280 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-02-07T09:07:09.281 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2023-02-07T09:07:09.297 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-02-07T09:07:09.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-02-07T09:07:09.479 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-02-07T09:07:09.533 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-02-07T09:07:09.534 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.4 (Ootpa)" 2023-02-07T09:07:09.534 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-02-07T09:07:09.534 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-02-07T09:07:09.534 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.4" 2023-02-07T09:07:09.534 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-02-07T09:07:09.535 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-02-07T09:07:09.535 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-02-07T09:07:09.535 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-02-07T09:07:09.535 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-02-07T09:07:09.535 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-02-07T09:07:09.536 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-02-07T09:07:09.536 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-02-07T09:07:09.536 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-02-07T09:07:09.536 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-02-07T09:07:09.537 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-02-07T09:07:09.537 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-02-07T09:07:09.537 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-02-07T09:07:09.625 INFO:teuthology.dispatcher.supervisor:Running job 7151456 2023-02-07T09:07:09.626 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/7151456 --name yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi --description fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} -- /home/teuthworker/archive/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/7151456/orig.config.yaml 2023-02-07T09:07:09.628 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/7151456 2023-02-07T09:07:09.629 INFO:teuthology.dispatcher.supervisor:Job PID: 24997 2023-02-07T09:07:09.629 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-02-07T09:09:10.675 WARNING:urllib3.connectionpool:Retrying (Retry(total=9, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:09:13.747 WARNING:urllib3.connectionpool:Retrying (Retry(total=8, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:09:16.818 WARNING:urllib3.connectionpool:Retrying (Retry(total=7, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:09:19.890 WARNING:urllib3.connectionpool:Retrying (Retry(total=6, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:09:22.967 WARNING:urllib3.connectionpool:Retrying (Retry(total=5, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:09:26.038 WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:09:29.106 WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:09:32.178 WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:09:35.249 WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:09:38.321 WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:09:41.398 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/ Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 169, in _new_conn conn = connection.create_connection( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 96, in create_connection raise err File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 86, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 607, in connect raise _SocketError(err, strerror(err)) OSError: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen httplib_response = self._make_request( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 394, in _make_request conn.request(method, url, **httplib_request_kw) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 234, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1234, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1280, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1229, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1008, in _send_output self.send(msg) File "/usr/lib/python3.8/http/client.py", line 948, in send self.connect() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 200, in connect conn = self._new_conn() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 181, in _new_conn raise NewConnectionError( urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 440, in send resp = conn.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( [Previous line repeated 7 more times] File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen retries = retries.increment( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/retry.py", line 574, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 508, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 473, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 299, in report_job response = self.session.post(run_uri, data=job_json, headers=headers) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 577, in post return self.request('POST', url, data=data, json=json, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 529, in request resp = self.send(prep, **send_kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 645, in send r = adapter.send(request, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 519, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) 2023-02-07T09:11:44.273 WARNING:urllib3.connectionpool:Retrying (Retry(total=9, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:11:47.345 WARNING:urllib3.connectionpool:Retrying (Retry(total=8, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:11:50.417 WARNING:urllib3.connectionpool:Retrying (Retry(total=7, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:11:53.489 WARNING:urllib3.connectionpool:Retrying (Retry(total=6, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:11:56.562 WARNING:urllib3.connectionpool:Retrying (Retry(total=5, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:11:59.633 WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:12:02.707 WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:12:05.778 WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:12:08.849 WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:12:11.921 WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:12:14.998 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/ Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 169, in _new_conn conn = connection.create_connection( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 96, in create_connection raise err File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 86, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 607, in connect raise _SocketError(err, strerror(err)) OSError: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen httplib_response = self._make_request( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 394, in _make_request conn.request(method, url, **httplib_request_kw) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 234, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1234, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1280, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1229, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1008, in _send_output self.send(msg) File "/usr/lib/python3.8/http/client.py", line 948, in send self.connect() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 200, in connect conn = self._new_conn() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 181, in _new_conn raise NewConnectionError( urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 440, in send resp = conn.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( [Previous line repeated 7 more times] File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen retries = retries.increment( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/retry.py", line 574, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 508, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 473, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 299, in report_job response = self.session.post(run_uri, data=job_json, headers=headers) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 577, in post return self.request('POST', url, data=data, json=json, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 529, in request resp = self.send(prep, **send_kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 645, in send r = adapter.send(request, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 519, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) 2023-02-07T09:14:17.877 WARNING:urllib3.connectionpool:Retrying (Retry(total=9, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:14:20.944 WARNING:urllib3.connectionpool:Retrying (Retry(total=8, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:14:24.016 WARNING:urllib3.connectionpool:Retrying (Retry(total=7, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:14:27.090 WARNING:urllib3.connectionpool:Retrying (Retry(total=6, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:14:30.161 WARNING:urllib3.connectionpool:Retrying (Retry(total=5, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:14:33.233 WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:14:36.305 WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:14:39.377 WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:14:42.449 WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:14:45.521 WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:14:48.594 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/ Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 169, in _new_conn conn = connection.create_connection( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 96, in create_connection raise err File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 86, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 607, in connect raise _SocketError(err, strerror(err)) OSError: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen httplib_response = self._make_request( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 394, in _make_request conn.request(method, url, **httplib_request_kw) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 234, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1234, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1280, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1229, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1008, in _send_output self.send(msg) File "/usr/lib/python3.8/http/client.py", line 948, in send self.connect() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 200, in connect conn = self._new_conn() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 181, in _new_conn raise NewConnectionError( urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 440, in send resp = conn.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( [Previous line repeated 7 more times] File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen retries = retries.increment( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/retry.py", line 574, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 508, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 473, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 299, in report_job response = self.session.post(run_uri, data=job_json, headers=headers) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 577, in post return self.request('POST', url, data=data, json=json, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 529, in request resp = self.send(prep, **send_kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 645, in send r = adapter.send(request, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 519, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) 2023-02-07T09:16:51.472 WARNING:urllib3.connectionpool:Retrying (Retry(total=9, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:16:54.544 WARNING:urllib3.connectionpool:Retrying (Retry(total=8, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:16:57.618 WARNING:urllib3.connectionpool:Retrying (Retry(total=7, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:17:00.690 WARNING:urllib3.connectionpool:Retrying (Retry(total=6, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:17:03.762 WARNING:urllib3.connectionpool:Retrying (Retry(total=5, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:17:06.833 WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:17:09.904 WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:17:12.977 WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:17:16.048 WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:17:19.120 WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')': /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ 2023-02-07T09:17:22.193 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/ Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 169, in _new_conn conn = connection.create_connection( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 96, in create_connection raise err File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 86, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 607, in connect raise _SocketError(err, strerror(err)) OSError: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen httplib_response = self._make_request( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 394, in _make_request conn.request(method, url, **httplib_request_kw) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 234, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1234, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1280, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1229, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1008, in _send_output self.send(msg) File "/usr/lib/python3.8/http/client.py", line 948, in send self.connect() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 200, in connect conn = self._new_conn() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 181, in _new_conn raise NewConnectionError( urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 440, in send resp = conn.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( [Previous line repeated 7 more times] File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen retries = retries.increment( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/retry.py", line 574, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 508, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 473, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 299, in report_job response = self.session.post(run_uri, data=job_json, headers=headers) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 577, in post return self.request('POST', url, data=data, json=json, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 529, in request resp = self.send(prep, **send_kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 645, in send r = adapter.send(request, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 519, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/yuriw-2023-02-06_22:38:13-fs-wip-yuri5-testing-2023-02-01-0832-quincy-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) 2023-02-07T09:17:22.194 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-02-07T09:17:25.266 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 169, in _new_conn conn = connection.create_connection( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 96, in create_connection raise err File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 86, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 607, in connect raise _SocketError(err, strerror(err)) OSError: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen httplib_response = self._make_request( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 394, in _make_request conn.request(method, url, **httplib_request_kw) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 234, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1234, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1280, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1229, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1008, in _send_output self.send(msg) File "/usr/lib/python3.8/http/client.py", line 948, in send self.connect() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 200, in connect conn = self._new_conn() File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 181, in _new_conn raise NewConnectionError( urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 113] No route to host During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 440, in send resp = conn.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen retries = retries.increment( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/urllib3/util/retry.py", line 574, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /nodes/smithi085.front.sepia.ceph.com/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/__init__.py", line 63, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 57, in main return run_job( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 156, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 226, in unlock_targets machine_statuses = query.get_statuses(job_info['targets'].keys()) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/lock/query.py", line 34, in get_statuses status = get_status(machine) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/lock/query.py", line 21, in get_status response = requests.get(uri) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/api.py", line 75, in get return request('get', url, params=params, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/api.py", line 61, in request return session.request(method=method, url=url, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 529, in request resp = self.send(prep, **send_kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 645, in send r = adapter.send(request, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 519, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /nodes/smithi085.front.sepia.ceph.com/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host'))