2022-08-21T13:19:16.253 INFO:root:teuthology version: 1.1.1.dev412+gb1d387f1 2022-08-21T13:19:16.254 INFO:teuthology.results:seed: '8231' 2022-08-21T13:19:44.319 INFO:root:teuthology version: 1.1.1.dev412+gb1d387f1 2022-08-21T13:19:44.322 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-08-21T13:19:44.344 INFO:teuthology.results:Tests finished! gathering results... 2022-08-21T13:19:44.419 INFO:scrape:Found 16 jobs 2022-08-21T13:19:44.420 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978213/teuthology.log 2022-08-21T13:19:44.421 INFO:scrape:Found 1 distinct failure reasons 2022-08-21T13:19:44.421 INFO:scrape:Dead: None 2022-08-21T13:19:44.422 INFO:scrape:16 jobs: ['6978213', '6978206', '6978208', '6978217', '6978216', '6978207', '6978211', '6978212', '6978215', '6978204', '6978203', '6978205', '6978210', '6978209', '6978202', '6978214'] 2022-08-21T13:19:44.422 INFO:scrape: 2022-08-21T13:19:44.423 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/ failed: 0 dead: 16 running: 0 waiting: 0 queued: 0 passed: 0 Dead ================================================================= [6978202] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978202/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978202/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978203] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978203/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978203/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978204] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 6-octopus 7-final-workload objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978204/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978204/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978205] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978205/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978205/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978206] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978206/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978206/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978207] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978207/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978207/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978208] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 6-octopus 7-final-workload objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978208/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978208/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978209] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978209/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978209/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978210] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978210/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978210/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978211] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978211/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978211/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978212] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 6-octopus 7-final-workload objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978212/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978212/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978213] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978213/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978213/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978214] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978214/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978214/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978215] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978215/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978215/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978216] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 6-octopus 7-final-workload objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978216/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978216/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',)) [6978217] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978217/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-18_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6978217/ Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] No route to host',))