2023-01-16T19:47:16.207 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2023-01-16T19:47:16.207 INFO:teuthology.results:subset: '111/120000' 2023-01-16T19:47:16.207 INFO:teuthology.results:seed: '2372' 2023-01-16T20:04:50.862 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2023-01-16T20:04:50.865 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-01-17T08:05:28.453 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2023-01-17T08:05:29.062 INFO:scrape:Found 5 jobs 2023-01-17T08:05:29.063 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2023-01-16_15:54:24-upgrade:pacific-p2p-pacific_16.2.11_RC6.6-distro-default-smithi/7143307/teuthology.log 2023-01-17T08:05:29.322 INFO:scrape:Found 2 distinct failure reasons 2023-01-17T08:05:29.322 INFO:scrape:Dead: None 2023-01-17T08:05:29.322 INFO:scrape:1 jobs: ['7143307'] 2023-01-17T08:05:29.322 INFO:scrape: 2023-01-17T08:05:29.322 INFO:scrape:Failure: HTTPSConnectionPool(host='chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/pacific/dd0603118f56ab514f133c8d2e3adfc983942503/ubuntu/focal/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) 2023-01-17T08:05:29.322 INFO:scrape:4 jobs: ['7143309', '7143311', '7143308', '7143310'] 2023-01-17T08:05:29.323 INFO:scrape:suites intersection: ['1-ceph-install/pacific', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '6-final-workload/{rbd-python', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/ubuntu_latest', 'thrashosds-health}', 'upgrade:pacific-p2p/pacific-p2p-stress-split/{0-cluster/{openstack'] 2023-01-17T08:05:29.323 INFO:scrape:suites union: ['1-ceph-install/pacific', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '6-final-workload/{rbd-python', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/ubuntu_latest', 'thrashosds-health}', 'upgrade:pacific-p2p/pacific-p2p-stress-split/{0-cluster/{openstack'] 2023-01-17T08:05:29.323 INFO:scrape: 2023-01-17T08:05:29.323 INFO:teuthology.results:Sending results to yweinstein@radhat.com: Test Run: yuriw-2023-01-16_15:54:24-upgrade:pacific-p2p-pacific_16.2.11_RC6.6-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-01-16_15:54:24-upgrade:pacific-p2p-pacific_16.2.11_RC6.6-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-16_15:54:24-upgrade:pacific-p2p-pacific_16.2.11_RC6.6-distro-default-smithi/ failed: 4 dead: 0 running: 0 waiting: 1 queued: 0 passed: 0 Fail ================================================================= [7143308] upgrade:pacific-p2p/pacific-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/pacific 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 00:06:58 info: http://pulpito.ceph.com/yuriw-2023-01-16_15:54:24-upgrade:pacific-p2p-pacific_16.2.11_RC6.6-distro-default-smithi/7143308/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-16_15:54:24-upgrade:pacific-p2p-pacific_16.2.11_RC6.6-distro-default-smithi/7143308/ sentry: https://sentry.ceph.com/organizations/ceph/?query=692026ae03614735bf91add47bd32b8f HTTPSConnectionPool(host='chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/pacific/dd0603118f56ab514f133c8d2e3adfc983942503/ubun tu/focal/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7143309] upgrade:pacific-p2p/pacific-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/pacific 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-comp supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 00:06:58 info: http://pulpito.ceph.com/yuriw-2023-01-16_15:54:24-upgrade:pacific-p2p-pacific_16.2.11_RC6.6-distro-default-smithi/7143309/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-16_15:54:24-upgrade:pacific-p2p-pacific_16.2.11_RC6.6-distro-default-smithi/7143309/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2c06d1831b2e4ef19f6fab25cc3516f3 HTTPSConnectionPool(host='chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/pacific/dd0603118f56ab514f133c8d2e3adfc983942503/ubun tu/focal/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7143310] upgrade:pacific-p2p/pacific-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/pacific 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-stupid supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 00:06:57 info: http://pulpito.ceph.com/yuriw-2023-01-16_15:54:24-upgrade:pacific-p2p-pacific_16.2.11_RC6.6-distro-default-smithi/7143310/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-16_15:54:24-upgrade:pacific-p2p-pacific_16.2.11_RC6.6-distro-default-smithi/7143310/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7cf4b54a12934370a66d4295774d1ef1 HTTPSConnectionPool(host='chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/pacific/dd0603118f56ab514f133c8d2e3adfc983942503/ubun tu/focal/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7143311] upgrade:pacific-p2p/pacific-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/pacific 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 00:06:58 info: http://pulpito.ceph.com/yuriw-2023-01-16_15:54:24-upgrade:pacific-p2p-pacific_16.2.11_RC6.6-distro-default-smithi/7143311/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-16_15:54:24-upgrade:pacific-p2p-pacific_16.2.11_RC6.6-distro-default-smithi/7143311/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cae8dd48b0224396b219bb2535d1775a HTTPSConnectionPool(host='chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/pacific/dd0603118f56ab514f133c8d2e3adfc983942503/ubun tu/focal/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) Waiting ================================================================= [7143307] upgrade:pacific-p2p/pacific-p2p-parallel/{point-to-point-upgrade supported-all-distro/ubuntu_latest} info: http://pulpito.ceph.com/yuriw-2023-01-16_15:54:24-upgrade:pacific-p2p-pacific_16.2.11_RC6.6-distro-default-smithi/7143307/