2021-02-17T14:23:07.647 INFO:root:teuthology version: 1.1.0-071a4df2 2021-02-17T14:23:07.650 INFO:teuthology.results:seed: '5149' 2021-02-17T14:49:02.463 INFO:root:teuthology version: 1.1.0-071a4df2 2021-02-17T14:49:02.485 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-02-18T02:37:15.446 INFO:teuthology.results:Tests finished! gathering results... 2021-02-18T02:37:51.606 INFO:scrape:Found 22 jobs 2021-02-18T02:37:51.650 INFO:scrape:Found 1 distinct failure reasons 2021-02-18T02:37:51.656 INFO:scrape:Dead: b'2021-02-18T02:33:56.711 DEBUG:teuthology.exit:Finished running handlers' 2021-02-18T02:37:51.656 INFO:scrape:2 jobs: ['5891082', '5891074'] 2021-02-18T02:37:51.657 INFO:scrape:suites intersection: [] 2021-02-18T02:37:51.657 INFO:scrape:suites union: ['1-ceph-install/pacific', '1-tasks', '1.1-pg-log-overrides/normal_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-pacific', '7-msgr2', '8-final-workload/{rbd-python', 'distro1$/{rhel_latest}', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-bitmap', 'rados_api', 'rados_loadgenbig', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'rbd_import_export', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'test_rbd_api}}', 'thrashosds-health', 'ubuntu_18.04}', 'upgrade-sequence', 'upgrade:octopus-x/parallel/{0-start', 'upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack', 'workload/{ec-rados-default'] 2021-02-18T02:37:51.658 INFO:scrape: 2021-02-18T02:37:51.660 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/ failed: 0 dead: 2 running: 0 waiting: 0 queued: 0 passed: 20 Dead ================================================================= [5891074] upgrade:octopus-x/parallel/{0-start 1-tasks distro1$/{rhel_latest} mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891074/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891074/ hit max job timeout [5891082] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/pacific 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-pacific 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891082/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891082/ hit max job timeout Pass ================================================================= [5891075] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-all 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest} time: 00:20:41 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891075/ [5891076] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-nautilus-install/pacific 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 04:33:27 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891076/ [5891077] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/pacific 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-pacific 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} time: 04:06:43 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891077/ [5891078] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-nautilus-install/pacific 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 01:55:26 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891078/ [5891079] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/pacific 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-pacific 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 03:02:18 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891079/ [5891080] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-mon-osd-mds 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest} time: 00:26:24 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891080/ [5891081] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-nautilus-install/pacific 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 02:20:57 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891081/ [5891083] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-nautilus-install/pacific 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 04:02:41 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891083/ [5891084] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/pacific 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-pacific 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 02:58:16 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891084/ [5891085] upgrade:octopus-x/parallel/{0-start 1-tasks distro1$/{ubuntu_20.04} mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:13:33 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891085/ [5891086] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-all 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest} time: 00:20:29 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891086/ [5891087] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-nautilus-install/pacific 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 03:29:34 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891087/ [5891088] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/pacific 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-pacific 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} time: 05:12:33 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891088/ [5891089] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-nautilus-install/pacific 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 02:23:13 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891089/ [5891090] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/pacific 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-pacific 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 03:04:08 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891090/ [5891091] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-mon-osd-mds 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest} time: 00:26:27 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891091/ [5891092] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-nautilus-install/pacific 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 01:58:50 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891092/ [5891093] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/pacific 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-pacific 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} time: 05:34:51 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891093/ [5891094] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-nautilus-install/pacific 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 04:29:20 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891094/ [5891095] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/pacific 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-pacific 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 03:00:40 info: http://pulpito.ceph.com/teuthology-2021-02-17_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5891095/