2021-10-17T16:10:19.182 INFO:root:teuthology version: 1.1.0-b35344e8 2021-10-17T16:10:19.183 INFO:teuthology.results:seed: '2020' 2021-10-17T18:16:22.946 INFO:root:teuthology version: 1.1.0-b35344e8 2021-10-17T18:16:22.982 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-10-18T04:47:01.716 INFO:teuthology.results:Tests finished! gathering results... 2021-10-18T04:47:02.249 INFO:scrape:Found 5 jobs 2021-10-18T04:47:03.526 INFO:scrape:Found 2 distinct failure reasons 2021-10-18T04:47:03.527 INFO:scrape:Failure: "2021-10-17T17:02:42.333298+0000 mon.b (mon.0) 7 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log 2021-10-18T04:47:03.528 INFO:scrape:1 jobs: ['6445822'] 2021-10-18T04:47:03.528 INFO:scrape:suites: ['supported-all-distro/ubuntu_latest}', 'upgrade:octopus-p2p/octopus-p2p-parallel/{point-to-point-upgrade'] 2021-10-18T04:47:03.528 INFO:scrape: 2021-10-18T04:47:03.529 INFO:scrape:Dead: b"TypeError: argument of type 'NoneType' is not iterable" 2021-10-18T04:47:03.529 INFO:scrape:1 jobs: ['6445825'] 2021-10-18T04:47:03.530 INFO:scrape:suites: ['1-ceph-install/octopus', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '6-final-workload/{rbd-python', 'objectstore/bluestore-stupid', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/ubuntu_latest', 'thrashosds-health}', 'upgrade:octopus-p2p/octopus-p2p-stress-split/{0-cluster/{openstack'] 2021-10-18T04:47:03.530 INFO:scrape: 2021-10-18T04:47:03.531 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-10-16_01:25:02-upgrade:octopus-p2p-octopus-distro-default-gibba ================================================================= info: http://pulpito.ceph.com/teuthology-2021-10-16_01:25:02-upgrade:octopus-p2p-octopus-distro-default-gibba/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-16_01:25:02-upgrade:octopus-p2p-octopus-distro-default-gibba/ failed: 1 dead: 1 running: 0 waiting: 0 queued: 0 passed: 3 Fail ================================================================= [6445822] upgrade:octopus-p2p/octopus-p2p-parallel/{point-to-point-upgrade supported-all-distro/ubuntu_latest} ----------------------------------------------------------------- time: 01:02:48 info: http://pulpito.ceph.com/teuthology-2021-10-16_01:25:02-upgrade:octopus-p2p-octopus-distro-default-gibba/6445822/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-16_01:25:02-upgrade:octopus-p2p-octopus-distro-default-gibba/6445822/ "2021-10-17T17:02:42.333298+0000 mon.b (mon.0) 7 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log Dead ================================================================= [6445825] upgrade:octopus-p2p/octopus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-stupid supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-16_01:25:02-upgrade:octopus-p2p-octopus-distro-default-gibba/6445825/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-16_01:25:02-upgrade:octopus-p2p-octopus-distro-default-gibba/6445825/ Pass ================================================================= [6445823] upgrade:octopus-p2p/octopus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest thrashosds-health} time: 04:02:42 info: http://pulpito.ceph.com/teuthology-2021-10-16_01:25:02-upgrade:octopus-p2p-octopus-distro-default-gibba/6445823/ [6445824] upgrade:octopus-p2p/octopus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-comp supported-all-distro/ubuntu_latest thrashosds-health} time: 03:58:36 info: http://pulpito.ceph.com/teuthology-2021-10-16_01:25:02-upgrade:octopus-p2p-octopus-distro-default-gibba/6445824/ [6445826] upgrade:octopus-p2p/octopus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} time: 04:02:55 info: http://pulpito.ceph.com/teuthology-2021-10-16_01:25:02-upgrade:octopus-p2p-octopus-distro-default-gibba/6445826/