Found 8 jobs Found 4 distinct failure reasons Dead: b'2020-10-26T16:49:13.301 DEBUG:teuthology.exit:Finished running handlers' 5 jobs: ['5558691', '5558694', '5558689', '5558695', '5558688'] suites intersection: ['clusters/{fixed-2.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash-erasure-code/{ceph.yaml', 'thrashosds-health.yaml'] suites union: ['clusters/{fixed-2.yaml', 'fast/fast.yaml', 'fast/normal.yaml', 'msgr-failures/few.yaml', 'msgr-failures/osd-delay.yaml', 'objectstore/bluestore-comp-snappy.yaml', 'objectstore/bluestore-comp-zlib.yaml', 'objectstore/bluestore-stupid.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash-erasure-code/{ceph.yaml', 'recovery-overrides/{more-active-recovery.yaml}', 'recovery-overrides/{more-async-partial-recovery.yaml}', 'recovery-overrides/{more-async-recovery.yaml}', 'recovery-overrides/{more-partial-recovery.yaml}', 'supported-random-distro$/{centos_latest.yaml}', 'supported-random-distro$/{ubuntu_16.04.yaml}', 'supported-random-distro$/{ubuntu_latest.yaml}', 'thrashers/careful.yaml', 'thrashers/default.yaml', 'thrashers/morepggrow.yaml', 'thrashers/pggrow.yaml', 'thrashosds-health.yaml', 'workloads/ec-rados-plugin=clay-k=4-m=2.yaml}', 'workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml}', 'workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml}', 'workloads/ec-small-objects-fast-read.yaml}'] Failure: psutil.NoSuchProcess process no longer exists (pid=3100) 1 jobs: ['5558693'] suites: ['clusters/{fixed-2.yaml', 'fast/fast.yaml', 'msgr-failures/fastclose.yaml', 'objectstore/bluestore-comp-lz4.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash-erasure-code/{ceph.yaml', 'recovery-overrides/{default.yaml}', 'supported-random-distro$/{rhel_latest.yaml}', 'thrashers/morepggrow.yaml', 'thrashosds-health.yaml', 'workloads/ec-small-objects.yaml}'] Crash: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 400000 --objects 20 --max-in-flight 8 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 0 --op write 0 --op delete 20 --op append 5 --op write_excl 0 --op append_excl 5 --pool unique_pool_0' ceph version 14.2.11-91-gf42f137403 (f42f137403caa6aa5f86fc6875fa543abc07a000) nautilus (stable) 1: (()+0xf630) [0x7fe9913d8630] 2: (gsignal()+0x37) [0x7fe9901cc387] 3: (abort()+0x148) [0x7fe9901cda78] 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x199) [0x55974e16a120] 5: (()+0x4de299) [0x55974e16a299] 6: (void PGLog::read_log_and_missing >(ObjectStore*, boost::intrusive_ptr&, ghobject_t, pg_info_t const&, PGLog::IndexedLog&, pg_missing_set&, std::basic_ostringstream, std::allocator >&, bool, bool*, DoutPrefixProvider const*, std::set, std::allocator >*, bool)+0x3022) [0x55974e369962] 7: (PG::read_state(ObjectStore*)+0x1c5) [0x55974e334355] 8: (OSD::load_pgs()+0x92a) [0x55974e24ee7a] 9: (OSD::init()+0x2559) [0x55974e276729] 10: (main()+0x1bf8) [0x55974e1d4488] 11: (__libc_start_main()+0xf5) [0x7fe9901b8555] 12: (()+0x57d3f5) [0x55974e2093f5] 1 jobs: ['5558692'] suites: ['clusters/{fixed-2.yaml', 'fast/normal.yaml', 'msgr-failures/osd-delay.yaml', 'objectstore/bluestore-bitmap.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash-erasure-code/{ceph.yaml', 'recovery-overrides/{default.yaml}', 'supported-random-distro$/{rhel_latest.yaml}', 'thrashers/fastread.yaml', 'thrashosds-health.yaml', 'workloads/ec-small-objects-many-deletes.yaml}'] Failure: reached maximum tries (800) after waiting for 4800 seconds 1 jobs: ['5558690'] suites: ['clusters/{fixed-2.yaml', 'fast/normal.yaml', 'msgr-failures/fastclose.yaml', 'objectstore/bluestore-comp-zstd.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash-erasure-code/{ceph.yaml', 'recovery-overrides/{more-active-recovery.yaml}', 'supported-random-distro$/{rhel_latest.yaml}', 'thrashers/careful.yaml', 'thrashosds-health.yaml', 'workloads/ec-radosbench.yaml}']