Found 24 jobs
Found 3 distinct failure reasons
Crash: Command failed (workunit test suites/fsstress.sh) on smithi195 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b340acf629a010a74d90da5782a2c5fe0b54ac20 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh'
ceph version 14.2.10 (b340acf629a010a74d90da5782a2c5fe0b54ac20) nautilus (stable)
 1: (()+0xf630) [0x7fe17b047630]
 2: (gsignal()+0x37) [0x7fe179c25387]
 3: (abort()+0x148) [0x7fe179c26a78]
 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x199) [0x7fe17d181324]
 5: (()+0x25449d) [0x7fe17d18149d]
 6: (ProtocolV1::handle_message_footer(char*, int)+0xf3d) [0x7fe17d46dc5d]
 7: (()+0x53945d) [0x7fe17d46645d]
 8: (AsyncConnection::process()+0x186) [0x7fe17d458076]
 9: (EventCenter::process_events(unsigned int, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> >*)+0xa15) [0x7fe17d4aa0e5]
 10: (()+0x583a47) [0x7fe17d4b0a47]
 11: (()+0x81411f) [0x7fe17d74111f]
 12: (()+0x7ea5) [0x7fe17b03fea5]
 13: (clone()+0x6d) [0x7fe179ced8dd]
1 jobs: ['5189798']
suites: ['begin', 'ceph-thrash/default', 'clusters/9-mds-3-standby', 'conf/{client', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'multimds/thrash/{0-supported-random-distro$/{ubuntu_latest}', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{distro/rhel/{k-distro', 'overrides/{fuse-default-perm-no', 'rhel_latest}', 'tasks/cfuse_workunit_suites_fsstress}', 'thrash/{frag_enable', 'thrash_debug}', 'whitelist_health', 'whitelist_wrongly_marked_down}']

Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=centos%2F7%2Fx86_64&sha1=556853900c89275f667d7cda681eca33c54b8e71
5 jobs: ['5189812', '5189810', '5189794', '5189778', '5189806']
suites intersection: ['conf/{client', 'mds', 'mon', 'mount/fuse', 'osd}', 'whitelist_health']
suites union: ['begin', 'centos_latest', 'ceph-thrash/default', 'clusters/3-mds', 'clusters/3-mds-2-standby', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'msgr-failures/none', 'multimds/basic/{0-supported-random-distro$/{rhel_latest}', 'multimds/thrash/{0-supported-random-distro$/{rhel_latest}', 'multimds/verify/{begin', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{fuse-default-perm-no', 'q_check_counter/check_counter', 'tasks/cfuse_workunit_kernel_untar_build}', 'tasks/cfuse_workunit_suites_fsstress', 'tasks/cfuse_workunit_suites_pjd}', 'thrash/{frag_enable', 'thrash_debug}', 'validater/lockdep}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'whitelist_wrongly_marked_down}}']

Failure: "2020-06-30 19:31:36.030022 mds.e (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi067: (4792), after waiting 45.5072 seconds during MDS startup" in cluster log
1 jobs: ['5189814']
suites: ['begin', 'ceph-thrash/default', 'clusters/9-mds-3-standby', 'conf/{client', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'multimds/thrash/{0-supported-random-distro$/{centos_latest}', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{distro/random/{k-testing', 'overrides/{fuse-default-perm-no', 'supported$/{rhel_latest}}', 'tasks/cfuse_workunit_suites_fsstress}', 'thrash/{frag_enable', 'thrash_debug}', 'whitelist_health', 'whitelist_wrongly_marked_down}']