Found 43 jobs Found 3 distinct failure reasons Failure: Command failed on smithi073 with status 4: 'rm -f /tmp/kernel.x86_64.rpm && echo kernel-4.20.0_ceph_gd4c0c9bb2b1d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://5.chacra.ceph.com/r/kernel/testing/d4c0c9bb2b1d2f91769af32d49121018ffe640fe/centos/7/flavors/default/x86_64/ --input-file=-' 13 jobs: ['5411457', '5411474', '5411480', '5411458', '5411488', '5411451', '5411476', '5411448', '5411486', '5411464', '5411453', '5411463', '5411485'] suites intersection: ['conf/{client', 'log-config', 'mds', 'mon', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] suites union: ['clusters/1-mds-1-client', 'clusters/1-mds-2-client', 'clusters/1-mds-4-client', 'conf/{client', 'inline/no', 'kcephfs/cephfs/{begin', 'kcephfs/mixed-clients/{begin', 'kcephfs/recovery/{begin', 'kcephfs/thrash/{begin', 'kclient-overrides/{distro/random/{k-testing', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/random/{k-testing', 'overrides/{frag_enable', 'supported$/{centos_latest}}', 'supported$/{rhel_latest}}', 'tasks/client-limits}', 'tasks/failover}', 'tasks/forward-scrub}', 'tasks/kclient_workunit_snaps}', 'tasks/kclient_workunit_suites_ffsb}', 'tasks/kclient_workunit_suites_fsstress}', 'tasks/kclient_workunit_suites_fsync}', 'tasks/kclient_workunit_suites_pjd}', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'tasks/mds-flush}', 'tasks/pool-perm}', 'tasks/strays}', 'thrash-health-whitelist', 'thrashers/mon', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/kclient_workunit_suites_iozone}'] Failure: Test failure: test_damaged_dentry (tasks.cephfs.test_damage.TestDamage) 1 jobs: ['5411479'] suites: ['clusters/1-mds-4-client', 'conf/{client', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-ec-root', 'osd-asserts', 'osd}', 'overrides/{distro/random/{k-testing', 'overrides/{frag_enable', 'supported$/{ubuntu_16.04}}', 'tasks/damage}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Crash: Command failed (workunit test suites/ffsb.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fee7b7e4d8927d79c886fba1b53276175c503b4b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' ceph version 14.2.11-122-gfee7b7e (fee7b7e4d8927d79c886fba1b53276175c503b4b) nautilus (stable) 1: (()+0xf630) [0x7f23eaad2630] 2: (Mutex::lock(bool)+0x9) [0x7f23ecccfe99] 3: (C_GatherBase::new_sub()+0x2f) [0x555d1cf55b3f] 4: (MDCache::wait_for_uncommitted_fragments(C_GatherBase*)+0x40) [0x555d1ceba430] 5: (MDSRank::rejoin_done()+0x293) [0x555d1ce10dd3] 6: (MDSContext::complete(int)+0x74) [0x555d1d072ab4] 7: (MDCache::open_snaprealms()+0xb33) [0x555d1cf0ebb3] 8: (MDCache::rejoin_gather_finish()+0x10d) [0x555d1cf0ee7d] 9: (MDCache::rejoin_open_sessions_finish(std::map, std::less, std::allocator > > >&)+0x203) [0x555d1cf1bd73] 10: (MDSContext::complete(int)+0x74) [0x555d1d072ab4] 11: (MDSIOContextBase::complete(int)+0x16f) [0x555d1d072d0f] 12: (MDSLogContextBase::complete(int)+0x40) [0x555d1d072f20] 13: (Finisher::finisher_thread_entry()+0x16f) [0x7f23ecc9d8ff] 14: (()+0x7ea5) [0x7f23eaacaea5] 15: (clone()+0x6d) [0x7f23e97788dd] 1 jobs: ['5411481'] suites: ['clusters/1-mds-1-client', 'conf/{client', 'kcephfs/thrash/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/rhel/{k-distro', 'overrides/{frag_enable', 'rhel_latest}', 'thrash-health-whitelist', 'thrashers/mds', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/kclient_workunit_suites_ffsb}']