Found 15 jobs Found 4 distinct failure reasons Failure: Command failed (workunit test fs/quota/quota.sh) on smithi017 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && cd -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4ba90dd80b1aa5b1a40fc707872b1636e7d0c3e7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="2" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.2 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.2 CEPH_MNT=/home/ubuntu/cephtest/mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.2/qa/workunits/fs/quota/quota.sh' 1 jobs: ['7390482'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/workunit/quota}'] Failure: "2023-09-07T00:20:54.997751+0000 mds.b (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi016:0 (7275), after 301.959 seconds" in cluster log 1 jobs: ['7390488'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/journal-repair}'] Assertion: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f20a2969cc5] ceph version 18.0.0-5849-g00f23e9a (00f23e9a033b0c92a258985da15db21d2979c6d2) reef (dev) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f20a2969cc5] 2: /usr/lib64/ceph/libceph-common.so.2(+0x2ace8b) [0x7f20a2969e8b] 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x3d3) [0x55d482ca8263] 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d482969a19] 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x593) [0x55d48296cb43] 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d48296d13c] 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d4829571ef] 8: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f20a2be9ca8] 9: (DispatchQueue::entry()+0x51f) [0x7f20a2be6e2f] 10: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f20a2cb18f1] 11: /lib64/libpthread.so.0(+0x81ca) [0x7f20a170d1ca] 1 jobs: ['7390480'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/snapshots}'] Failure: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 1 jobs: ['7390478'] suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/quota}']