Found 98 jobs Found 3 distinct failure reasons Failure: Command failed on smithi002 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t' 2 jobs: ['5694477', '5694510'] suites intersection: ['clusters/separate-client', 'conf', 'filestore-xfs', 'krbd/unmap/{ceph/ceph', 'tasks/unmap}'] suites union: ['clusters/separate-client', 'conf', 'filestore-xfs', 'kernels/single-major-off', 'kernels/single-major-on', 'krbd/unmap/{ceph/ceph', 'tasks/unmap}'] Failure: Command failed on smithi065 with status 120: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 2 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.2 image_client.2' 2 jobs: ['5694489', '5694529'] suites intersection: ['clusters/3-node', 'conf', 'krbd/fsx/{ceph/ceph', 'objectstore/bluestore-bitmap', 'randomized-striping-off}', 'tasks/fsx-3-client}'] suites union: ['clusters/3-node', 'conf', 'features/no-object-map', 'features/object-map', 'krbd/fsx/{ceph/ceph', 'objectstore/bluestore-bitmap', 'randomized-striping-off}', 'striping/default/{msgr-failures/few', 'striping/default/{msgr-failures/many', 'tasks/fsx-3-client}'] Failure: "2020-12-09T12:02:51.474070+0000 mon.a (mon.0) 1798 : cluster [WRN] Health check update: Degraded data redundancy: 875/6378 objects degraded (13.719%), 24 pgs degraded (PG_DEGRADED)" in cluster log 1 jobs: ['5694522'] suites: ['clusters/3-node', 'conf', 'features/no-object-map', 'krbd/fsx/{ceph/ceph', 'objectstore/bluestore-bitmap', 'randomized-striping-on}', 'striping/fancy/{msgr-failures/few', 'tasks/fsx-3-client}']