Found 315 jobs Misunderstood line: Found 5 distinct failure reasons Valgrind: osd (Leak_DefinitelyLost) 1 jobs: ['5498802'] suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'validater/valgrind}'] Failure: "2020-10-05T22:33:18.337981+0000 mon.c (mon.0) 22 : cluster [WRN] Health check failed: 1/21 mons down, quorum c,a,b,f,d,e,i,g,h,l,j,k,o,m,n,r,p,q,u,s (MON_DOWN)" in cluster log 2 jobs: ['5498770', '5498996'] suites intersection: ['rados'] suites union: ['clusters/{fixed-2', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v1only', 'no_pools', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/multimon/{clusters/21', 'supported-random-distro$/{rhel_latest}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/mon_clock_no_skews}', 'tasks/rados_cls_all}'] Failure: Command failed (workunit test osd/osd-rep-recov-eio.sh) on smithi001 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=25974bde613f88a851dd0fb76cfcacf4e732b446 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-rep-recov-eio.sh' 1 jobs: ['5498939'] suites: ['rados/standalone/{supported-random-distro$/{ubuntu_latest}', 'workloads/osd}'] Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=hammer 1 jobs: ['5498972'] suites: ['1-install/hammer', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'distro$/{ubuntu_18.04}', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'thrashers/mapgap', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}'] Failure: reached maximum tries (180) after waiting for 180 seconds 1 jobs: ['5498724'] suites: ['fixed-2', 'rados/cephadm/smoke/{distro/centos_7', 'start}']