Found 223 jobs
Found 3 distinct failure reasons
Failure: {'smithi074.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi197.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}}
28 jobs: ['6028994', '6029010', '6029093', '6029057', '6029006', '6029069', '6028947', '6028978', '6029033', '6028983', '6028953', '6028981', '6029077', '6028959', '6029020', '6029101', '6029016', '6029000', '6028969', '6029061', '6029025', '6028982', '6029126', '6028958', '6029105', '6029055', '6028989', '6029008']
suites intersection: []
suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', 'backoff/normal', 'backoff/peering', 'ceph', 'cluster/{12-osds', 'clusters/9-mons', 'clusters/{fixed-2', 'clusters/{fixed-4', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/off', 'debug/mgr', 'fast/fast', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'msgr/random', 'msgr/simple', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/dashboard/{clusters/{2-node-mgr}', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/multimon/{clusters/9', 'rados/rest/{mgr-restful', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/large-omap-object-warnings', 'rados/singleton-nomsgr/{all/recovery-unfound-found', 'rados/singleton/{all/lost-unfound-delete', 'rados/singleton/{all/max-pg-per-osd.from-primary', 'rados/singleton/{all/thrash-eio', 'rados/singleton/{all/thrash-rados/{thrash-rados', 'rados/singleton/{all/watch-notify-same-primary', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'supported-random-distro$/{rhel_7}', 'supported-random-distro$/{rhel_7}}', 'tasks/dashboard}', 'tasks/mon_recovery}', 'tasks/orchestrator_cli}', 'tasks/progress}', 'tasks/rados_cls_all}', 'tasks/rados_stress_watch}', 'tasks/rados_striper}', 'tasks/rados_workunit_loadgen_mix}', 'thrashers/careful', 'thrashers/default', 'thrashers/many', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'thrashosds-health}', 'workloads/ec-rados-plugin=clay-k=4-m=2}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-small-objects-fast-read-overwrites}', 'workloads/ec-snaps-few-objects-overwrites}', 'workloads/pool-snaps-few-objects}', 'workloads/rados_mon_workunits}', 'workloads/radosbench-high-concurrency}']

Failure: "2021-04-08 19:44:58.046249 osd.1 (osd.1) 267 : cluster [ERR] 2.4s0 scrub : stat mismatch, got 15/15 objects, 11/11 clones, 15/15 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 1/1 whiteouts, 30900224/1867776 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes." in cluster log
1 jobs: ['6029180']
suites: ['cluster/{12-osds', 'msgr-failures/osd-delay', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash-erasure-code-big/{ceph', 'recovery-overrides/{more-active-recovery}', 'supported-random-distro$/{ubuntu_16.04}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}']

Failure: Command failed (workunit test mon/pool_ops.sh) on smithi098 with status 110: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36e255485e9c1e5de6ee6f3f4aa4c3cd3a26d82b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/pool_ops.sh'
1 jobs: ['6029293']
suites: ['msgr-failures/few', 'msgr/random', 'objectstore/bluestore-comp-snappy', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{ubuntu_latest}}']