Found 34 jobs
Found 7 distinct failure reasons
Dead: b'2023-12-04T09:09:41.416 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-04T09:09:41.414+0000 7f0a061f7640 -1 mgr handle_mgr_signal  *** Got signal Terminated ***'
4 jobs: ['7476758', '7476732', '7476734', '7476737']
suites intersection: ['crimson-rados/perf/{clusters/{fixed-2}', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'settings/optimized']
suites union: ['crimson-rados/perf/{clusters/{fixed-2}', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'settings/optimized', 'workloads/fio_4K_rand_rw}', 'workloads/fio_4M_rand_read}', 'workloads/fio_4M_rand_rw}', 'workloads/sample_fio}']

Timeout 3h running clone.client.0/qa/workunits/rados/test_pool_quota.sh
1 jobs: ['7476727']
suites: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_api_tests}']

Timeout 3h running clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh
1 jobs: ['7476729']
suites: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests}']

Failure: Command failed (workunit test cls/test_cls_rbd.sh) on smithi066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e89bb53732569ae4a8d78945935b6e5cb35576be TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh'
1 jobs: ['7476741']
suites: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_cls_tests}']

Timeout 120 running ceph --cluster ceph pg dump --format=json
1 jobs: ['7476730']
suites: ['crimson-rados/singleton/{all/osd-backfill', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'objectstore/bluestore', 'rados}']

Failure: failed to complete snap trimming before timeout
2 jobs: ['7476742', '7476750']
suites intersection: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health']
suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/small-objects-balanced}', 'workloads/snaps-few-objects-balanced}']

Dead: b'2023-12-04T09:07:12.369 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-12-04T09:07:12.367+0000 7f12023f7640 -1 received  signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x  (PID: 81511) UID: 0'
2 jobs: ['7476728', '7476739']
suites intersection: ['crimson-rados/perf/{clusters/{fixed-2}', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'settings/optimized']
suites union: ['crimson-rados/perf/{clusters/{fixed-2}', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'settings/optimized', 'workloads/fio_4K_rand_read}', 'workloads/fio_4M_rand_write}']