Found 210 jobs
Found 8 distinct failure reasons
Crash: Found coredumps on ubuntu@smithi040.front.sepia.ceph.com
ceph version 18.0.0-4275-g4d3e9642 (4d3e9642f733c6e311d35e619922bd92ca033fbd) reef (dev)
 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f87c9889420]
 2: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned int, int)+0xe3) [0x7f87c882ffd3]
 3: (tcmalloc::ThreadCache::ListTooLong(tcmalloc::ThreadCache::FreeList*, unsigned int)+0x30) [0x7f87c8830350]
 4: ceph-mon(+0xde88f3) [0x559180f368f3]
 5: ceph-mon(+0xde88b6) [0x559180f368b6]
 6: ceph-mon(+0xde88b6) [0x559180f368b6]
 7: ceph-mon(+0xde88b6) [0x559180f368b6]
 8: (MgrMonitor::update_from_paxos(bool*)+0x611) [0x559180f47df1]
 9: (Monitor::refresh_from_paxos(bool*)+0x104) [0x559180cb9ad4]
 10: (Paxos::do_refresh()+0x52) [0x559180e2f6a2]
 11: (Paxos::commit_finish()+0x699) [0x559180e38b99]
 12: (C_Committed::finish(int)+0x4a) [0x559180e3bfba]
 13: (Context::complete(int)+0xd) [0x559180cf4e8d]
 14: (Context::complete(int)+0xd) [0x559180cf4e8d]
 15: (Finisher::finisher_thread_entry()+0x18d) [0x7f87c8dc4e9d]
 16: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f87c987d609]
 17: clone()
1 jobs: ['7295893']
suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/secure', 'msgr-failures/many', 'tasks/krbd_latest_osdmap_on_map}']

Failure: Command failed (workunit test rbd/krbd_udev_enumerate.sh) on smithi145 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=aef7f6787496f28a04d0c6511a3205e79d473fa8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_udev_enumerate.sh'
5 jobs: ['7295829', '7295898', '7295794', '7295758', '7295864']
suites intersection: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'tasks/krbd_udev_enumerate}']
suites union: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/crc$/{crc-rxbounce}', 'ms_mode/legacy$/{legacy-rxbounce}', 'ms_mode/legacy$/{legacy}', 'ms_mode/secure', 'msgr-failures/few', 'msgr-failures/many', 'tasks/krbd_udev_enumerate}']

Failure: Command failed on smithi195 with status 91: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.0 image_client.0'
2 jobs: ['7295869', '7295834']
suites intersection: ['clusters/3-node', 'conf', 'features/no-object-map', 'krbd/fsx/{ceph/ceph', 'objectstore/bluestore-bitmap', 'tasks/fsx-3-client}']
suites union: ['clusters/3-node', 'conf', 'features/no-object-map', 'krbd/fsx/{ceph/ceph', 'ms_mode$/{crc}', 'ms_mode$/{legacy-rxbounce}', 'objectstore/bluestore-bitmap', 'randomized-striping-off}', 'randomized-striping-on}', 'striping/default/{msgr-failures/few', 'striping/fancy/{msgr-failures/few', 'tasks/fsx-3-client}']

Timeout 3h running clone.client.0/qa/workunits/rbd/concurrent.sh
1 jobs: ['7295906']
suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/secure', 'msgr-failures/many', 'tasks/rbd_concurrent}']

Failure: Command failed on smithi176 with status 91: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 1 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.1 image_client.1'
3 jobs: ['7295903', '7295730', '7295763']
suites intersection: ['clusters/3-node', 'conf', 'krbd/fsx/{ceph/ceph', 'objectstore/bluestore-bitmap', 'tasks/fsx-3-client}']
suites union: ['clusters/3-node', 'conf', 'features/no-object-map', 'features/object-map', 'krbd/fsx/{ceph/ceph', 'ms_mode$/{crc}', 'ms_mode$/{legacy-rxbounce}', 'ms_mode$/{secure}', 'objectstore/bluestore-bitmap', 'randomized-striping-off}', 'randomized-striping-on}', 'striping/default/{msgr-failures/few', 'striping/default/{msgr-failures/many', 'striping/fancy/{msgr-failures/few', 'tasks/fsx-3-client}']

Failure: Command failed on smithi203 with status 10: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude25slk62z -r -- '-g auto -g blockdev -x clone'"
2 jobs: ['7295712', '7295818']
suites intersection: ['conf', 'krbd/singleton/{bluestore-bitmap', 'tasks/rbd_xfstests}']
suites union: ['conf', 'krbd/singleton/{bluestore-bitmap', 'ms_mode$/{crc-rxbounce}', 'ms_mode$/{crc}', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_xfstests}']

Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major
1 jobs: ['7295714']
suites: ['clusters/separate-client', 'conf', 'kernels/pre-single-major', 'krbd/unmap/{ceph/ceph', 'tasks/unmap}']

Failure: Command failed on smithi114 with status 2: 'sudo dpkg -i /tmp/linux-image.deb'
1 jobs: ['7295804']
suites: ['clusters/fixed-3', 'conf', 'krbd/rbd/{bluestore-bitmap', 'ms_mode/legacy$/{legacy-rxbounce}', 'msgr-failures/few', 'tasks/rbd_workunit_suites_fsx}']