Found 191 jobs Found 9 distinct failure reasons Failure: "2026-02-19T20:55:22.246561+0000 osd.5 (osd.5) 3 : cluster [ERR] osd.5 found snap mapper error on pg 2.2 oid 2:5a5d7a92:::rbd_data.1165e9bffc04.000000000000009a:21 snaps in mapper: {}, oi: {1e, 1f, 20, 21} ...repaired" in cluster log 1 jobs: ['59668'] suites: ['cluster/{fixed-3}', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'rbd/device/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/diff-continuous-nbd}'] Dead: b'2026-02-20T02:13:36.355 DEBUG:teuthology.exit:Finished running handlers' ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None) 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fedb2232520] 2: /lib/x86_64-linux-gnu/libc.so.6(+0x91117) [0x7fedb2281117] 3: /lib/x86_64-linux-gnu/libc.so.6(+0x96624) [0x7fedb2286624] 4: (Thread::join(void**)+0x33) [0x7fedb2e61903] 5: (rbd::mirror::PoolReplayer::shut_down()+0x2da) [0x5635e825c1fa] 6: (rbd::mirror::PoolReplayer::~PoolReplayer()+0x10) [0x5635e825c300] 7: rbd-mirror(+0x8275a8) [0x5635e875c5a8] 8: (rbd::mirror::Mirror::~Mirror()+0xae) [0x5635e8253e0e] 9: main() 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fedb2219d90] 11: __libc_start_main() 12: _start() 2 jobs: ['59625', '59505'] suites intersection: ['clients/mirror', 'cluster/{2-node}', 'conf/{disable-pool-app}', 'msgr-failures/few', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-fsx-workunit}'] suites union: ['clients/mirror', 'cluster/{2-node}', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-fsx-workunit}'] Failure: Command failed (workunit test rbd/diff_continuous.sh) on trial094 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=802bf111cd55e57f5842153d7ba2b8b964aa818a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_DEVICE_TYPE=krbd adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh' 1 jobs: ['59574'] suites: ['cluster/{fixed-3}', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'rbd/device/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/diff-continuous-krbd}'] Failure: Command failed on trial129 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' 2 jobs: ['59550', '59651'] suites intersection: ['2-cluster/{fix-2}', '4-cache-path', '6-cache-size/5G', '7-workloads/qemu_xfstests', 'conf/{disable-pool-app}}', 'rbd/pwl-cache/tmpfs/{1-base/install'] suites union: ['2-cluster/{fix-2}', '3-supported-random-distro$/{centos_latest}', '3-supported-random-distro$/{ubuntu_latest}', '4-cache-path', '5-cache-mode/rwl', '5-cache-mode/ssd', '6-cache-size/5G', '7-workloads/qemu_xfstests', 'conf/{disable-pool-app}}', 'rbd/pwl-cache/tmpfs/{1-base/install'] Failure: "2026-02-19T19:52:43.071006+0000 mon.a (mon.0) 313 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log 1 jobs: ['59576'] suites: ['cluster/{fixed-3}', 'conf/{disable-pool-app}', 'rbd/iscsi/{base/install', 'supported-container-hosts$/{ubuntu_22.04}', 'workloads/cephadm_iscsi}'] Failure: Command failed (workunit test rbd/qemu-iotests.sh) on trial050 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=802bf111cd55e57f5842153d7ba2b8b964aa818a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu-iotests.sh' 2 jobs: ['59661', '59646'] suites intersection: ['conf/{disable-pool-app}', 'supported-random-distro$/{ubuntu_latest}}'] suites union: ['conf/{disable-pool-app}', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'rbd/singleton/{all/qemu-iotests-no-cache', 'rbd/singleton/{all/qemu-iotests-writeback', 'supported-random-distro$/{ubuntu_latest}}'] Failure: Command failed (workunit test rbd/rbd_mirror_stress.sh) on trial163 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=802bf111cd55e57f5842153d7ba2b8b964aa818a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=4 RBD_MIRROR_MODE=snapshot RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh' 1 jobs: ['59587'] suites: ['clients/mirror', 'cluster/{2-node}', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_latest}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}'] Crash: Command failed (workunit test rbd/merge_diff.sh) on trial155 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=802bf111cd55e57f5842153d7ba2b8b964aa818a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/merge_diff.sh' ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - RelWithDebInfo) 1: /lib64/libc.so.6(+0x3fc30) [0x7fe44fa3fc30] 2: free() 3: /lib64/libfuse3.so.3(+0x1b3ce) [0x7fe451a963ce] 4: /lib64/libfuse3.so.3(+0x1b579) [0x7fe451a96579] 5: fuse_opt_parse() 6: main() 7: /lib64/libc.so.6(+0x2a610) [0x7fe44fa2a610] 8: __libc_start_main() 9: _start() 1 jobs: ['59616'] suites: ['conf/{disable-pool-app}', 'objectstore/bluestore-stupid', 'rbd/singleton/{all/merge_diff', 'supported-random-distro$/{centos_latest}}'] Failure: Command failed on trial183 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 802bf111cd55e57f5842153d7ba2b8b964aa818a' 1 jobs: ['59555'] suites: ['conf/{disable-pool-app}', 'objectstore/bluestore-bitmap', 'rbd/singleton/{all/read-flags-no-cache', 'supported-random-distro$/{centos_latest}}']