Found 21 jobs
Found 4 distinct failure reasons
Failure: "2022-04-09T22:37:43.063303+0000 mon.a (mon.0) 100 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log
1 jobs: ['6784304']
suites: ['cluster/3-nodes/{base/{install', 'extra/{rbd-mirror}', 'mirror', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'policy/simple', 'rbd/mirror-thrash/{base/{openstack}', 'roles}', 'supported-random-distro$/{ubuntu_latest}}', 'workloads/rbd-mirror-journal-workunit-multipeer}']

Timeout 120 running ceph --cluster cluster3 pg dump --format=json
1 jobs: ['6784315']
suites: ['cluster/3-nodes/{base/{install', 'extra/{rbd-mirror}', 'mirror', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'policy/simple', 'rbd/mirror-thrash/{base/{openstack}', 'roles}', 'supported-random-distro$/{ubuntu_latest}}', 'workloads/rbd-mirror-journal-workunit-multipeer}']

Crash: Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi171 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9b3739e792ef182b79445b926c7b7da461c05f52 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'
ceph version 17.0.0-11492-g9b3739e7 (9b3739e792ef182b79445b926c7b7da461c05f52) quincy (dev)
 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x143c0) [0x7f5f0bcf53c0]
 2: gsignal()
 3: abort()
 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b7) [0x7f5f0c257834]
 5: /usr/lib/ceph/libceph-common.so.2(+0x27b9de) [0x7f5f0c2579de]
 6: (rbd::mirror::NamespaceReplayer<librbd::ImageCtx>::init_remote_pool_watcher(rbd::mirror::Peer<librbd::ImageCtx>&, Context*)+0x43f) [0x5615bc92bb5f]
 7: (rbd::mirror::NamespaceReplayer<librbd::ImageCtx>::init_remote_pool_watchers(Context*)+0x1e0) [0x5615bc9307f0]
 8: (rbd::mirror::NamespaceReplayer<librbd::ImageCtx>::handle_init_local_pool_watcher(int, Context*)+0x51) [0x5615bc930ef1]
 9: (Context::complete(int)+0xd) [0x5615bc8bb2cd]
 10: (boost::asio::detail::completion_handler<librbd::asio::ContextWQ::queue(Context*, int)::{lambda()#1}, boost::asio::io_context::basic_executor_type<std::allocator<void>, 0u> >::do_complete(void*, boost::asio::detail::scheduler_operation*, boost::system::error_code const&, unsigned long)+0x5a) [0x5615bc8bb76a]
 11: (boost::asio::detail::strand_service::do_complete(void*, boost::asio::detail::scheduler_operation*, boost::system::error_code const&, unsigned long)+0x85) [0x5615bca4c1a5]
 12: /lib/librados.so.2(+0xdf248) [0x7f5f0cf53248]
 13: /lib/librados.so.2(+0xe4eea) [0x7f5f0cf58eea]
 14: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xd6de4) [0x7f5f0bbcfde4]
 15: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f5f0bce9609]
 16: clone()
1 jobs: ['6784308']
suites: ['cluster/3-nodes/{base/{install', 'extra/{rbd-mirror}', 'mirror', 'msgr-failures/few', 'objectstore/filestore-xfs', 'policy/simple', 'rbd/mirror-thrash/{base/{openstack}', 'roles}', 'supported-random-distro$/{ubuntu_latest}}', 'workloads/rbd-mirror-journal-workunit-multipeer}']

Failure: Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi145 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9b3739e792ef182b79445b926c7b7da461c05f52 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'
4 jobs: ['6784301', '6784303', '6784298', '6784311']
suites intersection: ['cluster/3-nodes/{base/{install', 'extra/{rbd-mirror}', 'mirror', 'msgr-failures/few', 'rbd/mirror-thrash/{base/{openstack}', 'roles}', 'supported-random-distro$/{ubuntu_latest}}', 'workloads/rbd-mirror-journal-workunit-multipeer}']
suites union: ['cluster/3-nodes/{base/{install', 'extra/{rbd-mirror}', 'mirror', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zstd', 'objectstore/filestore-xfs', 'policy/none', 'policy/simple', 'rbd/mirror-thrash/{base/{openstack}', 'roles}', 'supported-random-distro$/{ubuntu_latest}}', 'workloads/rbd-mirror-journal-workunit-multipeer}']