2022-03-15T13:00:23.836 INFO:root:teuthology version: 1.1.0-fbfc7b38 2022-03-15T13:00:23.837 INFO:teuthology.results:seed: '9922' 2022-03-15T13:19:58.768 INFO:root:teuthology version: 1.1.0-fbfc7b38 2022-03-15T13:19:58.784 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-15T14:11:02.761 INFO:teuthology.results:Tests finished! gathering results... 2022-03-15T14:11:04.269 INFO:scrape:Found 20 jobs 2022-03-15T14:11:14.152 INFO:scrape:Found 3 distinct failure reasons 2022-03-15T14:11:14.154 INFO:scrape:Failure: Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi120 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' 2022-03-15T14:11:14.155 INFO:scrape:12 jobs: ['6738388', '6738386', '6738391', '6738384', '6738397', '6738392', '6738394', '6738383', '6738398', '6738387', '6738395', '6738389'] 2022-03-15T14:11:14.156 INFO:scrape:suites intersection: ['cluster/3-nodes/{base/{install', 'extra/{rbd-mirror}', 'mirror', 'msgr-failures/few', 'rbd/mirror-thrash/{base/{openstack}', 'roles}', 'workloads/rbd-mirror-journal-workunit-multipeer}'] 2022-03-15T14:11:14.156 INFO:scrape:suites union: ['cluster/3-nodes/{base/{install', 'extra/{rbd-mirror}', 'mirror', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'policy/none', 'policy/simple', 'rbd/mirror-thrash/{base/{openstack}', 'roles}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{ubuntu_latest}}', 'workloads/rbd-mirror-journal-workunit-multipeer}'] 2022-03-15T14:11:14.157 INFO:scrape: 2022-03-15T14:11:14.158 INFO:scrape:Crash: Found coredumps on ubuntu@smithi173.front.sepia.ceph.com 2022-03-15T14:11:14.159 INFO:scrape:ceph version 17.0.0-11089-gf0baaf36 (f0baaf3694eacaeddea5f2758fc58361770a25c5) quincy (dev) 1: /lib64/libpthread.so.0(+0x12c20) [0x7f806f57ac20] 2: gsignal() 3: abort() 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7f8070148262] 5: /usr/lib64/ceph/libceph-common.so.2(+0x284425) [0x7f8070148425] 6: (rbd::mirror::NamespaceReplayer::init_remote_pool_watcher(rbd::mirror::Peer&, Context*)+0x40c) [0x5627c1e3af0c] 7: (rbd::mirror::NamespaceReplayer::init_remote_pool_watchers(Context*)+0x299) [0x5627c1e3e9b9] 8: (rbd::mirror::NamespaceReplayer::handle_init_local_pool_watcher(int, Context*)+0x51) [0x5627c1e3ef71] 9: (Context::complete(int)+0xd) [0x5627c1dc9fdd] 10: (boost::asio::detail::completion_handler, 0u> >::do_complete(void*, boost::asio::detail::scheduler_operation*, boost::system::error_code const&, unsigned long)+0x5a) [0x5627c1dca46a] 11: (boost::asio::detail::strand_service::do_complete(void*, boost::asio::detail::scheduler_operation*, boost::system::error_code const&, unsigned long)+0x85) [0x5627c1f9bad5] 12: /lib64/librados.so.2(+0xc8ee8) [0x7f80716b1ee8] 13: /lib64/librados.so.2(+0xce28a) [0x7f80716b728a] 14: /lib64/libstdc++.so.6(+0xc2ba3) [0x7f806e389ba3] 15: /lib64/libpthread.so.0(+0x817f) [0x7f806f57017f] 16: clone() 2022-03-15T14:11:14.160 INFO:scrape:1 jobs: ['6738381'] 2022-03-15T14:11:14.161 INFO:scrape:suites: ['cluster/3-nodes/{base/{install', 'extra/{rbd-mirror}', 'mirror', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'policy/simple', 'rbd/mirror-thrash/{base/{openstack}', 'roles}', 'supported-random-distro$/{centos_8}}', 'workloads/rbd-mirror-journal-workunit-multipeer}'] 2022-03-15T14:11:14.162 INFO:scrape: 2022-03-15T14:11:14.162 INFO:scrape:Failure: Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi195 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh' 2022-03-15T14:11:14.163 INFO:scrape:6 jobs: ['6738399', '6738393', '6738380', '6738385', '6738396', '6738390'] 2022-03-15T14:11:14.163 INFO:scrape:suites intersection: ['cluster/3-nodes/{base/{install', 'extra/{mirror-extra}', 'mirror', 'msgr-failures/few', 'rbd/mirror/{base/{openstack}', 'roles}', 'workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}'] 2022-03-15T14:11:14.164 INFO:scrape:suites union: ['cluster/3-nodes/{base/{install', 'extra/{mirror-extra}', 'mirror', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'rbd/mirror/{base/{openstack}', 'roles}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{ubuntu_latest}}', 'workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}'] 2022-03-15T14:11:14.164 INFO:scrape: 2022-03-15T14:11:14.166 INFO:teuthology.results:Sending results to arthur.outhenin-chalandre@cern.ch: Test Run: mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/ failed: 19 dead: 0 running: 0 waiting: 0 queued: 0 passed: 1 Fail ================================================================= [6738380] rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:40:01 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738380/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738380/ sentry: https://sentry.ceph.com/organizations/ceph/?query=138ef3586dda46ef9afe16b3ff05fc79 Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi153 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 USE_CLUSTER3=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh' [6738381] rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:55:59 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738381/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738381/ Found coredumps on ubuntu@smithi173.front.sepia.ceph.com [6738383] rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-zstd policy/none supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:21:13 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738383/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738383/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b84d4126e23f4df08fe81de4ac3066a9 Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi131 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' [6738384] rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:40:01 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738384/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738384/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc23c24c94564d5e86111ab11b3761da Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi179 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' [6738385] rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:39:29 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738385/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738385/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ef9c3d14c23046aebbb813e0613f717f Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi101 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 USE_CLUSTER3=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh' [6738386] rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-bitmap policy/none supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:40:06 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738386/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738386/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c8bb5c3c89af4aceb414cbf5c2f1d8d9 Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi123 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' [6738387] rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-stupid policy/simple supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:39:57 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738387/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738387/ sentry: https://sentry.ceph.com/organizations/ceph/?query=32decff640b249759a1305a0ed92b06a Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi169 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' [6738388] rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-hybrid policy/none supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:45:47 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738388/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738388/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a9c3c205738c47c6a599976f06b6e764 Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi120 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' [6738389] rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:39:29 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738389/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738389/ sentry: https://sentry.ceph.com/organizations/ceph/?query=18e04886ab3e435cb4e0da95d4b2134b Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi196 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' [6738390] rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:20:28 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738390/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738390/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f1477441f5094ab381da47c89358e502 Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi087 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 USE_CLUSTER3=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh' [6738391] rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:39:24 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738391/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738391/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aa91fed62ae748bd8f25285b86783f20 Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi139 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' [6738392] rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/filestore-xfs policy/simple supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:47:02 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738392/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738392/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ef3f5e2f4bed46dcbd5f348324e32ee9 Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi186 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' [6738393] rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:25:42 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738393/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738393/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c89f73c455bf4b7eb36c8e2dfeb0b76f Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi167 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 USE_CLUSTER3=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh' [6738394] rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:40:06 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738394/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738394/ sentry: https://sentry.ceph.com/organizations/ceph/?query=311c7ff9f00f4baaaf25e52a6e5a00f5 Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi174 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' [6738395] rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:41:00 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738395/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738395/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5a54bcc1d4c14700b22c0ef10db228d9 Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi137 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' [6738396] rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:39:38 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738396/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738396/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9ebc51bbe6024ea9abb4c01d2067fff6 Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi197 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 USE_CLUSTER3=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh' [6738397] rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-snappy policy/none supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:20:18 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738397/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738397/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41c8f5f2bcea484ebbea06a3d04c1593 Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi163 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' [6738398] rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-hybrid policy/simple supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:41:13 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738398/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738398/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4cf5f80d9ad84ea1b8932227632f444e Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi164 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' [6738399] rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:39:56 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738399/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738399/ sentry: https://sentry.ceph.com/organizations/ceph/?query=85971dfe33be4b9996ac21204ffe1284 Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi195 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7052254be1bbab4915ae3b739898be64fbbb9c48 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 USE_CLUSTER3=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh' Pass ================================================================= [6738382] rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8}} time: 00:27:24 info: http://pulpito.ceph.com/mrfreezeex-2022-03-15_12:44:59-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6738382/