2022-03-03T13:24:23.899 INFO:root:teuthology version: 1.1.0-eeaeee38
2022-03-03T13:24:23.901 INFO:teuthology.results:seed: '1717'
2022-03-03T20:02:20.819 INFO:root:teuthology version: 1.1.0-eeaeee38
2022-03-03T20:02:20.854 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-03-03T21:06:26.119 INFO:teuthology.results:Tests finished! gathering results...
2022-03-03T21:06:39.883 INFO:scrape:Found 178 jobs
2022-03-03T21:06:46.205 INFO:scrape:Found 6 distinct failure reasons
2022-03-03T21:06:46.206 INFO:scrape:Failure: 
2022-03-03T21:06:46.206 INFO:scrape:19 jobs: ['6718189', '6718071', '6718144', '6718152', '6718099', '6718123', '6718178', '6718080', '6718032', '6718042', '6718083', '6718045', '6718130', '6718090', '6718168', '6718164', '6718119', '6718107', '6718140']
2022-03-03T21:06:46.207 INFO:scrape:suites intersection: ['cluster/{2-node', 'msgr-failures/few', 'openstack}']
2022-03-03T21:06:46.208 INFO:scrape:suites union: ['clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'policy/none', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-journal-workunit-multipeer}', 'workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}']
2022-03-03T21:06:46.208 INFO:scrape:
2022-03-03T21:06:46.208 INFO:scrape:Failure: "2022-03-03T13:53:08.064213+0000 mon.a (mon.0) 200 : cluster [WRN] Health check failed: Degraded data redundancy: 1/716 objects degraded (0.140%), 1 pg degraded (PG_DEGRADED)" in cluster log
2022-03-03T21:06:46.209 INFO:scrape:2 jobs: ['6718040', '6718153']
2022-03-03T21:06:46.209 INFO:scrape:suites intersection: ['cluster/{2-node', 'msgr-failures/few', 'openstack}']
2022-03-03T21:06:46.210 INFO:scrape:suites union: ['clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-fsx-workunit}', 'workloads/rbd-mirror-workunit-config-key}']
2022-03-03T21:06:46.210 INFO:scrape:
2022-03-03T21:06:46.211 INFO:scrape:Crash: "2022-03-03T20:21:56.479716+0000 mon.a (mon.0) 1726 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log
2022-03-03T21:06:46.211 INFO:scrape:ceph version 17.0.0-10956-g501cde21 (501cde21dbba697e001f934aba397a4bf89fefdd) quincy (dev)
 1: /lib64/libpthread.so.0(+0x12c20) [0x7fa1244edc20]
 2: gsignal()
 3: abort()
 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x1b8) [0x55bf60c5592e]
 5: (KernelDevice::_aio_thread()+0xf9e) [0x55bf618a3efe]
 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55bf618b1731]
 7: /lib64/libpthread.so.0(+0x817f) [0x7fa1244e317f]
 8: clone()
2022-03-03T21:06:46.212 INFO:scrape:1 jobs: ['6718156']
2022-03-03T21:06:46.212 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'openstack}', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}']
2022-03-03T21:06:46.213 INFO:scrape:
2022-03-03T21:06:46.213 INFO:scrape:Failure: Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi165 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'
2022-03-03T21:06:46.214 INFO:scrape:2 jobs: ['6718050', '6718030']
2022-03-03T21:06:46.214 INFO:scrape:suites intersection: ['clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'openstack}', 'rbd/mirror/{base/install', 'workloads/rbd-mirror-snapshot-workunit-minimum}']
2022-03-03T21:06:46.215 INFO:scrape:suites union: ['clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-stupid', 'openstack}', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-workunit-minimum}']
2022-03-03T21:06:46.215 INFO:scrape:
2022-03-03T21:06:46.216 INFO:scrape:Failure: Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi061 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh'
2022-03-03T21:06:46.216 INFO:scrape:3 jobs: ['6718036', '6718082', '6718084']
2022-03-03T21:06:46.217 INFO:scrape:suites intersection: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}']
2022-03-03T21:06:46.217 INFO:scrape:suites union: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zlib', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}', 'workloads/rbd-mirror-snapshot-stress-workunit-minimum}']
2022-03-03T21:06:46.218 INFO:scrape:
2022-03-03T21:06:46.218 INFO:scrape:Failure: Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi026 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'
2022-03-03T21:06:46.218 INFO:scrape:1 jobs: ['6718033']
2022-03-03T21:06:46.219 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd-mirror-journal-workunit}']
2022-03-03T21:06:46.219 INFO:scrape:
2022-03-03T21:06:46.228 INFO:teuthology.results:Sending results to arthur.outhenin-chalandre@cern.ch: Test Run: mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/
failed:  28
dead:    0
running: 0
waiting: 0
queued:  0
passed:  150


Fail
=================================================================
[6718030]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum}
-----------------------------------------------------------------
time:   00:16:47
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718030/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718030/
sentry: https://sentry.ceph.com/organizations/ceph/?query=06f84587502e479598edfe2f36313d5d

    Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi135 with
    status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\'
    RBD_IMAGE_FEATURES=layering RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4
    RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

[6718032]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:07:10
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718032/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718032/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2b9f6018ed234747b7a71af749c32199

[6718033]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit}
-----------------------------------------------------------------
time:   00:22:38
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718033/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718033/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1ac0e638d7304e46b18d5bfd5be683c4

    Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi026 with
    status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\'
    RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1
    RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

[6718036]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
-----------------------------------------------------------------
time:   00:15:15
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718036/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718036/
sentry: https://sentry.ceph.com/organizations/ceph/?query=af6c8ff5669d40f8a7955b2340dea2ef

    Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi061 with
    status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\'
    MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image
    RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff
    RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1
    RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clo
    ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh'

[6718040]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
-----------------------------------------------------------------
time:   00:42:18
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718040/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718040/

    "2022-03-03T13:53:08.064213+0000 mon.a (mon.0) 200 : cluster [WRN] Health
    check failed: Degraded data redundancy: 1/716 objects degraded (0.140%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6718042]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:10:12
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718042/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718042/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f0b6b798e91148739a123223541e905b

[6718045]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}
-----------------------------------------------------------------
time:   00:09:33
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718045/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718045/
sentry: https://sentry.ceph.com/organizations/ceph/?query=612fe6878b654c6cbd5903b73a8f04f8

[6718050]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum}
-----------------------------------------------------------------
time:   00:14:16
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718050/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718050/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c6a280a5ec184cbebadd13d41b3d932e

    Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi165 with
    status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\'
    RBD_IMAGE_FEATURES=layering RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4
    RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

[6718071]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:07:13
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718071/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718071/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b3fc3fad769445638d7fab194883fb1f

[6718080]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:07:22
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718080/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718080/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a35e29b95ccf46b4ada20cfb639d473a

[6718082]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
-----------------------------------------------------------------
time:   00:15:33
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718082/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718082/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1e9c1365ec1541cfa0647db2a79d182e

    Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi165 with
    status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\'
    MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image
    RBD_IMAGE_FEATURES=layering,exclusive-lock RBD_MIRROR_INSTANCES=4
    RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-
    ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /ho
    me/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror
    _stress.sh'

[6718083]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}
-----------------------------------------------------------------
time:   00:07:25
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718083/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718083/
sentry: https://sentry.ceph.com/organizations/ceph/?query=36f05c59d08d4d659587a2a506b5ed3c

[6718084]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
-----------------------------------------------------------------
time:   00:13:11
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718084/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718084/
sentry: https://sentry.ceph.com/organizations/ceph/?query=919e9a2420ba43338a855e297229904f

    Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi110 with
    status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\'
    MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image
    RBD_IMAGE_FEATURES=layering RBD_MIRROR_INSTANCES=4
    RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-
    ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /ho
    me/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror
    _stress.sh'

[6718090]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:07:51
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718090/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718090/
sentry: https://sentry.ceph.com/organizations/ceph/?query=44e55af62b5643b893c2a1b30274ee5c

[6718099]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:10:12
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718099/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718099/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e2d1b9b7589d4295842b5c847377be13

[6718107]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:08:01
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718107/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718107/
sentry: https://sentry.ceph.com/organizations/ceph/?query=777111bd0cd24b31ac2c504f40916cd4

[6718119]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:07:52
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718119/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718119/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d7214a9a4e054f45b3a781ba40a39141

[6718123]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}
-----------------------------------------------------------------
time:   00:10:38
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718123/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718123/
sentry: https://sentry.ceph.com/organizations/ceph/?query=24ecff97238743738055b422195e2408

[6718130]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:10:27
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718130/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718130/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c7591451386d4f1fa23199a603670667

[6718140]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:10:11
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718140/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718140/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d404c462893a4e7ca9f6df2ff6015050

[6718144]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}
-----------------------------------------------------------------
time:   00:10:09
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718144/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718144/
sentry: https://sentry.ceph.com/organizations/ceph/?query=be20abd7018548938a9e7195db76ba3c

[6718152]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:10:03
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718152/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718152/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3e9e7fd760ce457097051b60652329d4

[6718153]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key}
-----------------------------------------------------------------
time:   00:30:14
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718153/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718153/

    "2022-03-03T19:43:03.361113+0000 mon.a (mon.0) 195 : cluster [WRN] Health
    check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in
    cluster log

[6718156]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
-----------------------------------------------------------------
time:   00:56:08
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718156/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718156/

    "2022-03-03T20:21:56.479716+0000 mon.a (mon.0) 1726 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6718164]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:10:00
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718164/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718164/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5abd7eeeba2e49da89a08a0f50282bfb

[6718168]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}
-----------------------------------------------------------------
time:   00:07:33
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718168/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718168/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3e9161a675ff49ff9ceaa8721830a977

[6718178]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:09:41
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718178/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718178/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eebf625dc9c84fac88b62540bfaf047d

[6718189]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:07:30
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718189/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718189/
sentry: https://sentry.ceph.com/organizations/ceph/?query=12897e7922c64a72bc62065cfd4570bc



Pass
=================================================================
[6718024] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit}
time:   00:15:59
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718024/

[6718025] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:34:39
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718025/

[6718026] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:11:16
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718026/

[6718027] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit}
time:   00:43:46
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718027/

[6718028] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:50:05
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718028/

[6718029] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:48:14
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718029/

[6718031] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit}
time:   00:56:24
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718031/

[6718034] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus}
time:   00:28:50
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718034/

[6718035] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:48:39
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718035/

[6718037] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/rbd_mirror}
time:   00:56:56
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718037/

[6718038] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple}
time:   00:31:24
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718038/

[6718039] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:49:18
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718039/

[6718041] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit}
time:   00:11:57
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718041/

[6718043] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock}
time:   00:23:37
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718043/

[6718044] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:48:09
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718044/

[6718046] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff}
time:   00:22:48
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718046/

[6718047] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:47:22
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718047/

[6718048] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling}
time:   00:19:26
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718048/

[6718049] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:36:31
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718049/

[6718051] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit}
time:   00:56:29
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718051/

[6718052] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zlib openstack supported-random-distro$/{centos_8}}
time:   00:45:41
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718052/

[6718053] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}
time:   00:52:41
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718053/

[6718054] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit}
time:   00:35:09
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718054/

[6718055] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus}
time:   00:30:29
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718055/

[6718056] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:46:04
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718056/

[6718057] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none}
time:   00:28:48
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718057/

[6718058] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/rbd_mirror}
time:   00:56:22
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718058/

[6718059] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:47:25
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718059/

[6718060] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit}
time:   00:59:28
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718060/

[6718061] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit}
time:   00:11:30
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718061/

[6718062] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:11:36
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718062/

[6718063] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock}
time:   00:22:22
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718063/

[6718064] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:48:02
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718064/

[6718065] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff}
time:   00:21:11
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718065/

[6718066] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:47:45
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718066/

[6718067] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling}
time:   00:21:03
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718067/

[6718068] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:39:17
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718068/

[6718069] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit}
time:   00:55:59
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718069/

[6718070] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}
time:   00:52:36
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718070/

[6718072] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key}
time:   00:31:14
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718072/

[6718073] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus}
time:   00:28:04
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718073/

[6718074] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none}
time:   00:28:58
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718074/

[6718075] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:46:51
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718075/

[6718076] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/rbd_mirror}
time:   00:58:02
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718076/

[6718077] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple}
time:   00:29:35
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718077/

[6718078] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:49:07
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718078/

[6718079] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit}
time:   00:14:23
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718079/

[6718081] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit}
time:   00:40:06
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718081/

[6718085] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling}
time:   00:20:07
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718085/

[6718086] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum}
time:   00:20:17
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718086/

[6718087] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit}
time:   00:56:01
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718087/

[6718088] rbd/singleton/{all/rbd_mirror objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}}
time:   00:43:48
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718088/

[6718089] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}
time:   00:53:46
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718089/

[6718091] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key}
time:   00:29:08
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718091/

[6718092] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:49:05
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718092/

[6718093] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:48:07
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718093/

[6718094] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/rbd_mirror}
time:   00:56:00
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718094/

[6718095] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple}
time:   00:28:59
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718095/

[6718096] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:49:46
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718096/

[6718097] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit}
time:   00:16:55
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718097/

[6718098] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:36:57
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718098/

[6718100] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:09:24
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718100/

[6718101] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:50:08
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718101/

[6718102] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff}
time:   00:20:58
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718102/

[6718103] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:48:52
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718103/

[6718104] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum}
time:   00:22:39
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718104/

[6718105] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit}
time:   00:55:11
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718105/

[6718106] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}
time:   00:53:11
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718106/

[6718108] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key}
time:   00:28:10
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718108/

[6718109] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus}
time:   00:29:59
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718109/

[6718110] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:47:59
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718110/

[6718111] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none}
time:   00:30:41
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718111/

[6718112] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:49:38
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718112/

[6718113] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/rbd_mirror}
time:   00:55:37
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718113/

[6718114] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple}
time:   00:29:21
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718114/

[6718115] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit}
time:   00:16:02
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718115/

[6718116] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:43:47
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718116/

[6718117] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit}
time:   01:01:25
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718117/

[6718118] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit}
time:   00:11:49
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718118/

[6718120] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:11:40
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718120/

[6718121] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit}
time:   00:38:39
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718121/

[6718122] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock}
time:   00:19:41
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718122/

[6718124] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff}
time:   00:22:07
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718124/

[6718125] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:47:42
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718125/

[6718126] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling}
time:   00:19:23
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718126/

[6718127] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:42:15
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718127/

[6718128] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum}
time:   00:19:46
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718128/

[6718129] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}
time:   00:53:13
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718129/

[6718131] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key}
time:   00:29:26
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718131/

[6718132] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit}
time:   00:35:30
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718132/

[6718133] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:47:48
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718133/

[6718134] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:47:10
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718134/

[6718135] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/rbd_mirror}
time:   00:57:01
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718135/

[6718136] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:49:11
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718136/

[6718137] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit}
time:   00:14:37
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718137/

[6718138] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:39:47
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718138/

[6718139] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit}
time:   00:08:42
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718139/

[6718141] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:08:08
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718141/

[6718142] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock}
time:   00:21:53
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718142/

[6718143] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:48:45
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718143/

[6718145] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:51:17
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718145/

[6718146] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff}
time:   00:22:52
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718146/

[6718147] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:46:29
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718147/

[6718148] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum}
time:   00:19:47
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718148/

[6718149] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit}
time:   00:54:59
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718149/

[6718150] rbd/singleton/{all/rbd_mirror objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}}
time:   00:45:39
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718150/

[6718151] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}
time:   00:52:40
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718151/

[6718154] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit}
time:   00:35:22
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718154/

[6718155] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus}
time:   00:31:21
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718155/

[6718157] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/rbd_mirror}
time:   00:55:41
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718157/

[6718158] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple}
time:   00:29:52
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718158/

[6718159] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:49:59
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718159/

[6718160] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit}
time:   00:16:30
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718160/

[6718161] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:38:55
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718161/

[6718162] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit}
time:   00:55:41
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718162/

[6718163] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit}
time:   00:08:38
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718163/

[6718165] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:08:53
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718165/

[6718166] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit}
time:   00:38:54
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718166/

[6718167] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock}
time:   00:22:35
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718167/

[6718169] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:47:27
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718169/

[6718170] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff}
time:   00:22:58
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718170/

[6718171] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:48:53
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718171/

[6718172] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling}
time:   00:20:13
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718172/

[6718173] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:37:38
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718173/

[6718174] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum}
time:   00:20:10
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718174/

[6718175] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit}
time:   00:55:33
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718175/

[6718176] rbd/singleton/{all/rbd_mirror objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}}
time:   00:45:51
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718176/

[6718177] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}
time:   00:51:40
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718177/

[6718179] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus}
time:   00:30:03
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718179/

[6718180] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:49:16
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718180/

[6718181] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none}
time:   00:29:13
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718181/

[6718182] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror}
time:   00:56:11
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718182/

[6718183] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple}
time:   00:29:50
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718183/

[6718184] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:51:56
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718184/

[6718185] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit}
time:   00:17:02
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718185/

[6718186] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:42:06
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718186/

[6718187] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit}
time:   00:58:34
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718187/

[6718188] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit}
time:   00:11:10
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718188/

[6718190] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit}
time:   00:41:47
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718190/

[6718191] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock}
time:   00:19:13
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718191/

[6718192] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:48:13
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718192/

[6718193] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum}
time:   00:19:48
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718193/

[6718194] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit}
time:   00:55:11
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718194/

[6718195] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}}
time:   00:45:48
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718195/

[6718196] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key}
time:   00:28:45
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718196/

[6718197] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:50:04
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718197/

[6718198] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none}
time:   00:27:58
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718198/

[6718199] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:47:28
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718199/

[6718200] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/rbd_mirror}
time:   00:56:24
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718200/

[6718201] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:51:32
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:20:43-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718201/