2022-03-04T17:55:55.997 INFO:root:teuthology version: 1.1.0-eeaeee38
2022-03-04T17:55:55.998 INFO:teuthology.results:seed: '8663'
2022-03-04T20:08:51.959 INFO:root:teuthology version: 1.1.0-eeaeee38
2022-03-04T20:08:51.995 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-03-04T21:12:57.366 INFO:teuthology.results:Tests finished! gathering results...
2022-03-04T21:13:10.245 INFO:scrape:Found 167 jobs
2022-03-04T21:13:15.564 INFO:scrape:Found 6 distinct failure reasons
2022-03-04T21:13:15.566 INFO:scrape:Failure: Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi103 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4c550ea9cebf70f679392719ef0e8ec0d2f72919 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'
2022-03-04T21:13:15.566 INFO:scrape:2 jobs: ['6720416', '6720464']
2022-03-04T21:13:15.567 INFO:scrape:suites intersection: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'openstack}', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'workloads/rbd-mirror-journal-workunit}']
2022-03-04T21:13:15.567 INFO:scrape:suites union: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'openstack}', 'policy/none', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-journal-workunit}']
2022-03-04T21:13:15.568 INFO:scrape:
2022-03-04T21:13:15.568 INFO:scrape:Failure: 
2022-03-04T21:13:15.569 INFO:scrape:17 jobs: ['6720515', '6720531', '6720434', '6720418', '6720546', '6720471', '6720469', '6720424', '6720414', '6720541', '6720526', '6720572', '6720454', '6720497', '6720445', '6720488', '6720477']
2022-03-04T21:13:15.569 INFO:scrape:suites intersection: ['cluster/{2-node', 'msgr-failures/few', 'openstack}']
2022-03-04T21:13:15.570 INFO:scrape:suites union: ['clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'policy/none', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-journal-workunit-multipeer}', 'workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}']
2022-03-04T21:13:15.570 INFO:scrape:
2022-03-04T21:13:15.571 INFO:scrape:Failure: "2022-03-04T19:24:11.995023+0000 mon.a (mon.0) 99 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log
2022-03-04T21:13:15.571 INFO:scrape:4 jobs: ['6720485', '6720432', '6720567', '6720510']
2022-03-04T21:13:15.572 INFO:scrape:suites intersection: ['cluster/{2-node', 'msgr-failures/few', 'openstack}']
2022-03-04T21:13:15.572 INFO:scrape:suites union: ['clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-fsx-workunit}', 'workloads/rbd-mirror-snapshot-bootstrap-workunit}', 'workloads/rbd-mirror-snapshot-stress-workunit-minimum}', 'workloads/rbd-mirror-snapshot-workunit-fast-diff}']
2022-03-04T21:13:15.573 INFO:scrape:
2022-03-04T21:13:15.573 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds
2022-03-04T21:13:15.573 INFO:scrape:3 jobs: ['6720417', '6720444', '6720449']
2022-03-04T21:13:15.574 INFO:scrape:suites intersection: ['cluster/{2-node', 'msgr-failures/few', 'openstack}']
2022-03-04T21:13:15.574 INFO:scrape:suites union: ['clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-stupid', 'openstack}', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}', 'workloads/rbd-mirror-snapshot-workunit-exclusive-lock}', 'workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}']
2022-03-04T21:13:15.575 INFO:scrape:
2022-03-04T21:13:15.575 INFO:scrape:Failure: Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi134 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4c550ea9cebf70f679392719ef0e8ec0d2f72919 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'
2022-03-04T21:13:15.576 INFO:scrape:1 jobs: ['6720441']
2022-03-04T21:13:15.576 INFO:scrape:suites: ['clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rbd/mirror/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-workunit-minimum}']
2022-03-04T21:13:15.577 INFO:scrape:
2022-03-04T21:13:15.577 INFO:scrape:Failure: {'smithi002.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': True, 'force_apt_get': False, 'install_recommends': None, 'name': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python-ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'], 'only_upgrade': False, 'package': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python-ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'], 'policy_rc_d': None, 'purge': False, 'state': 'absent', 'update_cache': None, 'upgrade': None}}, 'msg': "'apt-get remove 'librbd1' 'librados2'' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7289 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n", 'rc': 100, 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7289 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7289 (apt-get)', 'E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?'], 'stdout': '', 'stdout_lines': []}}
2022-03-04T21:13:15.577 INFO:scrape:1 jobs: ['6720459']
2022-03-04T21:13:15.578 INFO:scrape:suites: ['clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rbd/mirror/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-workunit-fast-diff}']
2022-03-04T21:13:15.578 INFO:scrape:
2022-03-04T21:13:15.586 INFO:teuthology.results:Sending results to arthur.outhenin-chalandre@cern.ch: Test Run: mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/
failed:  27
dead:    1
running: 0
waiting: 0
queued:  0
passed:  139


Fail
=================================================================
[6720414]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:10:21
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720414/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720414/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1da2f00ae4d44b75bbe8e6779d92a5dc

[6720416]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit}
-----------------------------------------------------------------
time:   00:18:59
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720416/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720416/
sentry: https://sentry.ceph.com/organizations/ceph/?query=98ec5d493ec5411795cc50f0a3a000b3

    Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi103 with
    status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=4c550ea9cebf70f679392719ef0e8ec0d2f72919
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\'
    RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1
    RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

[6720417]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock}
-----------------------------------------------------------------
time:   00:17:56
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720417/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720417/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5a4f85a4794341bf97eeb305eff8b4f2

    reached maximum tries (90) after waiting for 540 seconds

[6720418]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}
-----------------------------------------------------------------
time:   00:07:55
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720418/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720418/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6eca329293a94ee28a9fb1e39bdcf20c

[6720424]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:10:18
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720424/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720424/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b81f1e54bd564ef18e7b95c27a5df975

[6720432]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
-----------------------------------------------------------------
time:   00:42:42
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720432/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720432/

    "2022-03-04T18:30:47.217689+0000 mon.a (mon.0) 196 : cluster [WRN] Health
    check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in
    cluster log

[6720434]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:10:03
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720434/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720434/
sentry: https://sentry.ceph.com/organizations/ceph/?query=678a86f094ab43699b787ebd1bfb241f

[6720441]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum}
-----------------------------------------------------------------
time:   00:13:27
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720441/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720441/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f2fcda6e6a8e41598fba0c9117c9fd09

    Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi134 with
    status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=4c550ea9cebf70f679392719ef0e8ec0d2f72919
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\'
    RBD_IMAGE_FEATURES=layering RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4
    RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

[6720444]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}
-----------------------------------------------------------------
time:   00:15:13
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720444/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720444/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b88147bf93624793aaba5bea5288c899

    reached maximum tries (90) after waiting for 540 seconds

[6720445]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:07:21
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720445/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720445/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d4cca364ed9b4c82baf780713d6935cb

[6720449]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
-----------------------------------------------------------------
time:   00:16:36
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720449/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720449/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4dc527ab2490412ca8f9ad0192581b16

    reached maximum tries (90) after waiting for 540 seconds

[6720454]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:07:19
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720454/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720454/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5bc8b6633f024a0a815ad000f8a2fd03

[6720464]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit}
-----------------------------------------------------------------
time:   00:20:26
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720464/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720464/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5ad120cb78ae40e29534e6b1ff485b2c

    Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi067 with
    status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=4c550ea9cebf70f679392719ef0e8ec0d2f72919
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\'
    RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1
    RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

[6720469]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:09:54
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720469/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720469/
sentry: https://sentry.ceph.com/organizations/ceph/?query=407cb3149843435987270d4eaf994939

[6720471]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}
-----------------------------------------------------------------
time:   00:09:50
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720471/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720471/
sentry: https://sentry.ceph.com/organizations/ceph/?query=915f3d94b1594a65a292c1ee4c2fc2d1

[6720477]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:07:40
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720477/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720477/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5f2096c72eeb4c4b97418bb391d0056f

[6720485]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit}
-----------------------------------------------------------------
time:   00:19:16
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720485/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720485/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d9cd93622fe24471ac2d81a38e490cd1

    "2022-03-04T19:24:11.995023+0000 mon.a (mon.0) 99 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6720488]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}
-----------------------------------------------------------------
time:   00:10:22
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720488/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720488/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2a7b0e1a0e674f748975c751efaa0d37

[6720497]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:10:17
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720497/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720497/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ed66ddf6e4d24f98ab260660cafe71ea

[6720510]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff}
-----------------------------------------------------------------
time:   00:19:11
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720510/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720510/
sentry: https://sentry.ceph.com/organizations/ceph/?query=420949d0527749dfacbb898d263ca89b

    "2022-03-04T19:34:30.788326+0000 mon.a (mon.0) 94 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6720515]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:10:23
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720515/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720515/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7ec30dac236c406bb6cbf5a3341b5484

[6720526]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}
-----------------------------------------------------------------
time:   00:10:20
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720526/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720526/
sentry: https://sentry.ceph.com/organizations/ceph/?query=af67a0c405804431ad7055096b6d1a61

[6720531]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:07:15
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720531/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720531/
sentry: https://sentry.ceph.com/organizations/ceph/?query=658c55bbf68742058af26c64fe79dadc

[6720541]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:10:02
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720541/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720541/
sentry: https://sentry.ceph.com/organizations/ceph/?query=266806601ca14a5382cb1dad9b6e40cd

[6720546]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}
-----------------------------------------------------------------
time:   00:10:48
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720546/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720546/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1ca6de17497f49a094c1e6cf5c1a69ae

[6720567]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
-----------------------------------------------------------------
time:   00:48:15
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720567/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720567/

    "2022-03-04T20:15:38.607025+0000 mon.a (mon.0) 199 : cluster [WRN] Health
    check failed: Degraded data redundancy: 1/334 objects degraded (0.299%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6720572]  rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer}
-----------------------------------------------------------------
time:   00:07:39
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720572/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720572/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f6830df9f30348b1ad0dae0e5105165e



Dead
=================================================================
[6720459]  rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff}
-----------------------------------------------------------------
time:   00:03:02
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720459/
log:    http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720459/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3f5d14466257430e9cbaf3951c7f6761

    {'smithi002.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed':
    False, 'invocation': {'module_args': {'allow_unauthenticated': False,
    'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb':
    None, 'default_release': None, 'dpkg_options': 'force-confdef,force-
    confold', 'force': True, 'force_apt_get': False, 'install_recommends':
    None, 'name': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python-
    ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1',
    'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'],
    'only_upgrade': False, 'package': ['ceph', 'ceph-common', 'libcephfs1',
    'radosgw', 'python-ceph', 'python-rados', 'python-cephfs', 'python-rbd',
    'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-
    common'], 'policy_rc_d': None, 'purge': False, 'state': 'absent',
    'update_cache': None, 'upgrade': None}}, 'msg': "'apt-get remove 'librbd1'
    'librados2'' failed: W: --force-yes is deprecated, use one of the options
    starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-
    frontend. It is held by process 7289 (apt-get)\nE: Unable to acquire the
    dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using
    it?\n", 'rc': 100, 'stderr': 'W: --force-yes is deprecated, use one of the
    options starting with --allow instead.\nE: Could not get lock
    /var/lib/dpkg/lock-frontend. It is held by process 7289 (apt-get)\nE:
    Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is
    another process using it?\n', 'stderr_lines': ['W: --force-yes is
    deprecated, use one of the options starting with --allow instead.', 'E:
    Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7289
    (apt-get)', 'E: Unable to acquire the dpkg frontend lock
    (/var/lib/dpkg/lock-frontend), is another process using it?'], 'stdout':
    '', 'stdout_lines': []}}



Pass
=================================================================
[6720412] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit}
time:   00:14:11
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720412/

[6720413] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit}
time:   01:00:59
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720413/

[6720415] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:11:36
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720415/

[6720419] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff}
time:   00:20:47
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720419/

[6720420] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:47:37
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720420/

[6720421] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum}
time:   00:20:47
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720421/

[6720422] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit}
time:   00:54:00
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720422/

[6720423] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}}
time:   00:43:24
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720423/

[6720425] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit}
time:   00:38:17
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720425/

[6720426] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus}
time:   00:27:35
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720426/

[6720427] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:48:34
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720427/

[6720428] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/rbd_mirror}
time:   00:56:06
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720428/

[6720429] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple}
time:   00:28:05
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720429/

[6720430] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:48:59
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720430/

[6720431] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit}
time:   00:14:06
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720431/

[6720433] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit}
time:   00:08:49
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720433/

[6720435] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:09:33
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720435/

[6720436] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit}
time:   00:38:13
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720436/

[6720437] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock}
time:   00:20:45
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720437/

[6720438] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:48:52
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720438/

[6720439] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:46:08
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720439/

[6720440] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling}
time:   00:19:35
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720440/

[6720442] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit}
time:   00:54:14
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720442/

[6720443] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zlib openstack supported-random-distro$/{centos_8}}
time:   00:45:26
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720443/

[6720446] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key}
time:   00:28:57
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720446/

[6720447] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit}
time:   00:39:48
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720447/

[6720448] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus}
time:   00:27:26
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720448/

[6720450] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none}
time:   00:30:03
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720450/

[6720451] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/rbd_mirror}
time:   00:56:37
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720451/

[6720452] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit}
time:   00:15:35
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720452/

[6720453] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit}
time:   00:11:10
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720453/

[6720455] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:11:35
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720455/

[6720456] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit}
time:   00:39:21
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720456/

[6720457] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:45:36
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720457/

[6720458] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:48:38
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720458/

[6720460] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:48:57
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720460/

[6720461] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum}
time:   00:20:13
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720461/

[6720462] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}
time:   00:54:26
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720462/

[6720463] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key}
time:   00:27:36
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720463/

[6720465] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none}
time:   00:30:19
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720465/

[6720466] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/rbd_mirror}
time:   00:55:42
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720466/

[6720467] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple}
time:   00:28:54
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720467/

[6720468] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit}
time:   00:37:52
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720468/

[6720470] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:50:09
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720470/

[6720472] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:50:24
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720472/

[6720473] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:47:21
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720473/

[6720474] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum}
time:   00:19:38
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720474/

[6720475] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit}
time:   00:55:05
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720475/

[6720476] rbd/singleton/{all/rbd_mirror objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}}
time:   00:43:17
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720476/

[6720478] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit}
time:   00:36:15
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720478/

[6720479] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:52:18
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720479/

[6720480] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none}
time:   00:29:57
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720480/

[6720481] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/rbd_mirror}
time:   00:57:31
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720481/

[6720482] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit}
time:   00:16:08
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720482/

[6720483] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit}
time:   00:41:05
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720483/

[6720484] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit}
time:   01:00:34
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720484/

[6720486] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit}
time:   00:42:31
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720486/

[6720487] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:50:51
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720487/

[6720489] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff}
time:   00:23:56
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720489/

[6720490] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:46:47
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720490/

[6720491] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling}
time:   00:22:46
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720491/

[6720492] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit}
time:   00:38:16
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720492/

[6720493] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum}
time:   00:22:31
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720493/

[6720494] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit}
time:   00:57:55
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720494/

[6720495] rbd/singleton/{all/rbd_mirror objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{centos_8}}
time:   00:46:30
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720495/

[6720496] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}
time:   00:55:26
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720496/

[6720498] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key}
time:   00:29:29
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720498/

[6720499] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit}
time:   00:34:31
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720499/

[6720500] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none}
time:   00:30:26
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720500/

[6720501] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/rbd_mirror}
time:   00:55:42
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720501/

[6720502] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple}
time:   00:29:13
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720502/

[6720503] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit}
time:   00:16:27
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720503/

[6720504] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:44:01
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720504/

[6720505] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit}
time:   00:56:55
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720505/

[6720506] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit}
time:   00:09:13
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720506/

[6720507] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:08:36
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720507/

[6720508] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit}
time:   00:40:22
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720508/

[6720509] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:47:06
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720509/

[6720511] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:50:07
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720511/

[6720512] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling}
time:   00:20:00
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720512/

[6720513] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit}
time:   00:37:26
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720513/

[6720514] rbd/singleton/{all/rbd_mirror objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}}
time:   00:43:51
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720514/

[6720516] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key}
time:   00:30:25
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720516/

[6720517] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit}
time:   00:37:47
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720517/

[6720518] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:48:21
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720518/

[6720519] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none}
time:   00:30:02
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720519/

[6720520] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/rbd_mirror}
time:   00:56:05
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720520/

[6720521] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit}
time:   00:13:51
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720521/

[6720522] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:45:44
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720522/

[6720523] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit}
time:   00:11:35
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720523/

[6720524] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:10:52
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720524/

[6720525] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:48:19
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720525/

[6720527] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff}
time:   00:20:06
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720527/

[6720528] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling}
time:   00:19:49
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720528/

[6720529] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum}
time:   00:22:08
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720529/

[6720530] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit}
time:   00:55:16
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720530/

[6720532] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus}
time:   00:30:23
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720532/

[6720533] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none}
time:   00:30:03
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720533/

[6720534] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:45:44
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720534/

[6720535] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/rbd_mirror}
time:   00:56:11
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720535/

[6720536] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:48:12
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720536/

[6720537] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit}
time:   00:16:18
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720537/

[6720538] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:40:40
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720538/

[6720539] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit}
time:   00:59:09
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720539/

[6720540] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit}
time:   00:09:24
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720540/

[6720542] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:08:57
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720542/

[6720543] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit}
time:   00:40:23
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720543/

[6720544] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock}
time:   00:23:09
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720544/

[6720545] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:47:31
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720545/

[6720547] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff}
time:   00:20:40
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720547/

[6720548] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:47:41
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720548/

[6720549] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling}
time:   00:19:59
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720549/

[6720550] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum}
time:   00:19:40
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720550/

[6720551] rbd/singleton/{all/rbd_mirror objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}}
time:   00:45:44
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720551/

[6720552] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}
time:   00:52:33
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720552/

[6720553] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit}
time:   00:35:14
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720553/

[6720554] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus}
time:   00:30:37
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720554/

[6720555] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none}
time:   00:30:29
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720555/

[6720556] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}
time:   00:48:38
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720556/

[6720557] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror}
time:   00:55:44
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720557/

[6720558] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple}
time:   00:29:54
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720558/

[6720559] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:50:06
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720559/

[6720560] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit}
time:   00:16:12
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720560/

[6720561] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:44:20
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720561/

[6720562] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit}
time:   01:01:10
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720562/

[6720563] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit}
time:   00:08:44
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720563/

[6720564] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit}
time:   00:09:10
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720564/

[6720565] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:49:41
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720565/

[6720566] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff}
time:   00:22:28
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720566/

[6720568] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling}
time:   00:22:48
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720568/

[6720569] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit}
time:   00:39:45
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720569/

[6720570] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit}
time:   00:55:01
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720570/

[6720571] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}}
time:   00:44:02
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720571/

[6720573] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key}
time:   00:29:04
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720573/

[6720574] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit}
time:   00:39:12
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720574/

[6720575] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}
time:   00:51:33
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720575/

[6720576] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/rbd_mirror}
time:   00:56:51
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720576/

[6720577] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple}
time:   00:30:29
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720577/

[6720578] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum}
time:   00:53:22
info:   http://pulpito.ceph.com/mrfreezeex-2022-03-04_16:43:54-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6720578/