2022-02-11T08:35:57.758 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-11T08:35:57.759 INFO:teuthology.results:seed: '366' 2022-02-11T09:05:43.149 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-11T09:05:43.197 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-02-11T10:10:47.993 INFO:teuthology.results:Tests finished! gathering results... 2022-02-11T10:10:51.593 INFO:scrape:Found 54 jobs 2022-02-11T10:10:52.956 INFO:scrape:Found 3 distinct failure reasons 2022-02-11T10:10:52.957 INFO:scrape:Failure: "2022-02-11T08:57:57.315521+0000 mon.a (mon.0) 83 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log 2022-02-11T10:10:52.957 INFO:scrape:1 jobs: ['6676196'] 2022-02-11T10:10:52.958 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}'] 2022-02-11T10:10:52.958 INFO:scrape: 2022-02-11T10:10:52.959 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds 2022-02-11T10:10:52.959 INFO:scrape:1 jobs: ['6676236'] 2022-02-11T10:10:52.960 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{rhel_8}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}'] 2022-02-11T10:10:52.960 INFO:scrape: 2022-02-11T10:10:52.960 INFO:scrape:Failure: Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi107 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4c78eb81ad44ea4cc7de87ab2ef5c002e4d541a0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh' 2022-02-11T10:10:52.961 INFO:scrape:4 jobs: ['6676235', '6676203', '6676226', '6676209'] 2022-02-11T10:10:52.961 INFO:scrape:suites intersection: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'openstack}', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install'] 2022-02-11T10:10:52.962 INFO:scrape:suites union: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'openstack}', 'policy/none', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}', 'workloads/rbd-mirror-snapshot-stress-workunit-minimum}'] 2022-02-11T10:10:52.962 INFO:scrape: 2022-02-11T10:10:52.965 INFO:teuthology.results:Sending results to to.my.trociny@gmail.com: Test Run: trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 48 Fail ================================================================= [6676196] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} ----------------------------------------------------------------- time: 00:16:34 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676196/ log: http://qa-proxy.ceph.com/teuthology/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676196/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b9af13c82a4a4c3aa6066805ad5ee046 "2022-02-11T08:57:57.315521+0000 mon.a (mon.0) 83 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6676203] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} ----------------------------------------------------------------- time: 00:11:31 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676203/ log: http://qa-proxy.ceph.com/teuthology/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676203/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7fb34d2f0d104d4a9c2f82d9079c8c02 Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi201 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4c78eb81ad44ea4cc7de87ab2ef5c002e4d541a0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh' [6676209] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:24:51 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676209/ log: http://qa-proxy.ceph.com/teuthology/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676209/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b98ea1b2c3c545bdb414bcdaecd165f5 Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi159 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4c78eb81ad44ea4cc7de87ab2ef5c002e4d541a0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering,exclusive-lock RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /ho me/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror _stress.sh' [6676226] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:25:58 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676226/ log: http://qa-proxy.ceph.com/teuthology/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676226/ sentry: https://sentry.ceph.com/organizations/ceph/?query=473fd78aecf44d129a2f9fcd61d9e2a2 Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi023 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4c78eb81ad44ea4cc7de87ab2ef5c002e4d541a0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering,exclusive-lock RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /ho me/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror _stress.sh' [6676235] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} ----------------------------------------------------------------- time: 00:21:52 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676235/ log: http://qa-proxy.ceph.com/teuthology/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676235/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f10e7559b9734f80a24e00d2bd5282a5 Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi107 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4c78eb81ad44ea4cc7de87ab2ef5c002e4d541a0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /ho me/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror _stress.sh' [6676236] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:29:10 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676236/ log: http://qa-proxy.ceph.com/teuthology/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676236/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ffa3fb30b12c4b64b0ea448f9b077925 reached maximum tries (90) after waiting for 540 seconds Pass ================================================================= [6676189] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:47:51 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676189/ [6676190] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:49:48 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676190/ [6676191] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:47:10 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676191/ [6676192] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:48:44 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676192/ [6676193] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:51:01 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676193/ [6676194] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:49:15 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676194/ [6676195] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:47:24 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676195/ [6676197] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:48:43 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676197/ [6676198] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:45:35 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676198/ [6676199] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:46:48 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676199/ [6676200] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 01:05:46 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676200/ [6676201] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 01:00:55 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676201/ [6676202] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:45:21 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676202/ [6676204] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:46:05 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676204/ [6676205] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:45:34 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676205/ [6676206] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:50:28 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676206/ [6676207] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:49:21 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676207/ [6676208] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 01:03:06 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676208/ [6676210] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:51:22 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676210/ [6676211] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:47:43 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676211/ [6676212] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 01:03:47 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676212/ [6676213] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 01:03:16 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676213/ [6676214] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 01:01:31 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676214/ [6676215] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 01:00:40 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676215/ [6676216] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:48:24 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676216/ [6676217] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 01:04:02 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676217/ [6676218] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 01:01:35 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676218/ [6676219] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:59:56 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676219/ [6676220] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:50:57 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676220/ [6676221] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:46:24 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676221/ [6676222] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:58:49 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676222/ [6676223] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:50:24 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676223/ [6676224] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:48:01 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676224/ [6676225] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 01:01:09 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676225/ [6676227] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 01:03:01 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676227/ [6676228] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:47:53 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676228/ [6676229] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:49:56 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676229/ [6676230] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:48:21 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676230/ [6676231] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:47:37 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676231/ [6676232] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 01:01:05 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676232/ [6676233] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:48:19 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676233/ [6676234] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:50:27 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676234/ [6676237] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:51:10 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676237/ [6676238] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:45:31 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676238/ [6676239] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:46:02 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676239/ [6676240] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 01:05:45 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676240/ [6676241] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:47:10 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676241/ [6676242] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:46:20 info: http://pulpito.ceph.com/trociny-2022-02-11_08:34:47-rbd-master-distro-basic-smithi/6676242/