2022-03-03T11:17:50.697 INFO:root:teuthology version: 1.1.0-eeaeee38 2022-03-03T11:17:50.699 INFO:teuthology.results:seed: '124' 2022-03-03T13:24:23.528 INFO:root:teuthology version: 1.1.0-eeaeee38 2022-03-03T13:24:23.540 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-03T14:28:28.797 INFO:teuthology.results:Tests finished! gathering results... 2022-03-03T14:28:42.965 INFO:scrape:Found 164 jobs 2022-03-03T14:28:47.639 WARNING:scrape:Not-understood crash indication 2022-03-03T12:47:07.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi135.stderr:daemon-helper: command crashed with signal 11 2022-03-03T14:28:47.640 WARNING:scrape:Not-understood crash indication 2022-03-03T14:28:47.701 WARNING:scrape:Not-understood crash indication 2022-03-03T12:47:07.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi135.stderr:daemon-helper: command crashed with signal 11 2022-03-03T14:28:47.702 WARNING:scrape:Not-understood crash indication 2022-03-03T14:28:47.759 WARNING:scrape:Not-understood crash indication 2022-03-03T12:47:07.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi135.stderr:daemon-helper: command crashed with signal 11 2022-03-03T14:28:47.760 WARNING:scrape:Not-understood crash indication 2022-03-03T14:28:47.818 WARNING:scrape:Not-understood crash indication 2022-03-03T12:47:07.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi135.stderr:daemon-helper: command crashed with signal 11 2022-03-03T14:28:47.819 WARNING:scrape:Not-understood crash indication 2022-03-03T14:28:47.876 WARNING:scrape:Not-understood crash indication 2022-03-03T12:47:07.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi135.stderr:daemon-helper: command crashed with signal 11 2022-03-03T14:28:47.877 WARNING:scrape:Not-understood crash indication 2022-03-03T14:28:47.936 WARNING:scrape:Not-understood crash indication 2022-03-03T12:47:07.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi135.stderr:daemon-helper: command crashed with signal 11 2022-03-03T14:28:47.937 WARNING:scrape:Not-understood crash indication 2022-03-03T14:28:47.992 WARNING:scrape:Not-understood crash indication 2022-03-03T12:47:07.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi135.stderr:daemon-helper: command crashed with signal 11 2022-03-03T14:28:47.993 WARNING:scrape:Not-understood crash indication 2022-03-03T14:28:48.048 WARNING:scrape:Not-understood crash indication 2022-03-03T12:47:07.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi135.stderr:daemon-helper: command crashed with signal 11 2022-03-03T14:28:48.049 WARNING:scrape:Not-understood crash indication 2022-03-03T14:28:49.511 INFO:scrape:Found 7 distinct failure reasons 2022-03-03T14:28:49.512 INFO:scrape:Failure: 2022-03-03T14:28:49.513 INFO:scrape:12 jobs: ['6717987', '6717865', '6717960', '6718000', '6717944', '6717873', '6717883', '6717957', '6717992', '6717926', '6717890', '6718014'] 2022-03-03T14:28:49.513 INFO:scrape:suites intersection: ['cluster/{2-node', 'msgr-failures/few', 'openstack}'] 2022-03-03T14:28:49.514 INFO:scrape:suites union: ['clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'policy/none', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-journal-workunit-multipeer}', 'workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}'] 2022-03-03T14:28:49.514 INFO:scrape: 2022-03-03T14:28:49.515 INFO:scrape:Failure: No module named 'tasks.ceph' 2022-03-03T14:28:49.515 INFO:scrape:7 jobs: ['6717901', '6717915', '6717911', '6717900', '6717914', '6717899', '6717897'] 2022-03-03T14:28:49.516 INFO:scrape:suites intersection: ['cluster/{2-node', 'msgr-failures/few', 'openstack}'] 2022-03-03T14:28:49.516 INFO:scrape:suites union: ['clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-ha-workunit}', 'workloads/rbd-mirror-journal-workunit-multipeer}', 'workloads/rbd-mirror-journal-workunit}', 'workloads/rbd-mirror-snapshot-bootstrap-workunit}', 'workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}', 'workloads/rbd-mirror-workunit-min-compat-client-octopus}', 'workloads/rbd-mirror-workunit-policy-simple}'] 2022-03-03T14:28:49.517 INFO:scrape: 2022-03-03T14:28:49.517 INFO:scrape:Failure: "2022-03-03T13:28:05.405553+0000 mon.a (mon.0) 93 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log 2022-03-03T14:28:49.518 INFO:scrape:8 jobs: ['6718005', '6717943', '6717929', '6717996', '6717965', '6717859', '6717881', '6718018'] 2022-03-03T14:28:49.518 INFO:scrape:suites intersection: ['cluster/{2-node', 'msgr-failures/few', 'openstack}'] 2022-03-03T14:28:49.519 INFO:scrape:suites union: ['clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'policy/none', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-fsx-workunit}', 'workloads/rbd-mirror-journal-stress-workunit}', 'workloads/rbd-mirror-journal-workunit-multipeer}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}', 'workloads/rbd-mirror-snapshot-stress-workunit-minimum}', 'workloads/rbd-mirror-snapshot-workunit-exclusive-lock}', 'workloads/rbd-mirror-snapshot-workunit-minimum}'] 2022-03-03T14:28:49.519 INFO:scrape: 2022-03-03T14:28:49.520 INFO:scrape:Failure: Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi083 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' 2022-03-03T14:28:49.520 INFO:scrape:1 jobs: ['6717923'] 2022-03-03T14:28:49.521 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'openstack}', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-journal-workunit}'] 2022-03-03T14:28:49.522 INFO:scrape: 2022-03-03T14:28:49.522 INFO:scrape:Failure: Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi153 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh' 2022-03-03T14:28:49.523 INFO:scrape:2 jobs: ['6717924', '6717903'] 2022-03-03T14:28:49.523 INFO:scrape:suites intersection: ['clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'openstack}', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd-mirror-snapshot-workunit-exclusive-lock}'] 2022-03-03T14:28:49.524 INFO:scrape:suites union: ['clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd-mirror-snapshot-workunit-exclusive-lock}'] 2022-03-03T14:28:49.524 INFO:scrape: 2022-03-03T14:28:49.525 INFO:scrape:Dead: b"teuthology.exceptions.CommitNotFoundError: '501cde21dbba697e001f934aba397a4bf89fefdd' not found in repo: git://git.ceph.com/ceph-ci.git!" 2022-03-03T14:28:49.525 INFO:scrape:2 jobs: ['6717908', '6717912'] 2022-03-03T14:28:49.526 INFO:scrape: 2022-03-03T14:28:49.526 INFO:scrape:Failure: Found coredumps on ubuntu@smithi135.front.sepia.ceph.com 2022-03-03T14:28:49.527 INFO:scrape:1 jobs: ['6717905'] 2022-03-03T14:28:49.527 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}'] 2022-03-03T14:28:49.528 INFO:scrape: 2022-03-03T14:28:49.536 INFO:teuthology.results:Sending results to arthur.outhenin-chalandre@cern.ch: Test Run: mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/ failed: 31 dead: 2 running: 0 waiting: 0 queued: 0 passed: 131 Fail ================================================================= [6717859] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} ----------------------------------------------------------------- time: 01:00:18 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717859/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717859/ "2022-03-03T11:37:47.767065+0000 mon.a (mon.0) 192 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log [6717865] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} ----------------------------------------------------------------- time: 00:08:02 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717865/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717865/ sentry: https://sentry.ceph.com/organizations/ceph/?query=55725cb78f5740f2a8e91ea90ef25ab5 [6717873] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:09:56 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717873/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717873/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3438b3ede7e142b098d030ff42a42176 [6717881] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:17:50 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717881/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717881/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6238e2723c97464a9d1f1dd317e4d849 "2022-03-03T11:49:36.313998+0000 mon.a (mon.0) 94 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6717883] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} ----------------------------------------------------------------- time: 00:06:55 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717883/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717883/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd1f0b4c049b4743849b557b31c85590 [6717890] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:07:40 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717890/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717890/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc6377feab354ed09400dad21a7a63a5 [6717897] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717897/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717897/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6a2e026e62ac4768ae8a84734621db6e No module named 'tasks.ceph' [6717899] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} ----------------------------------------------------------------- time: 00:07:44 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717899/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717899/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c4f089e3915b4d669b67c0eb5c469987 No module named 'tasks.ceph' [6717900] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:07:30 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717900/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717900/ sentry: https://sentry.ceph.com/organizations/ceph/?query=952b31f3d907431aa94625e0044568c6 No module named 'tasks.rbd_mirror' [6717901] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} ----------------------------------------------------------------- time: 00:07:27 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717901/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717901/ sentry: https://sentry.ceph.com/organizations/ceph/?query=87cf6b92b5534c8487bce42cd87a599e No module named 'tasks.ceph' [6717903] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:17:08 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717903/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717903/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa0bee2f85b64da89d4bb0256d5e7a71 Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi026 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubunt u/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapsho t.sh' [6717905] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} ----------------------------------------------------------------- time: 00:49:29 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717905/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717905/ Found coredumps on ubuntu@smithi135.front.sepia.ceph.com [6717911] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} ----------------------------------------------------------------- time: 00:05:15 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717911/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717911/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3be37063609b4c23bb44f17260b60729 No module named 'tasks' [6717914] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} ----------------------------------------------------------------- time: 00:05:02 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717914/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717914/ sentry: https://sentry.ceph.com/organizations/ceph/?query=04e0f2c6c0b04ea4a7a63dea7930b33b No module named 'tasks' [6717915] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} ----------------------------------------------------------------- time: 00:07:33 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717915/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717915/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4069bd1690bc48249125e1efe567a233 No module named 'tasks' [6717923] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} ----------------------------------------------------------------- time: 00:22:46 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717923/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717923/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0d876b6c3f2542408578ab24ab0a1076 Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi083 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh' [6717924] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:16:29 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717924/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717924/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7871aacbc8f649e084b236e0fe8492f6 Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi153 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=501cde21dbba697e001f934aba397a4bf89fefdd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubunt u/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapsho t.sh' [6717926] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} ----------------------------------------------------------------- time: 00:09:51 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717926/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717926/ sentry: https://sentry.ceph.com/organizations/ceph/?query=59f81f331bf94e5082523843eec5febf [6717929] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} ----------------------------------------------------------------- time: 00:16:25 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717929/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717929/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d22c37f321174f52be3b795c3a67e155 "2022-03-03T12:25:34.038877+0000 mon.a (mon.0) 100 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6717943] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:20:50 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717943/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717943/ "2022-03-03T12:37:46.790493+0000 mon.a (mon.0) 191 : cluster [WRN] Health check failed: Degraded data redundancy: 1/94 objects degraded (1.064%), 1 pg degraded (PG_DEGRADED)" in cluster log [6717944] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} ----------------------------------------------------------------- time: 00:07:26 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717944/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717944/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b8c32f4ef78a4289a2b84314476ff37e [6717957] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:07:17 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717957/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717957/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8cde5750116f4b4092c072ff2cdb661c [6717960] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} ----------------------------------------------------------------- time: 00:07:33 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717960/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717960/ sentry: https://sentry.ceph.com/organizations/ceph/?query=becba585586f4a02b06695845f7da300 [6717965] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} ----------------------------------------------------------------- time: 00:17:33 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717965/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717965/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a478a4d3e01745ff8910b9e1080684cf "2022-03-03T12:55:56.538551+0000 mon.a (mon.0) 96 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6717987] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:10:14 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717987/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717987/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8c5aaf4532d84b1bb534a34d55ac833b [6717992] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} ----------------------------------------------------------------- time: 00:09:59 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717992/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717992/ sentry: https://sentry.ceph.com/organizations/ceph/?query=03638b6ca1844310b00e52ae75c7e595 [6717996] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} ----------------------------------------------------------------- time: 00:17:54 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717996/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717996/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8bb587b50bf24ef595474d6d4422b5e8 "2022-03-03T13:24:12.664354+0000 mon.a (mon.0) 97 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6718000] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:10:02 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718000/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718000/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b8e951410eca489bb2b4db6be5ad2d81 [6718005] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} ----------------------------------------------------------------- time: 00:18:39 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718005/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718005/ sentry: https://sentry.ceph.com/organizations/ceph/?query=acb5911fc15846d5ba287e29061b9e30 "2022-03-03T13:28:05.405553+0000 mon.a (mon.0) 93 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6718014] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:10:17 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718014/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718014/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3edcda557044225a34dd7b9a0080b2e [6718018] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} ----------------------------------------------------------------- time: 00:15:09 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718018/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718018/ sentry: https://sentry.ceph.com/organizations/ceph/?query=942e9a37a46a4c5ba074c06c9545f5af "2022-03-03T13:40:20.861102+0000 mon.a (mon.0) 98 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log Dead ================================================================= [6717908] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717908/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717908/ [6717912] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717912/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717912/ Pass ================================================================= [6717858] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} time: 00:16:27 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717858/ [6717860] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:11:48 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717860/ [6717861] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:11:58 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717861/ [6717862] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} time: 00:40:10 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717862/ [6717863] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:23:08 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717863/ [6717864] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:48:43 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717864/ [6717866] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:48:08 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717866/ [6717867] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:19:36 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717867/ [6717868] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} time: 00:39:01 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717868/ [6717869] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:22:36 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717869/ [6717870] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:55:54 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717870/ [6717871] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-snappy openstack supported-random-distro$/{centos_8}} time: 00:45:52 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717871/ [6717872] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:49:20 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717872/ [6717874] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:31:03 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717874/ [6717875] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} time: 00:28:44 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717875/ [6717876] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:48:07 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717876/ [6717877] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/rbd_mirror} time: 00:55:55 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717877/ [6717878] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} time: 00:30:00 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717878/ [6717879] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} time: 00:14:21 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717879/ [6717880] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:08:59 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717880/ [6717882] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:08:59 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717882/ [6717884] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:48:14 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717884/ [6717885] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:20:48 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717885/ [6717886] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:48:57 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717886/ [6717887] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:19:25 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717887/ [6717888] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zlib openstack supported-random-distro$/{centos_8}} time: 00:45:45 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717888/ [6717889] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:52:18 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717889/ [6717891] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} time: 00:28:01 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717891/ [6717892] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:37:45 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717892/ [6717893] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:30:22 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717893/ [6717894] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} time: 00:28:29 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717894/ [6717895] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:44:39 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717895/ [6717896] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/rbd_mirror} time: 00:56:59 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717896/ [6717898] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:49:57 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717898/ [6717902] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} time: 00:39:55 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717902/ [6717904] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:46:54 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717904/ [6717906] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:20:14 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717906/ [6717907] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:48:12 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717907/ [6717909] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:55:56 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717909/ [6717910] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zstd openstack supported-random-distro$/{ubuntu_latest}} time: 00:43:44 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717910/ [6717913] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} time: 00:30:28 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717913/ [6717916] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:47:41 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717916/ [6717917] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/rbd_mirror} time: 00:57:11 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717917/ [6717918] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} time: 00:30:37 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717918/ [6717919] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} time: 00:36:24 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717919/ [6717920] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:55:42 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717920/ [6717921] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:08:51 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717921/ [6717922] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:11:53 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717922/ [6717925] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:46:53 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717925/ [6717927] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:51:54 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717927/ [6717928] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:20:25 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717928/ [6717930] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:19:59 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717930/ [6717931] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} time: 00:36:31 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717931/ [6717932] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:19:40 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717932/ [6717933] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} time: 00:31:38 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717933/ [6717934] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:38:53 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717934/ [6717935] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:30:45 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717935/ [6717936] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:51:14 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717936/ [6717937] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} time: 00:28:12 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717937/ [6717938] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/rbd_mirror} time: 00:55:43 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717938/ [6717939] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:53:06 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717939/ [6717940] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} time: 00:14:27 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717940/ [6717941] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:08:58 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717941/ [6717942] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} time: 00:38:26 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717942/ [6717945] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:49:35 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717945/ [6717946] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:49:40 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717946/ [6717947] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:20:31 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717947/ [6717948] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 00:44:34 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717948/ [6717949] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:54:06 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717949/ [6717950] rbd/singleton/{all/rbd_mirror objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{centos_8}} time: 00:46:16 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717950/ [6717951] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:39:22 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717951/ [6717952] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:30:33 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717952/ [6717953] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/rbd_mirror} time: 00:56:39 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717953/ [6717954] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} time: 00:30:11 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717954/ [6717955] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:51:06 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717955/ [6717956] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 01:00:34 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717956/ [6717958] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:39:55 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717958/ [6717959] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:23:11 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717959/ [6717961] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:47:23 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717961/ [6717962] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:19:32 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717962/ [6717963] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:18:54 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717963/ [6717964] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} time: 00:40:39 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717964/ [6717966] rbd/singleton/{all/rbd_mirror objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} time: 00:43:50 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717966/ [6717967] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:51:57 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717967/ [6717968] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} time: 00:28:17 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717968/ [6717969] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} time: 00:35:52 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717969/ [6717970] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:30:46 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717970/ [6717971] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/rbd_mirror} time: 00:55:31 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717971/ [6717972] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:58:42 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717972/ [6717973] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:08:59 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717973/ [6717974] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:08:34 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717974/ [6717975] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:23:13 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717975/ [6717976] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:46:03 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717976/ [6717977] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:46:59 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717977/ [6717978] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:22:59 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717978/ [6717979] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:49:10 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717979/ [6717980] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:22:05 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717980/ [6717981] rbd/singleton/{all/rbd_mirror objectstore/filestore-xfs openstack supported-random-distro$/{ubuntu_latest}} time: 00:43:32 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717981/ [6717982] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:38:50 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717982/ [6717983] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:27:50 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717983/ [6717984] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:47:56 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717984/ [6717985] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/rbd_mirror} time: 00:55:08 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717985/ [6717986] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 00:38:29 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717986/ [6717988] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:11:38 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717988/ [6717989] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} time: 00:38:48 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717989/ [6717990] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:19:56 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717990/ [6717991] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:47:59 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717991/ [6717993] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:22:21 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717993/ [6717994] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:46:56 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717994/ [6717995] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:19:48 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717995/ [6717997] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:20:08 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717997/ [6717998] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} time: 00:56:00 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717998/ [6717999] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:55:11 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6717999/ [6718001] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:30:10 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718001/ [6718002] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:49:20 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718002/ [6718003] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror} time: 00:55:38 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718003/ [6718004] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} time: 00:29:09 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718004/ [6718006] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 01:00:07 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718006/ [6718007] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:08:57 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718007/ [6718008] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:47:47 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718008/ [6718009] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:21:13 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718009/ [6718010] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:22:46 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718010/ [6718011] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} time: 00:39:04 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718011/ [6718012] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:20:14 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718012/ [6718013] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:54:45 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718013/ [6718015] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} time: 00:28:55 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718015/ [6718016] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:28:24 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718016/ [6718017] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} time: 00:30:25 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718017/ [6718019] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/rbd_mirror} time: 00:55:25 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718019/ [6718020] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} time: 00:29:57 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718020/ [6718021] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:50:52 info: http://pulpito.ceph.com/mrfreezeex-2022-03-03_11:17:22-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6718021/