2022-02-25T16:58:19.344 INFO:root:teuthology version: 1.1.0-5825e8d0 2022-02-25T16:58:19.347 INFO:teuthology.results:seed: '9739' 2022-02-26T18:33:01.703 INFO:root:teuthology version: 1.1.0-5825e8d0 2022-02-26T18:33:01.741 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-02-26T19:37:07.245 INFO:teuthology.results:Tests finished! gathering results... 2022-02-26T19:37:25.851 INFO:scrape:Found 177 jobs 2022-02-26T19:37:27.066 WARNING:scrape:Not-understood crash indication 2022-02-26T18:35:12.250 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi189.stderr:daemon-helper: command crashed with signal 11 2022-02-26T19:37:27.067 WARNING:scrape:Not-understood crash indication 2022-02-26T19:37:27.206 WARNING:scrape:Not-understood crash indication 2022-02-26T18:35:12.250 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi189.stderr:daemon-helper: command crashed with signal 11 2022-02-26T19:37:27.208 WARNING:scrape:Not-understood crash indication 2022-02-26T19:37:31.361 INFO:scrape:Found 5 distinct failure reasons 2022-02-26T19:37:31.363 INFO:scrape:Failure: 2022-02-26T19:37:31.363 INFO:scrape:18 jobs: ['6705867', '6705954', '6706013', '6705877', '6705951', '6705971', '6705861', '6705990', '6705928', '6705941', '6705908', '6705932', '6706021', '6705980', '6705901', '6705884', '6705857', '6705879'] 2022-02-26T19:37:31.364 INFO:scrape:suites intersection: ['cluster/{2-node', 'msgr-failures/few', 'openstack}'] 2022-02-26T19:37:31.364 INFO:scrape:suites union: ['clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'policy/none', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-journal-workunit-multipeer}', 'workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer}'] 2022-02-26T19:37:31.365 INFO:scrape: 2022-02-26T19:37:31.365 INFO:scrape:Failure: Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi157 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8122fe56dfc5c5edb9b4ddf1231b79ef0701fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh' 2022-02-26T19:37:31.366 INFO:scrape:2 jobs: ['6705921', '6705967'] 2022-02-26T19:37:31.366 INFO:scrape:suites intersection: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'openstack}', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}'] 2022-02-26T19:37:31.367 INFO:scrape:suites union: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zstd', 'openstack}', 'policy/none', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd-mirror-journal-stress-workunit}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}'] 2022-02-26T19:37:31.367 INFO:scrape: 2022-02-26T19:37:31.368 INFO:scrape:Failure: "2022-02-26T18:38:51.987189+0000 mon.a (mon.0) 98 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log 2022-02-26T19:37:31.368 INFO:scrape:7 jobs: ['6706014', '6705868', '6705944', '6706008', '6705950', '6705893', '6706024'] 2022-02-26T19:37:31.369 INFO:scrape:suites intersection: ['cluster/{2-node', 'msgr-failures/few', 'openstack}'] 2022-02-26T19:37:31.369 INFO:scrape:suites union: ['clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'policy/none', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-fsx-workunit}', 'workloads/rbd-mirror-journal-workunit-multipeer}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}', 'workloads/rbd-mirror-workunit-config-key}', 'workloads/rbd-mirror-workunit-min-compat-client-octopus}'] 2022-02-26T19:37:31.370 INFO:scrape: 2022-02-26T19:37:31.370 INFO:scrape:Crash: Found coredumps on ubuntu@smithi162.front.sepia.ceph.com 2022-02-26T19:37:31.371 INFO:scrape:ceph version 17.0.0-10875-g8122fe56 (8122fe56dfc5c5edb9b4ddf1231b79ef0701fa66) quincy (dev) 1: /lib64/libpthread.so.0(+0x12c20) [0x7fbef8466c20] 2: gsignal() 3: abort() 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7fbef90332f2] 5: /usr/lib64/ceph/libceph-common.so.2(+0x2834b5) [0x7fbef90334b5] 6: (rbd::mirror::NamespaceReplayer::init_remote_pool_watcher(rbd::mirror::Peer&, Context*)+0x418) [0x562b0bec50e8] 7: (rbd::mirror::NamespaceReplayer::handle_init_remote_status_updater(rbd::mirror::Peer&, int, Context*)+0x1aa) [0x562b0bec535a] 8: (Context::complete(int)+0xd) [0x562b0be540ad] 9: (boost::asio::detail::completion_handler, 0u> >::do_complete(void*, boost::asio::detail::scheduler_operation*, boost::system::error_code const&, unsigned long)+0x5a) [0x562b0be5453a] 10: (boost::asio::detail::strand_service::do_complete(void*, boost::asio::detail::scheduler_operation*, boost::system::error_code const&, unsigned long)+0x85) [0x562b0c0259c5] 11: /lib64/librados.so.2(+0xc8ee8) [0x7fbefa59bee8] 12: /lib64/librados.so.2(+0xce28a) [0x7fbefa5a128a] 13: /lib64/libstdc++.so.6(+0xc2ba3) [0x7fbef7275ba3] 14: /lib64/libpthread.so.0(+0x817f) [0x7fbef845c17f] 15: clone() 2022-02-26T19:37:31.371 INFO:scrape:1 jobs: ['6705933'] 2022-02-26T19:37:31.372 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}'] 2022-02-26T19:37:31.372 INFO:scrape: 2022-02-26T19:37:31.372 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds 2022-02-26T19:37:31.373 INFO:scrape:1 jobs: ['6705918'] 2022-02-26T19:37:31.373 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-journal-workunit}'] 2022-02-26T19:37:31.374 INFO:scrape: 2022-02-26T19:37:31.382 INFO:teuthology.results:Sending results to arthur.outhenin-chalandre@cern.ch: Test Run: mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/ failed: 29 dead: 0 running: 0 waiting: 0 queued: 0 passed: 148 Fail ================================================================= [6705857] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:09:41 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705857/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705857/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d69ec36051be4e408fe43abaff0930de [6705861] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} ----------------------------------------------------------------- time: 00:10:58 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705861/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705861/ sentry: https://sentry.ceph.com/organizations/ceph/?query=83a649de5cc24f2b949ecbb3b01b367e [6705867] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:09:54 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705867/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705867/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a0657c031542421d961402500feacfd5 [6705868] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} ----------------------------------------------------------------- time: 00:17:48 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705868/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705868/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe138dcab9934fbcb8497638328f0f4e "2022-02-25T17:23:13.306268+0000 mon.a (mon.0) 93 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6705877] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:10:32 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705877/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705877/ sentry: https://sentry.ceph.com/organizations/ceph/?query=387ecc32424f4e46a1426808f00e6274 [6705879] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} ----------------------------------------------------------------- time: 00:10:10 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705879/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705879/ sentry: https://sentry.ceph.com/organizations/ceph/?query=534dfce0744248ddbbce9a06f599e3c5 [6705884] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705884/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705884/ sentry: https://sentry.ceph.com/organizations/ceph/?query=68b88173e6d04273bd5735a7fca7c4ec [6705893] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:15:03 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705893/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705893/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dbba5f11ffb145899ef648b406fffe66 "2022-02-25T17:36:23.919416+0000 mon.a (mon.0) 95 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6705901] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:07:38 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705901/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705901/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8f2438788aee437682e5e9a0a8abf851 [6705908] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:09:51 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705908/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705908/ sentry: https://sentry.ceph.com/organizations/ceph/?query=313d5c9fb39b4371bc7714f0d7b2615e [6705918] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} ----------------------------------------------------------------- time: 00:16:12 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705918/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705918/ sentry: https://sentry.ceph.com/organizations/ceph/?query=128caa5a5db349309a0cd523578c4071 reached maximum tries (90) after waiting for 540 seconds [6705921] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} ----------------------------------------------------------------- time: 00:16:48 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705921/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705921/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f811eb660e6242adae974cac30700094 Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi157 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8122fe56dfc5c5edb9b4ddf1231b79ef0701fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clo ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh' [6705928] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:10:10 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705928/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705928/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1e0c7fadb1744d03b6e61f2d9d7dbf7b [6705932] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} ----------------------------------------------------------------- time: 00:07:51 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705932/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705932/ sentry: https://sentry.ceph.com/organizations/ceph/?query=07c715927780446e87be8ef660bb1d4b [6705933] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} ----------------------------------------------------------------- time: 00:50:13 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705933/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705933/ Found coredumps on ubuntu@smithi162.front.sepia.ceph.com [6705941] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:07:35 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705941/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705941/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4617dcdbf5fb436f93473675c28bcf8c [6705944] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:16:28 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705944/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705944/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b36df946454a40d9b48a9c08cdfad1ef "2022-02-25T18:45:36.428347+0000 mon.a (mon.0) 94 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6705950] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} ----------------------------------------------------------------- time: 00:38:36 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705950/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705950/ "2022-02-25T18:54:48.027723+0000 mon.a (mon.0) 203 : cluster [WRN] Health check failed: Degraded data redundancy: 4/886 objects degraded (0.451%), 1 pg degraded (PG_DEGRADED)" in cluster log [6705951] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:10:03 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705951/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705951/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b9061fc55e304be3912bdd0de50c9485 [6705954] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} ----------------------------------------------------------------- time: 00:10:23 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705954/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705954/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c5cc3c64a7bf46fdaf8e41d18bffd352 [6705967] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} ----------------------------------------------------------------- time: 00:40:01 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705967/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705967/ sentry: https://sentry.ceph.com/organizations/ceph/?query=713b7437a3344cc3aae0ca928cf9f16d Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi189 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8122fe56dfc5c5edb9b4ddf1231b79ef0701fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=journal MIRROR_POOL_MODE=pool RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /ho me/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror _stress.sh' [6705971] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} ----------------------------------------------------------------- time: 00:07:57 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705971/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705971/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2c8237d317ae4e9981783b84a52d04dd [6705980] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:07:26 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705980/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705980/ sentry: https://sentry.ceph.com/organizations/ceph/?query=db7fbd258b9b43fa95e68378c28be808 [6705990] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:10:26 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705990/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705990/ sentry: https://sentry.ceph.com/organizations/ceph/?query=495ca5db92b445829453eff8bf10a93d [6706008] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:15:08 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706008/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706008/ sentry: https://sentry.ceph.com/organizations/ceph/?query=941dd3cad2774e2f8df7edb1917a3f36 "2022-02-26T18:32:08.758686+0000 mon.a (mon.0) 96 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6706013] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} ----------------------------------------------------------------- time: 00:07:26 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706013/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706013/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9861f8dbb4d14cbab8f5c8fa94a520e5 [6706014] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} ----------------------------------------------------------------- time: 00:18:57 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706014/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706014/ sentry: https://sentry.ceph.com/organizations/ceph/?query=787e91857efa43d081ab821ca6a2bab1 "2022-02-26T18:38:51.987189+0000 mon.a (mon.0) 98 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6706021] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} ----------------------------------------------------------------- time: 00:07:17 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706021/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706021/ sentry: https://sentry.ceph.com/organizations/ceph/?query=34fa5e0681e0477eb4cfb6f12d713a56 [6706024] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} ----------------------------------------------------------------- time: 00:18:30 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706024/ log: http://qa-proxy.ceph.com/teuthology/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706024/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4d6e8ec5e9964f1887f7eac36e37aca9 "2022-02-26T18:48:21.197421+0000 mon.a (mon.0) 92 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log Pass ================================================================= [6705853] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} time: 00:15:07 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705853/ [6705854] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} time: 00:40:49 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705854/ [6705855] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:56:14 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705855/ [6705856] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:08:54 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705856/ [6705858] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:09:23 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705858/ [6705859] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:22:33 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705859/ [6705860] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:47:19 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705860/ [6705862] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:19:43 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705862/ [6705863] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} time: 00:36:24 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705863/ [6705864] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:59:32 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705864/ [6705865] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} time: 00:43:34 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705865/ [6705866] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:55:19 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705866/ [6705869] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:28:04 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705869/ [6705870] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:50:54 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705870/ [6705871] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/rbd_mirror} time: 00:56:45 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705871/ [6705872] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} time: 00:29:53 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705872/ [6705873] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} time: 00:16:43 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705873/ [6705874] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 00:54:35 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705874/ [6705875] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:59:38 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705875/ [6705876] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:09:12 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705876/ [6705878] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:40:33 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705878/ [6705880] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:48:28 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705880/ [6705881] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 00:39:14 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705881/ [6705882] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} time: 00:43:23 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705882/ [6705883] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:54:57 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705883/ [6705885] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:41:46 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705885/ [6705886] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:49:42 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705886/ [6705887] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} time: 00:27:58 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705887/ [6705888] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:47:58 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705888/ [6705889] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/rbd_mirror} time: 00:57:43 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705889/ [6705890] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} time: 00:15:59 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705890/ [6705891] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:57:43 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705891/ [6705892] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:08:57 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705892/ [6705894] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:11:24 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705894/ [6705895] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:22:22 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705895/ [6705896] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:48:17 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705896/ [6705897] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:20:10 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705897/ [6705898] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} time: 00:42:32 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705898/ [6705899] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:20:41 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705899/ [6705900] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:54:55 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705900/ [6705902] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} time: 00:35:22 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705902/ [6705903] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:27:59 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705903/ [6705904] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:46:28 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705904/ [6705905] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:49:10 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705905/ [6705906] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/rbd_mirror} time: 00:56:10 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705906/ [6705907] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} time: 00:29:34 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705907/ [6705909] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:09:00 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705909/ [6705910] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:21:32 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705910/ [6705911] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:49:40 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705911/ [6705912] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:21:59 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705912/ [6705913] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:20:21 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705913/ [6705914] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} time: 00:44:23 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705914/ [6705915] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:56:56 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705915/ [6705916] rbd/singleton/{all/rbd_mirror objectstore/bluestore-hybrid openstack supported-random-distro$/{centos_8}} time: 00:45:48 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705916/ [6705917] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} time: 00:29:57 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705917/ [6705919] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:30:46 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705919/ [6705920] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:51:59 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705920/ [6705922] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/rbd_mirror} time: 00:57:31 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705922/ [6705923] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} time: 00:30:31 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705923/ [6705924] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} time: 00:14:20 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705924/ [6705925] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 00:41:37 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705925/ [6705926] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:55:05 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705926/ [6705927] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:10:48 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705927/ [6705929] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:11:17 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705929/ [6705930] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:42:00 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705930/ [6705931] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:19:49 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705931/ [6705934] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:20:20 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705934/ [6705935] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:48:33 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705935/ [6705936] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:20:47 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705936/ [6705937] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 00:38:08 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705937/ [6705938] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:22:01 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705938/ [6705939] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} time: 00:54:14 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705939/ [6705940] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:52:02 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705940/ [6705942] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:40:14 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705942/ [6705943] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:28:10 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705943/ [6705945] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:46:44 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705945/ [6705946] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/rbd_mirror} time: 00:56:07 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705946/ [6705947] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} time: 00:30:21 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705947/ [6705948] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:49:34 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705948/ [6705949] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} time: 00:16:54 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705949/ [6705952] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} time: 00:38:00 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705952/ [6705953] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:19:53 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705953/ [6705955] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:47:42 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705955/ [6705956] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:20:24 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705956/ [6705957] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} time: 00:45:58 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705957/ [6705958] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:54:09 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705958/ [6705959] rbd/singleton/{all/rbd_mirror objectstore/bluestore-stupid openstack supported-random-distro$/{centos_8}} time: 00:46:12 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705959/ [6705960] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} time: 00:28:23 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705960/ [6705961] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} time: 00:29:28 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705961/ [6705962] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:47:53 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705962/ [6705963] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/rbd_mirror} time: 00:57:38 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705963/ [6705964] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} time: 00:29:46 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705964/ [6705965] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} time: 00:15:49 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705965/ [6705966] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 00:52:35 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705966/ [6705968] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} time: 00:11:43 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705968/ [6705969] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:21:49 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705969/ [6705970] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:48:17 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705970/ [6705972] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:51:56 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705972/ [6705973] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:20:43 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705973/ [6705974] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:46:29 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705974/ [6705975] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:22:19 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705975/ [6705976] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 00:36:54 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705976/ [6705977] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:20:55 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705977/ [6705978] rbd/singleton/{all/rbd_mirror objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} time: 00:46:21 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705978/ [6705979] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:52:36 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705979/ [6705981] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} time: 00:28:39 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705981/ [6705982] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} time: 00:36:07 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705982/ [6705983] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:28:03 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705983/ [6705984] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:49:57 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705984/ [6705985] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/rbd_mirror} time: 00:56:05 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705985/ [6705986] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} time: 00:29:23 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705986/ [6705987] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} time: 00:13:46 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705987/ [6705988] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} time: 00:44:00 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705988/ [6705989] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} time: 01:00:04 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705989/ [6705991] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:09:14 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705991/ [6705992] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:40:44 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705992/ [6705993] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:19:26 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705993/ [6705994] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:48:25 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705994/ [6705995] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 00:37:53 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705995/ [6705996] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:21:21 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705996/ [6705997] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} time: 00:57:23 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705997/ [6705998] rbd/singleton/{all/rbd_mirror objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} time: 00:43:45 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705998/ [6705999] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:52:04 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6705999/ [6706000] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:38:39 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706000/ [6706001] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:47:58 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706001/ [6706002] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} time: 00:30:50 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706002/ [6706003] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:47:24 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706003/ [6706004] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror} time: 00:57:19 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706004/ [6706005] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:49:15 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706005/ [6706006] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} time: 00:15:54 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706006/ [6706007] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:58:47 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706007/ [6706009] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} time: 00:11:10 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706009/ [6706010] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} time: 00:41:03 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706010/ [6706011] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:19:46 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706011/ [6706012] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:46:39 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706012/ [6706015] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:23:09 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706015/ [6706016] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:46:33 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706016/ [6706017] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:19:56 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706017/ [6706018] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 00:38:57 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706018/ [6706019] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}} time: 00:45:46 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706019/ [6706020] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:53:19 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706020/ [6706022] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} time: 00:27:53 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706022/ [6706023] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} time: 00:37:10 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706023/ [6706025] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:46:12 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706025/ [6706026] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} time: 00:31:07 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706026/ [6706027] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/rbd_mirror} time: 00:55:50 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706027/ [6706028] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} time: 00:28:09 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706028/ [6706029] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:51:20 info: http://pulpito.ceph.com/mrfreezeex-2022-02-25_16:57:19-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6706029/