2020-12-15T15:20:10.398 INFO:root:teuthology version: 1.0.0-8e55e2ff 2020-12-15T15:20:10.400 INFO:teuthology.results:seed: '6269' 2020-12-15T15:52:07.149 INFO:root:teuthology version: 1.0.0-8e55e2ff 2020-12-15T15:52:07.194 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-12-15T16:34:07.971 INFO:teuthology.results:Tests finished! gathering results... 2020-12-15T16:34:11.939 INFO:scrape:Found 36 jobs 2020-12-15T16:34:12.155 INFO:scrape:Found 1 distinct failure reasons 2020-12-15T16:34:12.156 INFO:scrape:Failure: "2020-12-15T15:56:34.173467+0000 mon.a (mon.0) 234 : cluster [WRN] Health check failed: Degraded data redundancy: 3/202 objects degraded (1.485%), 1 pg degraded (PG_DEGRADED)" in cluster log 2020-12-15T16:34:12.156 INFO:scrape:1 jobs: ['5710655'] 2020-12-15T16:34:12.157 INFO:scrape:suites: ['clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'openstack}', 'rbd/mirror/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-workunit-exclusive-lock}'] 2020-12-15T16:34:12.157 INFO:scrape: 2020-12-15T16:34:12.159 INFO:teuthology.results:Sending results to to.my.trociny@gmail.com: Test Run: trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/ failed: 1 dead: 0 running: 0 waiting: 0 queued: 0 passed: 35 Fail ================================================================= [5710655] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:15:06 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710655/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710655/ "2020-12-15T15:56:34.173467+0000 mon.a (mon.0) 234 : cluster [WRN] Health check failed: Degraded data redundancy: 3/202 objects degraded (1.485%), 1 pg degraded (PG_DEGRADED)" in cluster log Pass ================================================================= [5710631] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:17:33 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710631/ [5710632] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:15:19 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710632/ [5710633] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:17:45 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710633/ [5710634] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:16:55 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710634/ [5710635] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:17:20 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710635/ [5710636] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:15:38 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710636/ [5710637] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:17:31 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710637/ [5710638] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:14:56 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710638/ [5710639] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:17:53 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710639/ [5710640] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:18:18 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710640/ [5710641] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:17:02 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710641/ [5710642] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:15:02 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710642/ [5710643] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:17:26 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710643/ [5710644] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:17:17 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710644/ [5710645] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:16:54 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710645/ [5710646] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:17:30 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710646/ [5710647] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:15:48 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710647/ [5710648] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:14:45 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710648/ [5710649] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:15:08 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710649/ [5710650] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:17:45 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710650/ [5710651] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:15:45 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710651/ [5710652] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:18:18 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710652/ [5710653] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:17:57 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710653/ [5710654] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:14:53 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710654/ [5710656] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:19:00 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710656/ [5710657] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:15:07 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710657/ [5710658] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:19:01 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710658/ [5710659] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:17:35 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710659/ [5710660] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:15:33 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710660/ [5710661] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:17:18 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710661/ [5710662] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:18:17 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710662/ [5710663] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:17:34 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710663/ [5710664] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:15:04 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710664/ [5710665] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:17:16 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710665/ [5710666] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:17:17 info: http://pulpito.ceph.com/trociny-2020-12-15_15:17:28-rbd-wip-mgolub-testing-distro-basic-smithi/5710666/