2020-05-04T17:37:18.994 INFO:root:teuthology version: 1.0.0-58684fc5
2020-05-04T17:37:18.997 INFO:teuthology.results:seed: '1110'
2020-05-04T18:01:50.675 INFO:root:teuthology version: 1.0.0-58684fc5
2020-05-04T18:01:50.687 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-05-05T05:44:05.341 INFO:teuthology.results:Tests finished! gathering results...
2020-05-05T05:44:05.460 INFO:teuthology.results:Sending results to to.my.trociny@gmail.com: Test Run: trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/
failed:  5
dead:    0
running: 0
waiting: 0
queued:  0
passed:  55


Fail
=================================================================
[5022359]  rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-snapshot-workunit-minimum.yaml}
-----------------------------------------------------------------
time:   11:54:01
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022359/
log:    http://qa-proxy.ceph.com/teuthology/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022359/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=c840a932a00246b3bc55c4665aba02ce

    psutil.NoSuchProcess process no longer exists (pid=19894)

[5022367]  rbd/valgrind/{base/install.yaml centos_latest.yaml clusters/{fixed-1.yaml openstack.yaml} objectstore/bluestore-stupid.yaml validator/memcheck.yaml workloads/rbd_mirror.yaml}
-----------------------------------------------------------------
time:   01:09:01
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022367/
log:    http://qa-proxy.ceph.com/teuthology/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022367/

    "2020-05-04T18:39:20.489118+0000 mon.a (mon.0) 1621 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5022375]  rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-snapshot-workunit-journaling.yaml}
-----------------------------------------------------------------
time:   00:17:46
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022375/
log:    http://qa-proxy.ceph.com/teuthology/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022375/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=b9c755f5432c43e899df4bb7882a1708

    Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi039 with
    status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=911bc6d63076ad26f575cda52fe9f54913dc3ed8
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ARGS=\'\'
    RBD_IMAGE_FEATURES=layering,exclusive-lock,journaling
    RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4
    RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

[5022385]  rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-workunit-policy-simple.yaml}
-----------------------------------------------------------------
time:   00:21:42
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022385/
log:    http://qa-proxy.ceph.com/teuthology/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022385/

    "2020-05-04T18:05:22.607800+0000 mon.a (mon.0) 168 : cluster [WRN] Health
    check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5022410]  rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-snapshot-workunit-minimum.yaml}
-----------------------------------------------------------------
time:   00:20:58
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022410/
log:    http://qa-proxy.ceph.com/teuthology/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022410/

    "2020-05-04T18:20:17.174157+0000 mon.a (mon.0) 187 : cluster [WRN] Health
    check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering
    (PG_AVAILABILITY)" in cluster log



Pass
=================================================================
[5022352] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-bootstrap-workunit.yaml}
time:   00:11:56
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022352/

[5022353] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-ha-workunit.yaml}
time:   00:17:17
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022353/

[5022354] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:34:11
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022354/

[5022355] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-snapshot-workunit-exclusive-lock.yaml}
time:   00:18:03
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022355/

[5022356] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-snapshot-workunit-fast-diff.yaml}
time:   00:19:39
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022356/

[5022357] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:22:48
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022357/

[5022358] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-snapshot-workunit-journaling.yaml}
time:   00:20:58
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022358/

[5022360] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml}
time:   00:20:39
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022360/

[5022361] rbd/singleton/{all/rbd_mirror.yaml objectstore/bluestore-comp-lz4.yaml openstack.yaml supported-random-distro$/{centos_8.yaml}}
time:   00:42:58
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022361/

[5022362] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-workunit-config-key.yaml}
time:   00:22:42
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022362/

[5022363] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:32:20
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022363/

[5022364] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-workunit-min-compat-client-octopus.yaml}
time:   00:24:18
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022364/

[5022365] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-workunit-policy-none.yaml}
time:   00:21:06
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022365/

[5022366] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:20:01
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022366/

[5022368] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-workunit-policy-simple.yaml}
time:   00:22:14
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022368/

[5022369] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-bootstrap-workunit.yaml}
time:   00:09:41
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022369/

[5022370] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-ha-workunit.yaml}
time:   00:18:02
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022370/

[5022371] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:32:17
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022371/

[5022372] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-snapshot-workunit-exclusive-lock.yaml}
time:   00:20:18
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022372/

[5022373] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-snapshot-workunit-fast-diff.yaml}
time:   00:15:50
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022373/

[5022374] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:18:48
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022374/

[5022376] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-snapshot-workunit-minimum.yaml}
time:   00:18:28
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022376/

[5022377] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:26:00
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022377/

[5022378] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml}
time:   00:19:02
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022378/

[5022379] rbd/singleton/{all/rbd_mirror.yaml objectstore/bluestore-bitmap.yaml openstack.yaml supported-random-distro$/{ubuntu_latest.yaml}}
time:   00:42:55
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022379/

[5022380] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-workunit-config-key.yaml}
time:   00:25:51
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022380/

[5022381] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-workunit-min-compat-client-octopus.yaml}
time:   00:21:17
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022381/

[5022382] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-workunit-policy-none.yaml}
time:   00:22:19
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022382/

[5022383] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:33:28
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022383/

[5022384] rbd/valgrind/{base/install.yaml centos_latest.yaml clusters/{fixed-1.yaml openstack.yaml} objectstore/bluestore-low-osd-mem-target.yaml validator/memcheck.yaml workloads/rbd_mirror.yaml}
time:   01:05:27
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022384/

[5022386] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-bootstrap-workunit.yaml}
time:   00:13:01
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022386/

[5022387] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:21:43
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022387/

[5022388] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-ha-workunit.yaml}
time:   00:19:58
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022388/

[5022389] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-snapshot-workunit-exclusive-lock.yaml}
time:   00:17:40
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022389/

[5022390] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-snapshot-workunit-fast-diff.yaml}
time:   00:16:25
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022390/

[5022391] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:33:09
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022391/

[5022392] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-snapshot-workunit-journaling.yaml}
time:   00:20:37
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022392/

[5022393] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-snapshot-workunit-minimum.yaml}
time:   00:19:14
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022393/

[5022394] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:23:54
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022394/

[5022395] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml}
time:   00:20:00
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022395/

[5022396] rbd/singleton/{all/rbd_mirror.yaml objectstore/filestore-xfs.yaml openstack.yaml supported-random-distro$/{rhel_8.yaml}}
time:   00:45:56
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022396/

[5022397] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-workunit-config-key.yaml}
time:   00:26:32
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022397/

[5022398] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-workunit-min-compat-client-octopus.yaml}
time:   00:25:26
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022398/

[5022399] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-workunit-policy-none.yaml}
time:   00:23:19
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022399/

[5022400] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:32:53
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022400/

[5022401] rbd/valgrind/{base/install.yaml centos_latest.yaml clusters/{fixed-1.yaml openstack.yaml} objectstore/bluestore-hybrid.yaml validator/memcheck.yaml workloads/rbd_mirror.yaml}
time:   01:11:43
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022401/

[5022402] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-workunit-policy-simple.yaml}
time:   00:22:10
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022402/

[5022403] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-bootstrap-workunit.yaml}
time:   00:14:02
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022403/

[5022404] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:33:10
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022404/

[5022405] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-ha-workunit.yaml}
time:   00:19:24
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022405/

[5022406] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:23:47
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022406/

[5022407] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-snapshot-workunit-exclusive-lock.yaml}
time:   00:19:18
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022407/

[5022408] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-snapshot-workunit-fast-diff.yaml}
time:   00:18:00
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022408/

[5022409] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-snapshot-workunit-journaling.yaml}
time:   00:20:51
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022409/

[5022411] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:34:56
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:15:03-rbd-wip-mgolub-testing-distro-basic-smithi/5022411/
2020-05-05T05:44:05.602 INFO:teuthology.results:starting coverage generation
2020-05-05T05:44:05.614 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main
    int(args['--timeout']), args['--dry-run'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results
    generate_coverage(archive_dir, name)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage
    archive_dir,
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'