2020-05-04T18:01:50.887 INFO:root:teuthology version: 1.0.0-58684fc5
2020-05-04T18:01:50.889 INFO:teuthology.results:seed: '7328'
2020-05-04T18:49:05.390 INFO:root:teuthology version: 1.0.0-58684fc5
2020-05-04T18:49:05.411 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-05-04T20:35:07.803 INFO:teuthology.results:Tests finished! gathering results...
2020-05-04T20:35:07.964 INFO:teuthology.results:Sending results to to.my.trociny@gmail.com: Test Run: trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/
failed:  5
dead:    0
running: 0
waiting: 0
queued:  0
passed:  75


Fail
=================================================================
[5022488]  rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-snapshot-workunit-journaling.yaml}
-----------------------------------------------------------------
time:   00:22:03
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022488/
log:    http://qa-proxy.ceph.com/teuthology/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022488/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=be80779159674a01ae15169baf0a41c9

    Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi192 with
    status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ec2fcf3035c95cff15c99cfb6c8cf268b299f704
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ARGS=\'\'
    RBD_IMAGE_FEATURES=layering,exclusive-lock,journaling
    RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4
    RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

[5022492]  rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-workunit-config-key.yaml}
-----------------------------------------------------------------
time:   00:14:49
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022492/
log:    http://qa-proxy.ceph.com/teuthology/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022492/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=a3e91f94a1524389822031e311a063d3

    Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi005 with
    status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ec2fcf3035c95cff15c99cfb6c8cf268b299f704
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ARGS=\'\'
    RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4
    RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

[5022505]  rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-snapshot-workunit-journaling.yaml}
-----------------------------------------------------------------
time:   00:15:24
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022505/
log:    http://qa-proxy.ceph.com/teuthology/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022505/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=51360138f1544014b9f1d196b27d473a

    Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi123 with
    status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd --
    /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ec2fcf3035c95cff15c99cfb6c8cf268b299f704
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1"
    CEPH_ID="mirror" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror
    CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ARGS=\'\'
    RBD_IMAGE_FEATURES=layering,exclusive-lock,journaling
    RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4
    RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

[5022506]  rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-snapshot-workunit-minimum.yaml}
-----------------------------------------------------------------
time:   00:16:05
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022506/
log:    http://qa-proxy.ceph.com/teuthology/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022506/

    "2020-05-04T18:30:13.427138+0000 mon.a (mon.0) 183 : cluster [WRN] Health
    check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5022542]  rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml}
-----------------------------------------------------------------
time:   00:19:08
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022542/
log:    http://qa-proxy.ceph.com/teuthology/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022542/

    "2020-05-04T18:55:08.114142+0000 mon.a (mon.0) 231 : cluster [WRN] Health
    check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering
    (PG_AVAILABILITY)" in cluster log



Pass
=================================================================
[5022482] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-bootstrap-workunit.yaml}
time:   00:13:04
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022482/

[5022483] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-ha-workunit.yaml}
time:   00:19:56
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022483/

[5022484] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:35:21
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022484/

[5022485] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-snapshot-workunit-exclusive-lock.yaml}
time:   00:16:16
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022485/

[5022486] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-snapshot-workunit-fast-diff.yaml}
time:   00:19:12
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022486/

[5022487] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:20:53
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022487/

[5022489] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-snapshot-workunit-minimum.yaml}
time:   00:18:19
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022489/

[5022490] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml}
time:   00:17:58
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022490/

[5022491] rbd/singleton/{all/rbd_mirror.yaml objectstore/bluestore-comp-lz4.yaml openstack.yaml supported-random-distro$/{centos_8.yaml}}
time:   00:42:14
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022491/

[5022493] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:34:20
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022493/

[5022494] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-workunit-min-compat-client-octopus.yaml}
time:   00:21:28
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022494/

[5022495] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-workunit-policy-none.yaml}
time:   00:25:00
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022495/

[5022496] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:25:30
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022496/

[5022497] rbd/valgrind/{base/install.yaml centos_latest.yaml clusters/{fixed-1.yaml openstack.yaml} objectstore/bluestore-stupid.yaml validator/memcheck.yaml workloads/rbd_mirror.yaml}
time:   02:15:18
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022497/

[5022498] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-workunit-policy-simple.yaml}
time:   00:24:44
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022498/

[5022499] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-bootstrap-workunit.yaml}
time:   00:10:58
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022499/

[5022500] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-ha-workunit.yaml}
time:   00:18:37
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022500/

[5022501] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:34:41
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022501/

[5022502] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-snapshot-workunit-exclusive-lock.yaml}
time:   00:19:40
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022502/

[5022503] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-snapshot-workunit-fast-diff.yaml}
time:   00:17:25
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022503/

[5022504] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:19:12
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022504/

[5022507] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:26:20
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022507/

[5022508] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml}
time:   00:20:55
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022508/

[5022509] rbd/singleton/{all/rbd_mirror.yaml objectstore/bluestore-bitmap.yaml openstack.yaml supported-random-distro$/{ubuntu_latest.yaml}}
time:   00:41:32
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022509/

[5022510] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-workunit-config-key.yaml}
time:   00:25:31
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022510/

[5022511] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-workunit-min-compat-client-octopus.yaml}
time:   00:21:30
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022511/

[5022512] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-workunit-policy-none.yaml}
time:   00:23:03
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022512/

[5022513] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:33:39
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022513/

[5022514] rbd/valgrind/{base/install.yaml centos_latest.yaml clusters/{fixed-1.yaml openstack.yaml} objectstore/bluestore-low-osd-mem-target.yaml validator/memcheck.yaml workloads/rbd_mirror.yaml}
time:   02:12:04
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022514/

[5022515] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-workunit-policy-simple.yaml}
time:   00:26:42
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022515/

[5022516] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-bootstrap-workunit.yaml}
time:   00:13:18
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022516/

[5022517] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:23:50
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022517/

[5022518] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-ha-workunit.yaml}
time:   00:20:09
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022518/

[5022519] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-snapshot-workunit-exclusive-lock.yaml}
time:   00:17:30
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022519/

[5022520] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-snapshot-workunit-fast-diff.yaml}
time:   00:20:34
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022520/

[5022521] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:31:03
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022521/

[5022522] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-snapshot-workunit-journaling.yaml}
time:   00:21:00
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022522/

[5022523] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-snapshot-workunit-minimum.yaml}
time:   00:20:34
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022523/

[5022524] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:24:28
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022524/

[5022525] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml}
time:   00:20:14
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022525/

[5022526] rbd/singleton/{all/rbd_mirror.yaml objectstore/filestore-xfs.yaml openstack.yaml supported-random-distro$/{centos_8.yaml}}
time:   00:43:08
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022526/

[5022527] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-workunit-config-key.yaml}
time:   00:21:13
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022527/

[5022528] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-workunit-min-compat-client-octopus.yaml}
time:   00:20:52
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022528/

[5022529] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-workunit-policy-none.yaml}
time:   00:25:56
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022529/

[5022530] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:34:51
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022530/

[5022531] rbd/valgrind/{base/install.yaml centos_latest.yaml clusters/{fixed-1.yaml openstack.yaml} objectstore/bluestore-hybrid.yaml validator/memcheck.yaml workloads/rbd_mirror.yaml}
time:   01:11:30
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022531/

[5022532] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-workunit-policy-simple.yaml}
time:   00:25:36
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022532/

[5022533] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-bootstrap-workunit.yaml}
time:   00:14:38
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022533/

[5022534] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:33:11
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022534/

[5022535] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-ha-workunit.yaml}
time:   00:19:45
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022535/

[5022536] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:24:56
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022536/

[5022537] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-snapshot-workunit-exclusive-lock.yaml}
time:   00:17:34
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022537/

[5022538] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-snapshot-workunit-fast-diff.yaml}
time:   00:16:36
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022538/

[5022539] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-snapshot-workunit-journaling.yaml}
time:   00:19:13
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022539/

[5022540] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-snapshot-workunit-minimum.yaml}
time:   00:17:44
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022540/

[5022541] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:36:31
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022541/

[5022543] rbd/singleton/{all/rbd_mirror.yaml objectstore/bluestore-stupid.yaml openstack.yaml supported-random-distro$/{ubuntu_latest.yaml}}
time:   00:45:56
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022543/

[5022544] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-workunit-config-key.yaml}
time:   00:22:42
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022544/

[5022545] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:21:00
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022545/

[5022546] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-workunit-min-compat-client-octopus.yaml}
time:   00:23:54
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022546/

[5022547] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-workunit-policy-none.yaml}
time:   00:21:41
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022547/

[5022548] rbd/valgrind/{base/install.yaml centos_latest.yaml clusters/{fixed-1.yaml openstack.yaml} objectstore/bluestore-comp-zstd.yaml validator/memcheck.yaml workloads/rbd_mirror.yaml}
time:   01:32:05
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022548/

[5022549] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-workunit-policy-simple.yaml}
time:   00:23:31
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022549/

[5022550] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-bootstrap-workunit.yaml}
time:   00:12:32
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022550/

[5022551] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:35:51
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022551/

[5022552] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-ha-workunit.yaml}
time:   00:19:21
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022552/

[5022553] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-stress-workunit.yaml}
time:   00:25:35
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022553/

[5022554] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-snapshot-workunit-exclusive-lock.yaml}
time:   00:19:56
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022554/

[5022555] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-snapshot-workunit-fast-diff.yaml}
time:   00:18:16
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022555/

[5022556] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-snapshot-workunit-journaling.yaml}
time:   00:22:07
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022556/

[5022557] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-snapshot-workunit-minimum.yaml}
time:   00:20:03
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022557/

[5022558] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{rhel_8.yaml} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml}
time:   00:22:04
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022558/

[5022559] rbd/singleton/{all/rbd_mirror.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml supported-random-distro$/{ubuntu_latest.yaml}}
time:   00:44:19
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022559/

[5022560] rbd/mirror/{base/install.yaml clients/{mirror-extra.yaml mirror.yaml} cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-workunit-config-key.yaml}
time:   00:23:53
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022560/

[5022561] rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_8.yaml} workloads/rbd-mirror-journal-workunit.yaml}
time:   00:32:07
info:   http://pulpito.ceph.com/trociny-2020-05-04_15:46:48-rbd-master-distro-basic-smithi/5022561/
2020-05-04T20:35:08.102 INFO:teuthology.results:starting coverage generation
2020-05-04T20:35:08.110 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main
    int(args['--timeout']), args['--dry-run'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results
    generate_coverage(archive_dir, name)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage
    archive_dir,
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'