2020-04-12T23:40:11.678 INFO:root:teuthology version: 1.0.0-df3de94
2020-04-12T23:40:11.678 INFO:teuthology.results:seed: '2483'
2020-04-13T00:54:36.790 INFO:root:teuthology version: 1.0.0-df3de94
2020-04-13T00:54:36.987 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-04-13T05:56:43.007 INFO:teuthology.results:Tests finished! gathering results...
2020-04-13T05:56:43.152 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/
failed:  6
dead:    0
running: 0
waiting: 0
queued:  0
passed:  90


Fail
=================================================================
[4944357]  krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_kernel_untar_build.yaml}
-----------------------------------------------------------------
time:   00:17:12
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944357/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944357/

    "2020-04-13T01:57:06.302897+0000 osd.3 (osd.3) 3 : cluster [WRN] slow
    request osd_op(client.4280.0:4672 2.5
    2:a1b33078:::rbd_data.10b57f604d56.0000000000000687:head [set-alloc-hint
    object_size 4194304 write_size 4194304,write 1892352~36864 in=36864b] snapc
    0=[] RETRY=3 ondisk+retry+write+known_if_redirected e23) initiated
    2020-04-13T01:56:36.248085+0000 currently commit sent; apply or cleanup" in
    cluster log

[4944400]  krbd/singleton/{bluestore-bitmap.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_xfstests.yaml}
-----------------------------------------------------------------
time:   04:32:04
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944400/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944400/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=ceeed1add8494d288b335df3a2ab7fa4

    Command failed on smithi203 with status 2: "/usr/bin/sudo
    TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage /bin/bash
    /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s
    /dev/rbd1 -x /tmp/exclude0FW5z1 -r -- '-g auto -g blockdev -x clone'"

[4944351]  krbd/singleton/{bluestore-bitmap.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_xfstests.yaml}
-----------------------------------------------------------------
time:   03:36:04
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944351/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944351/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=758b411b16374a8cadd4a786507d43a2

    Command failed on smithi066 with status 2: "/usr/bin/sudo
    TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage /bin/bash
    /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s
    /dev/rbd1 -x /tmp/excludeMpeLpY -r -- '-g auto -g blockdev -x clone'"

[4944411]  krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_fio.yaml}
-----------------------------------------------------------------
time:   00:51:38
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944411/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944411/

    "2020-04-13T00:52:37.820091+0000 mon.a (mon.0) 135 : cluster [WRN] Health
    check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

[4944441]  krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml}
-----------------------------------------------------------------
time:   00:28:29
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944441/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944441/

    "2020-04-13T01:33:04.571781+0000 mon.b (mon.0) 461 : cluster [WRN] Health
    check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

[4944364]  krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml}
-----------------------------------------------------------------
time:   00:48:33
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944364/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944364/

    "2020-04-13T00:11:21.977295+0000 mon.a (mon.0) 187 : cluster [WRN] Health
    check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log



Pass
=================================================================
[4944404] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_kernel_untar_build.yaml}
time:   00:16:58
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944404/

[4944405] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_fallocate.yaml}
time:   00:12:35
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944405/

[4944406] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml}
time:   00:34:53
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944406/

[4944407] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_huge_osdmap.yaml}
time:   00:11:57
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944407/

[4944401] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml}
time:   00:58:32
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944401/

[4944402] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_exclusive_option.yaml}
time:   00:13:32
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944402/

[4944403] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml}
time:   00:40:50
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944403/

[4944408] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_dbench.yaml}
time:   00:41:06
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944408/

[4944409] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_parent_overlap.yaml}
time:   00:10:28
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944409/

[4944390] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_snapshot_io.yaml}
time:   00:10:44
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944390/

[4944391] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml}
time:   01:00:07
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944391/

[4944392] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_unmap.yaml}
time:   00:16:04
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944392/

[4944393] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_trivial_sync.yaml}
time:   00:11:09
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944393/

[4944394] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml}
time:   00:30:02
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944394/

[4944395] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_simple_big.yaml}
time:   00:25:48
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944395/

[4944396] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_msgr_segments.yaml}
time:   00:09:21
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944396/

[4944397] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml}
time:   00:29:16
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944397/

[4944398] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_fio.yaml}
time:   00:37:20
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944398/

[4944399] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_data_pool.yaml}
time:   00:30:41
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944399/

[4944431] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_image_read.yaml}
time:   00:11:50
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944431/

[4944430] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsx.yaml}
time:   00:18:36
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944430/

[4944433] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_whole_object_zeroout.yaml}
time:   00:10:05
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944433/

[4944432] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kernel.yaml}
time:   00:10:56
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944432/

[4944435] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_fio.yaml}
time:   00:49:48
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944435/

[4944434] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml}
time:   00:25:13
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944434/

[4944437] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_snapshot_io.yaml}
time:   00:10:45
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944437/

[4944436] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_iozone.yaml}
time:   00:13:37
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944436/

[4944439] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_unmap.yaml}
time:   00:15:53
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944439/

[4944438] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml}
time:   00:31:35
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944438/

[4944347] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_deep_flatten.yaml}
time:   00:11:05
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944347/

[4944440] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_trivial_sync.yaml}
time:   00:11:19
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944440/

[4944428] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_huge_tickets.yaml}
time:   00:11:07
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944428/

[4944429] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml}
time:   00:31:33
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944429/

[4944426] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml}
time:   00:11:07
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944426/

[4944427] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml}
time:   00:33:34
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944427/

[4944424] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml}
time:   00:56:25
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944424/

[4944425] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_concurrent.yaml}
time:   00:17:36
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944425/

[4944422] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_read_only.yaml}
time:   00:10:38
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944422/

[4944423] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml}
time:   00:28:35
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944423/

[4944349] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_fio.yaml}
time:   00:32:09
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944349/

[4944348] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml}
time:   00:26:14
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944348/

[4944354] krbd/wac/sysfs/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/stable_pages_required.yaml}
time:   00:09:41
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944354/

[4944355] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_exclusive_option.yaml}
time:   00:13:47
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944355/

[4944356] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml}
time:   01:17:44
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944356/

[4944350] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_data_pool.yaml}
time:   00:23:02
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944350/

[4944352] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_fio.yaml}
time:   00:53:53
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944352/

[4944353] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/pre-single-major.yaml tasks/unmap.yaml}
time:   00:09:58
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944353/

[4944358] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_fallocate.yaml}
time:   00:12:02
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944358/

[4944359] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml}
time:   00:29:22
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944359/

[4944361] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_dbench.yaml}
time:   00:41:13
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944361/

[4944360] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_huge_osdmap.yaml}
time:   00:12:10
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944360/

[4944363] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml}
time:   00:28:00
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944363/

[4944362] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_discard.yaml}
time:   00:11:24
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944362/

[4944365] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_latest_osdmap_on_map.yaml}
time:   00:15:43
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944365/

[4944367] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_ffsb.yaml}
time:   01:15:27
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944367/

[4944366] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml}
time:   00:35:14
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944366/

[4944369] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_enumerate.yaml}
time:   00:24:29
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944369/

[4944368] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_namespaces.yaml}
time:   00:13:52
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944368/

[4944442] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_simple_big.yaml}
time:   00:27:21
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944442/

[4944378] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml}
time:   00:30:12
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944378/

[4944379] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_huge_tickets.yaml}
time:   00:11:17
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944379/

[4944376] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_concurrent.yaml}
time:   00:17:12
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944376/

[4944377] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml}
time:   00:11:36
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944377/

[4944374] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml}
time:   00:26:36
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944374/

[4944375] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_fio.yaml}
time:   00:54:48
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944375/

[4944372] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_netlink_enobufs.yaml}
time:   00:16:09
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944372/

[4944373] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_huge_image.yaml}
time:   00:09:33
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944373/

[4944370] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml}
time:   00:28:06
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944370/

[4944371] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress.yaml}
time:   00:11:38
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944371/

[4944420] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress.yaml}
time:   00:11:52
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944420/

[4944421] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_netlink_enobufs.yaml}
time:   00:16:07
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944421/

[4944417] krbd/wac/wac/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/no-resets.yaml}
time:   00:24:11
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944417/

[4944416] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-on.yaml tasks/unmap.yaml}
time:   00:09:54
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944416/

[4944415] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_namespaces.yaml}
time:   00:13:19
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944415/

[4944414] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_ffsb.yaml}
time:   01:01:14
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944414/

[4944413] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml}
time:   00:36:45
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944413/

[4944412] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_latest_osdmap_on_map.yaml}
time:   00:16:43
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944412/

[4944410] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml}
time:   00:24:06
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944410/

[4944419] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml}
time:   00:29:00
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944419/

[4944418] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_enumerate.yaml}
time:   00:30:07
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944418/

[4944383] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-off.yaml tasks/unmap.yaml}
time:   00:10:03
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944383/

[4944382] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_image_read.yaml}
time:   00:11:39
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944382/

[4944381] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsx.yaml}
time:   00:17:45
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944381/

[4944380] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml}
time:   00:29:58
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944380/

[4944387] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml}
time:   00:27:59
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944387/

[4944386] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_modprobe.yaml}
time:   00:09:18
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944386/

[4944385] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kernel.yaml}
time:   00:11:00
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944385/

[4944384] krbd/wac/wac/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/many-resets.yaml}
time:   00:23:41
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944384/

[4944389] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_iozone.yaml}
time:   00:14:12
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944389/

[4944388] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml}
time:   01:01:41
info:   http://pulpito.ceph.com/teuthology-2020-04-11_03:20:02-krbd-master-testing-basic-smithi/4944388/
2020-04-13T05:56:43.247 INFO:teuthology.results:starting coverage generation
2020-04-13T05:56:43.263 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main
    int(args['--timeout']), args['--dry-run'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results
    generate_coverage(archive_dir, name)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage
    archive_dir,
  File "/usr/lib/python2.7/subprocess.py", line 711, in __init__
    errread, errwrite)
  File "/usr/lib/python2.7/subprocess.py", line 1343, in _execute_child
    raise child_exception
OSError: [Errno 2] No such file or directory