2020-01-04T01:00:50.474 INFO:root:teuthology version: 1.0.0-ebb2eff
2020-01-04T01:00:50.474 INFO:teuthology.results:subset: '1/2'
2020-01-04T01:00:50.474 INFO:teuthology.results:seed: '3349'
2020-01-04T01:54:52.047 INFO:root:teuthology version: 1.0.0-ebb2eff
2020-01-04T01:54:52.085 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-01-04T05:17:55.975 INFO:teuthology.results:Tests finished! gathering results...
2020-01-04T05:17:56.134 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/
failed:  42
dead:    0
running: 0
waiting: 0
queued:  0
passed:  38


Fail
=================================================================
[4637818]  fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/admin.yaml}
-----------------------------------------------------------------
time:   00:19:23
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637818/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637818/

    "2020-01-04T01:22:25.409721+0000 mon.b (mon.0) 696 : cluster [WRN] Health
    check failed: insufficient standby MDS daemons available
    (MDS_INSUFFICIENT_STANDBY)" in cluster log

[4637819]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_ffsb.yaml}
-----------------------------------------------------------------
time:   00:47:14
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637819/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637819/

    "2020-01-04T01:34:04.399081+0000 mon.b (mon.0) 150 : cluster [WRN] Health
    check failed: 3 slow ops, oldest one blocked for 181 sec, osd.4 has slow
    ops (SLOW_OPS)" in cluster log

[4637815]  fs/multiclient/{begin.yaml clusters/1-mds-3-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} distros/ubuntu_latest.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cephfs_misc_tests.yaml}
-----------------------------------------------------------------
time:   00:12:56
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637815/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637815/

    Test failure: test_drop_cache_command_dead
    (tasks.cephfs.test_misc.TestCacheDrop)

[4637817]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_misc.yaml}
-----------------------------------------------------------------
time:   03:18:40
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637817/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637817/

    Command failed (workunit test fs/misc/filelock_interrupt.py) on smithi046
    with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/fs/misc/filelock_interrupt.py'

[4637874]  fs/verify/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:06:08
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637874/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637874/

    Command failed on smithi182 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-
    object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-
    base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo
    ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo
    libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-
    debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-
    debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo
    python3-cephfs bison flex elfutils-libelf-devel openssl-devel libaio-devel
    libtool bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool
    bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool bison
    flex elfutils-libelf-devel openssl-devel libaio-devel libtool'

[4637851]  fs/verify/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:06:15
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637851/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637851/

    Command failed on smithi097 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-
    object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-
    base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo
    ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo
    libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-
    debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-
    debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo
    python3-cephfs bison flex elfutils-libelf-devel openssl-devel libaio-devel
    libtool bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool
    bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool bison
    flex elfutils-libelf-devel openssl-devel libaio-devel libtool'

[4637868]  fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cephfs_scrub_tests.yaml}
-----------------------------------------------------------------
time:   00:13:00
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637868/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637868/

    Test failure: test_scrub_abort
    (tasks.cephfs.test_scrub_checks.TestScrubControls)

[4637841]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_suites_iozone.yaml}
-----------------------------------------------------------------
time:   00:09:57
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637841/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637841/

    Command failed (workunit test suites/iozone.sh) on smithi081 with status
    127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh'

[4637840]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_fsx.yaml}
-----------------------------------------------------------------
time:   00:10:37
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637840/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637840/

    Command failed (workunit test suites/fsx.sh) on smithi053 with status 2:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh'

[4637846]  fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/strays.yaml}
-----------------------------------------------------------------
time:   00:15:12
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637846/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637846/

    Test failure: test_files_throttle (tasks.cephfs.test_strays.TestStrays)

[4637845]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_misc.yaml}
-----------------------------------------------------------------
time:   03:16:57
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637845/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637845/

    Command failed (workunit test fs/misc/filelock_interrupt.py) on smithi037
    with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/fs/misc/filelock_interrupt.py'

[4637844]  fs/multiclient/{begin.yaml clusters/1-mds-3-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} distros/ubuntu_latest.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cephfs_misc_tests.yaml}
-----------------------------------------------------------------
time:   00:12:46
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637844/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637844/

    Test failure: test_drop_cache_command_dead
    (tasks.cephfs.test_misc.TestCacheDrop)

[4637854]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_ffsb.yaml}
-----------------------------------------------------------------
time:   00:50:19
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637854/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637854/

    "2020-01-04T01:59:32.193993+0000 mon.b (mon.0) 148 : cluster [WRN] Health
    check failed: 1 slow ops, oldest one blocked for 180 sec, osd.4 has slow
    ops (SLOW_OPS)" in cluster log

[4637849]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_iozone.yaml}
-----------------------------------------------------------------
time:   00:09:31
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637849/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637849/

    Command failed (workunit test suites/iozone.sh) on smithi064 with status
    127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh'

[4637866]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_misc.yaml}
-----------------------------------------------------------------
time:   03:17:02
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637866/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637866/

    Command failed (workunit test fs/misc/filelock_interrupt.py) on smithi173
    with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/fs/misc/filelock_interrupt.py'

[4637855]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_fsx.yaml}
-----------------------------------------------------------------
time:   00:10:48
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637855/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637855/

    Command failed (workunit test suites/fsx.sh) on smithi170 with status 2:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh'

[4637875]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_misc.yaml}
-----------------------------------------------------------------
time:   03:18:51
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637875/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637875/

    Command failed (workunit test fs/misc/filelock_interrupt.py) on smithi103
    with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/fs/misc/filelock_interrupt.py'

[4637820]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_fsx.yaml}
-----------------------------------------------------------------
time:   00:11:02
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637820/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637820/

    Command failed (workunit test suites/fsx.sh) on smithi172 with status 2:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh'

[4637823]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_iozone.yaml}
-----------------------------------------------------------------
time:   00:09:40
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637823/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637823/

    Command failed (workunit test suites/iozone.sh) on smithi064 with status
    127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh'

[4637825]  fs/verify/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:06:18
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637825/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637825/

    Command failed on smithi137 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-
    object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-
    base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo
    ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo
    libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-
    debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-
    debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo
    python3-cephfs bison flex elfutils-libelf-devel openssl-devel libaio-devel
    libtool bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool
    bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool bison
    flex elfutils-libelf-devel openssl-devel libaio-devel libtool'

[4637827]  fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cephfs_scrub_tests.yaml}
-----------------------------------------------------------------
time:   00:14:41
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637827/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637827/

    Test failure: test_scrub_abort
    (tasks.cephfs.test_scrub_checks.TestScrubControls)

[4637826]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_misc.yaml}
-----------------------------------------------------------------
time:   03:17:27
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637826/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637826/

    Command failed (workunit test fs/misc/filelock_interrupt.py) on smithi146
    with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/fs/misc/filelock_interrupt.py'

[4637884]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_misc.yaml}
-----------------------------------------------------------------
time:   03:17:50
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637884/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637884/

    Command failed (workunit test fs/misc/filelock_interrupt.py) on smithi170
    with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/fs/misc/filelock_interrupt.py'

[4637883]  fs/traceless/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_ffsb.yaml traceless/50pc.yaml}
-----------------------------------------------------------------
time:   00:46:31
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637883/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637883/

    "2020-01-04T02:13:18.070331+0000 mon.b (mon.0) 141 : cluster [WRN] Health
    check failed: 0 slow ops, oldest one blocked for 180 sec, osd.4 has slow
    ops (SLOW_OPS)" in cluster log

[4637881]  fs/multiclient/{begin.yaml clusters/1-mds-3-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} distros/ubuntu_latest.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cephfs_misc_tests.yaml}
-----------------------------------------------------------------
time:   00:12:33
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637881/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637881/

    Test failure: test_drop_cache_command_dead
    (tasks.cephfs.test_misc.TestCacheDrop)

[4637873]  fs/thrash/{begin.yaml ceph-thrash/mon.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_snaptests.yaml}
-----------------------------------------------------------------
time:   00:56:04
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637873/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637873/

    Command failed (workunit test fs/snaps/snaptest-parents.sh) on smithi181
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-
    parents.sh'

[4637879]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_suites_fsx.yaml}
-----------------------------------------------------------------
time:   00:11:58
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637879/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637879/

    Command failed (workunit test suites/fsx.sh) on smithi022 with status 2:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh'

[4637889]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_misc.yaml}
-----------------------------------------------------------------
time:   03:16:58
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637889/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637889/

    Command failed (workunit test fs/misc/filelock_interrupt.py) on smithi191
    with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/fs/misc/filelock_interrupt.py'

[4637888]  fs/verify/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:06:26
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637888/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637888/

    Command failed on smithi145 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-
    object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-
    base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo
    ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo
    libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-
    debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-
    debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo
    python3-cephfs bison flex elfutils-libelf-devel openssl-devel libaio-devel
    libtool bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool
    bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool bison
    flex elfutils-libelf-devel openssl-devel libaio-devel libtool'

[4637871]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_iozone.yaml}
-----------------------------------------------------------------
time:   00:09:24
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637871/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637871/

    Command failed (workunit test suites/iozone.sh) on smithi047 with status
    127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh'

[4637850]  fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/acls-fuse-client.yaml}
-----------------------------------------------------------------
time:   00:10:16
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637850/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637850/

    Test failure: test_acls (tasks.cephfs.test_acls.TestACLs)

[4637837]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_suites_iozone.yaml}
-----------------------------------------------------------------
time:   00:10:51
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637837/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637837/

    Command failed (workunit test suites/iozone.sh) on smithi129 with status
    127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh'

[4637852]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_misc.yaml}
-----------------------------------------------------------------
time:   03:18:50
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637852/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637852/

    Command failed (workunit test fs/misc/filelock_interrupt.py) on smithi172
    with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/fs/misc/filelock_interrupt.py'

[4637853]  fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/admin.yaml}
-----------------------------------------------------------------
time:   00:19:05
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637853/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637853/

    "2020-01-04T01:48:50.937381+0000 mon.a (mon.0) 796 : cluster [WRN] Health
    check failed: insufficient standby MDS daemons available
    (MDS_INSUFFICIENT_STANDBY)" in cluster log

[4637832]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_misc.yaml}
-----------------------------------------------------------------
time:   03:19:31
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637832/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637832/

    Command failed (workunit test fs/misc/filelock_interrupt.py) on smithi017
    with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/fs/misc/filelock_interrupt.py'

[4637833]  fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/damage.yaml}
-----------------------------------------------------------------
time:   00:13:47
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637833/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637833/

    Test failure: test_object_deletion (tasks.cephfs.test_damage.TestDamage)

[4637831]  fs/multiclient/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} distros/ubuntu_latest.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cephfs_misc_tests.yaml}
-----------------------------------------------------------------
time:   00:11:57
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637831/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637831/

    Test failure: test_drop_cache_command_dead
    (tasks.cephfs.test_misc.TestCacheDrop)

[4637859]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_iozone.yaml}
-----------------------------------------------------------------
time:   00:09:28
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637859/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637859/

    Command failed (workunit test suites/iozone.sh) on smithi129 with status
    127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh'

[4637862]  fs/multiclient/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} distros/ubuntu_latest.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cephfs_misc_tests.yaml}
-----------------------------------------------------------------
time:   00:11:52
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637862/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637862/

    Test failure: test_drop_cache_command_dead
    (tasks.cephfs.test_misc.TestCacheDrop)

[4637876]  fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/damage.yaml}
-----------------------------------------------------------------
time:   00:13:52
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637876/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637876/

    Test failure: test_object_deletion (tasks.cephfs.test_damage.TestDamage)

[4637838]  fs/verify/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:06:13
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637838/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637838/

    Command failed on smithi150 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-
    object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-
    base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo
    ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo
    libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-
    debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-
    debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo
    python3-cephfs bison flex elfutils-libelf-devel openssl-devel libaio-devel
    libtool bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool
    bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool bison
    flex elfutils-libelf-devel openssl-devel libaio-devel libtool'

[4637839]  fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_misc.yaml}
-----------------------------------------------------------------
time:   03:17:35
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637839/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637839/

    Command failed (workunit test fs/misc/filelock_interrupt.py) on smithi059
    with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ef6e2456c3e126a3ef57eca6cd233ab010e1fc57
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/fs/misc/filelock_interrupt.py'



Pass
=================================================================
[4637814] fs/32bits/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml overrides/{faked-ino.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_suites_fsstress.yaml}
time:   00:14:08
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637814/

[4637816] fs/multifs/{begin.yaml clusters/1a3s-mds-2c-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/failover.yaml}
time:   00:42:52
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637816/

[4637890] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/strays.yaml}
time:   00:32:06
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637890/

[4637891] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_fsync.yaml}
time:   00:18:54
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637891/

[4637892] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/volumes.yaml}
time:   00:58:05
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637892/

[4637893] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/volume-client/{py/3.yaml task/test/{test.yaml}}}
time:   00:24:13
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637893/

[4637878] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/data-scan.yaml}
time:   00:29:11
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637878/

[4637843] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_kernel_untar_build.yaml}
time:   01:05:37
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637843/

[4637842] fs/thrash/{begin.yaml ceph-thrash/mds.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_trivial_sync.yaml}
time:   00:10:51
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637842/

[4637847] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/test_journal_migration.yaml}
time:   00:16:18
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637847/

[4637865] fs/thrash/{begin.yaml ceph-thrash/mon.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_snaptests.yaml}
time:   02:04:06
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637865/

[4637864] fs/snaps/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/snaptests.yaml}
time:   01:03:55
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637864/

[4637867] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_suites_blogbench.yaml}
time:   00:21:41
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637867/

[4637848] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_fsync.yaml}
time:   00:17:08
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637848/

[4637861] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cap-flush.yaml}
time:   00:11:23
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637861/

[4637860] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/libcephfs_interface_tests.yaml}
time:   00:12:51
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637860/

[4637863] fs/multifs/{begin.yaml clusters/1a3s-mds-2c-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/failover.yaml}
time:   00:42:04
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637863/

[4637829] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/client-limits.yaml}
time:   00:17:03
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637829/

[4637828] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_suites_fsync.yaml}
time:   00:13:30
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637828/

[4637830] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/client-recovery.yaml}
time:   00:37:09
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637830/

[4637821] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_suites_fsync.yaml}
time:   00:12:26
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637821/

[4637822] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/auto-repair.yaml}
time:   00:10:43
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637822/

[4637824] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cap-flush.yaml}
time:   00:11:33
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637824/

[4637886] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_kernel_untar_build.yaml}
time:   01:22:18
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637886/

[4637887] fs/thrash/{begin.yaml ceph-thrash/mon.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_snaptests.yaml}
time:   01:58:55
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637887/

[4637872] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/client-recovery.yaml}
time:   00:35:20
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637872/

[4637885] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_suites_dbench.yaml}
time:   00:53:30
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637885/

[4637882] fs/thrash/{begin.yaml ceph-thrash/mon.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_snaptests.yaml}
time:   01:49:51
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637882/

[4637880] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_kernel_untar_build.yaml}
time:   01:14:32
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637880/

[4637869] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_suites_ffsb.yaml}
time:   00:36:08
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637869/

[4637836] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/fragment.yaml}
time:   00:15:12
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637836/

[4637834] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_suites_dbench.yaml}
time:   00:51:56
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637834/

[4637835] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/data-scan.yaml}
time:   00:30:45
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637835/

[4637856] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_fsync.yaml}
time:   00:11:22
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637856/

[4637857] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_suites_iogen.yaml}
time:   00:27:32
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637857/

[4637858] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/auto-repair.yaml}
time:   00:12:54
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637858/

[4637870] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/client-limits.yaml}
time:   00:16:57
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637870/

[4637877] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_norstats.yaml}
time:   00:13:09
info:   http://pulpito.ceph.com/pdonnell-2020-01-04_00:59:46-fs-wip-pdonnell-testing-20200103.181716-distro-basic-smithi/4637877/
2020-01-04T05:17:56.239 INFO:teuthology.results:starting coverage generation