2021-05-23T20:57:44.593 INFO:root:teuthology version: 1.1.0-d92ec140
2021-05-23T20:57:44.596 INFO:teuthology.results:seed: '3447'
2021-05-23T20:58:27.318 INFO:root:teuthology version: 1.1.0-d92ec140
2021-05-23T20:58:27.325 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-05-23T21:43:29.996 INFO:teuthology.results:Tests finished! gathering results...
2021-05-23T21:43:31.014 INFO:scrape:Found 20 jobs
2021-05-23T21:43:32.806 INFO:scrape:Found 1 distinct failure reasons
2021-05-23T21:43:32.807 INFO:scrape:Failure: Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio /tmp/fio_rbd_qghjm041'
2021-05-23T21:43:32.808 INFO:scrape:19 jobs: ['6130647', '6130652', '6130635', '6130637', '6130645', '6130649', '6130644', '6130638', '6130648', '6130633', '6130634', '6130651', '6130650', '6130639', '6130643', '6130641', '6130636', '6130646', '6130642']
2021-05-23T21:43:32.808 INFO:scrape:suites intersection: ['2-cluster/{fix-2', '3-supported-random-distro$/{centos_8}', '4-pool/cache', '5-cache-mode/ssd', '6-workloads/fio}', 'openstack}', 'rbd/persistent-writeback-cache/{1-base/install']
2021-05-23T21:43:32.809 INFO:scrape:suites union: ['2-cluster/{fix-2', '3-supported-random-distro$/{centos_8}', '4-pool/cache', '5-cache-mode/ssd', '6-workloads/fio}', 'openstack}', 'rbd/persistent-writeback-cache/{1-base/install']
2021-05-23T21:43:32.809 INFO:scrape:
2021-05-23T21:43:32.810 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/
failed:  19
dead:    0
running: 0
waiting: 0
queued:  0
passed:  1


Fail
=================================================================
[6130633]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:17:58
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130633/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130633/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7ea5a9ae0c464f25933a3d6e4d6864cb

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_ehn6a0ul'

[6130634]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:14:50
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130634/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130634/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8275356f41c24887becca05a560b6443

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_hy6twqpm'

[6130635]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:20:03
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130635/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130635/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9c8e3612d9c140f3b51f8323321270a6

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_fo94yb9x'

[6130636]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:18:44
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130636/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130636/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0caf654299c341859f49faf5d456ad72

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_v_fn42pr'

[6130637]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:18:50
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130637/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130637/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0e584f1934e248eaa47f99d1ff2b566a

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_55ds58y_'

[6130638]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:21:28
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130638/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130638/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c04e437155104a53ab5a17676ace175a

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_h4jcfoo6'

[6130639]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:19:24
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130639/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130639/
sentry: https://sentry.ceph.com/organizations/ceph/?query=73937cd29dd94cb4a23fba337cf62299

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_s191vlwi'

[6130641]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:14:59
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130641/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130641/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a5e5bc42b3844aa5a9abc26fc01b9199

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_m0wdhhv2'

[6130642]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:18:30
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130642/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130642/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f18049770d90405a973815b19693b741

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_4u58ww6q'

[6130643]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:19:57
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130643/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130643/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ef4dabb35fa840d89afc492de425d9e2

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_h6ifelin'

[6130644]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:20:09
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130644/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130644/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ff7d499c2f964211a0ff74bdeeed55c8

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_u15o6hge'

[6130645]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:19:31
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130645/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130645/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2f586c5df531443bab60bd49809831b1

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_xgk6szox'

[6130646]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:20:07
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130646/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130646/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eae53f8cb27041b88bc48c8a6e3fb37b

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_kdj6rlfs'

[6130647]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:20:28
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130647/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130647/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f24d60581c7347d682c89476b4cc9250

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_qghjm041'

[6130648]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:20:22
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130648/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130648/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cfb8fa1376dc4021b29a99c6fc0ffb62

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_8qi_a_lm'

[6130649]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:20:33
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130649/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130649/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b19792e3f5614f818aa4f5f927b15bec

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_3f7rr4hj'

[6130650]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:19:04
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130650/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130650/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c0f9f446e41e4e50b3fb349b9d067fca

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_94rxeyir'

[6130651]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:18:38
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130651/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130651/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1096dfdce9204e56a9583500dcdc9430

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_4yw2bx6l'

[6130652]  rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
-----------------------------------------------------------------
time:   00:19:54
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130652/
log:    http://qa-proxy.ceph.com/teuthology/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130652/
sentry: https://sentry.ceph.com/organizations/ceph/?query=70cc32ddebf7490cbb31d9d05beb65a3

    Command crashed: 'sudo /home/ubuntu/cephtest/rbd_fio_test/fio-fio-3.16/fio
    /tmp/fio_rbd_w3g4834p'



Pass
=================================================================
[6130640] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/ssd 6-workloads/fio}
time:   00:35:23
info:   http://pulpito.ceph.com/dis-2021-05-23_20:57:33-rbd-wip-rbd-pwl-ssd-tailp-distro-basic-smithi/6130640/