2020-08-21T02:25:26.992 INFO:root:teuthology version: 1.0.0-c0ecc52 2020-08-21T02:25:26.994 INFO:teuthology.results:subset: '859/9999' 2020-08-21T02:25:26.994 INFO:teuthology.results:seed: '2477' 2020-08-21T02:31:48.360 INFO:root:teuthology version: 1.0.0-c0ecc52 2020-08-21T02:31:48.364 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-08-21T03:47:50.451 INFO:teuthology.results:Tests finished! gathering results... 2020-08-21T03:47:53.967 INFO:scrape:Found 19 jobs 2020-08-21T03:47:55.638 INFO:scrape:Found 2 distinct failure reasons 2020-08-21T03:47:55.639 INFO:scrape:Failure: Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS) 2020-08-21T03:47:55.641 INFO:scrape:4 jobs: ['5363249', '5363258', '5363262', '5363253'] 2020-08-21T03:47:55.641 INFO:scrape:suites intersection: ['task/test_orch_cli}'] 2020-08-21T03:47:55.642 INFO:scrape:suites union: ['rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_orch_cli}'] 2020-08-21T03:47:55.642 INFO:scrape: 2020-08-21T03:47:55.643 INFO:scrape:Dead: b'2020-08-21T03:46:09.847 DEBUG:teuthology.exit:Finished running handlers' 2020-08-21T03:47:55.643 INFO:scrape:1 jobs: ['5363263'] 2020-08-21T03:47:55.644 INFO:scrape:suites: ['1-install/nautilus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'bluestore-bitmap', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_latest}'] 2020-08-21T03:47:55.645 INFO:scrape: 2020-08-21T03:47:55.647 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/ failed: 4 dead: 1 running: 0 waiting: 0 queued: 0 passed: 14 Fail ================================================================= [5363249] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} ----------------------------------------------------------------- time: 00:17:18 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363249/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363249/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=563b50c2ef5245eb97a6ff8711ad6d48 Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS) [5363253] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} ----------------------------------------------------------------- time: 00:17:00 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363253/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363253/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=7b6590006ea845b4bc3de4a1d6621a2f Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS) [5363258] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} ----------------------------------------------------------------- time: 00:17:21 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363258/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363258/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=3a675ce97b454feba72d23aa14349db6 Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS) [5363262] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} ----------------------------------------------------------------- time: 00:16:54 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363262/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363262/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=4a83ae506e004db5b35d644b8deaba30 Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS) Dead ================================================================= [5363263] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363263/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363263/ Pass ================================================================= [5363247] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:30:34 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363247/ [5363248] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} time: 00:22:15 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363248/ [5363250] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:58 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363250/ [5363251] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:26:49 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363251/ [5363252] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:40 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363252/ [5363254] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:04 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363254/ [5363255] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:39:56 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363255/ [5363256] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:31 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363256/ [5363257] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:23 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363257/ [5363259] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:25:23 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363259/ [5363260] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:30:13 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363260/ [5363261] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} time: 00:19:26 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363261/ [5363264] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:49 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363264/ [5363265] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:24:36 info: http://pulpito.ceph.com/kchai-2020-08-21_02:24:23-rados-wip-kefu-testing-2020-08-19-1142-distro-basic-smithi/5363265/