2021-03-31T00:54:12.729 INFO:root:teuthology version: 1.1.0-9870012c 2021-03-31T00:54:12.732 INFO:teuthology.results:seed: '1657' 2021-03-31T01:04:29.738 INFO:root:teuthology version: 1.1.0-9870012c 2021-03-31T01:04:29.770 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-03-31T02:04:51.811 INFO:teuthology.results:Tests finished! gathering results... 2021-03-31T02:04:56.402 INFO:scrape:Found 20 jobs 2021-03-31T02:04:56.409 INFO:scrape:Found 1 distinct failure reasons 2021-03-31T02:04:56.410 INFO:scrape:Failure: Test failure: test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes), test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes) 2021-03-31T02:04:56.410 INFO:scrape:9 jobs: ['6012224', '6012226', '6012223', '6012227', '6012228', '6012225', '6012229', '6012222', '6012231'] 2021-03-31T02:04:56.411 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/volumes/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/volumes/{overrides', 'test/basic}}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-03-31T02:04:56.412 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs/volumes/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/volumes/{overrides', 'test/basic}}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-03-31T02:04:56.413 INFO:scrape: 2021-03-31T02:04:56.415 INFO:teuthology.results:Sending results to rraja@redhat.com: Test Run: rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/ failed: 9 dead: 0 running: 0 waiting: 0 queued: 0 passed: 11 Fail ================================================================= [6012222] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} ----------------------------------------------------------------- time: 00:36:00 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012222/ log: http://qa-proxy.ceph.com/teuthology/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012222/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0d09799d882e4a1e90cfecc06b54f8fe Test failure: test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes), test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes) [6012223] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} ----------------------------------------------------------------- time: 00:35:41 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012223/ log: http://qa-proxy.ceph.com/teuthology/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012223/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2a41a14633c046c69f675ff3aaf08141 Test failure: test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes), test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes) [6012224] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} ----------------------------------------------------------------- time: 00:35:58 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012224/ log: http://qa-proxy.ceph.com/teuthology/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012224/ sentry: https://sentry.ceph.com/organizations/ceph/?query=11b33cd4dd9b4a9687d9fcd033d570c6 Test failure: test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes), test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes) [6012225] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} ----------------------------------------------------------------- time: 00:36:25 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012225/ log: http://qa-proxy.ceph.com/teuthology/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012225/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4d7bb45472f441fb9e37f432cfb27da0 Test failure: test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes), test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes) [6012226] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} ----------------------------------------------------------------- time: 00:36:24 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012226/ log: http://qa-proxy.ceph.com/teuthology/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012226/ sentry: https://sentry.ceph.com/organizations/ceph/?query=47b684df0d66493c842d9eea453c2f76 Test failure: test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes), test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes) [6012227] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} ----------------------------------------------------------------- time: 00:42:48 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012227/ log: http://qa-proxy.ceph.com/teuthology/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012227/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6b2c0c25acb94cffb4b8db1ef4bd46ae Test failure: test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes), test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes) [6012228] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} ----------------------------------------------------------------- time: 00:42:20 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012228/ log: http://qa-proxy.ceph.com/teuthology/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012228/ sentry: https://sentry.ceph.com/organizations/ceph/?query=31a0af0fc8ed46bab785f00ba97fdb80 Test failure: test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes), test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes) [6012229] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} ----------------------------------------------------------------- time: 00:44:19 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012229/ log: http://qa-proxy.ceph.com/teuthology/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012229/ sentry: https://sentry.ceph.com/organizations/ceph/?query=873e702ff4d040e789761c66247b5df7 Test failure: test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes), test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes) [6012231] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} ----------------------------------------------------------------- time: 00:43:49 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012231/ log: http://qa-proxy.ceph.com/teuthology/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012231/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1eb18e62057a4e7c912636238f2f5737 Test failure: test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes), test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes) Pass ================================================================= [6012217] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} time: 00:45:05 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012217/ [6012218] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} time: 00:44:44 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012218/ [6012219] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} time: 00:44:40 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012219/ [6012220] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} time: 00:45:23 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012220/ [6012221] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} time: 00:44:56 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012221/ [6012230] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} time: 00:52:27 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012230/ [6012232] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} time: 00:39:27 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012232/ [6012233] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} time: 00:38:39 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012233/ [6012234] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} time: 00:39:10 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012234/ [6012235] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} time: 00:38:31 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012235/ [6012236] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} time: 00:38:08 info: http://pulpito.ceph.com/rraja-2021-03-31_00:53:55-fs-wip-48411-distro-basic-smithi/6012236/