2020-12-24T04:24:52.852 INFO:root:teuthology version: 1.0.0-8e49dda4 2020-12-24T04:24:52.854 INFO:teuthology.results:seed: '3085' 2020-12-24T04:25:16.338 INFO:root:teuthology version: 1.0.0-8e49dda4 2020-12-24T04:25:16.368 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-12-24T04:56:16.940 INFO:teuthology.results:Tests finished! gathering results... 2020-12-24T04:56:17.125 INFO:scrape:Found 2 jobs 2020-12-24T04:56:17.484 INFO:scrape:Found 2 distinct failure reasons 2020-12-24T04:56:17.484 INFO:scrape:Failure: "2020-12-24T04:45:14.692705+0000 mon.c (mon.0) 277 : cluster [WRN] Health check failed: Degraded data redundancy: 8/48 objects degraded (16.667%), 2 pgs degraded (PG_DEGRADED)" in cluster log 2020-12-24T04:56:17.485 INFO:scrape:1 jobs: ['5734898'] 2020-12-24T04:56:17.485 INFO:scrape:suites: ['clusters/1a5s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_8}', 'fs:workload/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'ranks/5', 'scrub/yes', 'session_timeout', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/iogen}}'] 2020-12-24T04:56:17.486 INFO:scrape: 2020-12-24T04:56:17.486 INFO:scrape:Failure: cannot import name 'Filesystem' 2020-12-24T04:56:17.487 INFO:scrape:1 jobs: ['5734899'] 2020-12-24T04:56:17.487 INFO:scrape:suites: ['clusters/1a5s-mds-1c-client-3node', 'conf/{client', 'distro/{ubuntu_latest}', 'fs:workload/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'ranks/3', 'scrub/yes', 'session_timeout', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/iogen}}'] 2020-12-24T04:56:17.488 INFO:scrape: 2020-12-24T04:56:17.488 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2020-12-24_04:23:48-fs:workload-wip-pdonnell-testing-20201223.043716-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/pdonnell-2020-12-24_04:23:48-fs:workload-wip-pdonnell-testing-20201223.043716-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-12-24_04:23:48-fs:workload-wip-pdonnell-testing-20201223.043716-distro-basic-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [5734898] fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/iogen}} ----------------------------------------------------------------- time: 00:08:35 info: http://pulpito.ceph.com/pdonnell-2020-12-24_04:23:48-fs:workload-wip-pdonnell-testing-20201223.043716-distro-basic-smithi/5734898/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-12-24_04:23:48-fs:workload-wip-pdonnell-testing-20201223.043716-distro-basic-smithi/5734898/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c673275f94754ce69f4db9ad4d1a5042 "2020-12-24T04:45:14.692705+0000 mon.c (mon.0) 277 : cluster [WRN] Health check failed: Degraded data redundancy: 8/48 objects degraded (16.667%), 2 pgs degraded (PG_DEGRADED)" in cluster log [5734899] fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/iogen}} ----------------------------------------------------------------- time: 00:09:03 info: http://pulpito.ceph.com/pdonnell-2020-12-24_04:23:48-fs:workload-wip-pdonnell-testing-20201223.043716-distro-basic-smithi/5734899/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-12-24_04:23:48-fs:workload-wip-pdonnell-testing-20201223.043716-distro-basic-smithi/5734899/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c478580c675d4c03a843c67f200c47df cannot import name 'Filesystem'