2022-06-06T21:48:35.229 INFO:root:teuthology version: 1.1.1.dev362+g93d2b653 2022-06-06T21:48:35.231 INFO:teuthology.results:seed: '8408' 2022-06-06T22:01:06.021 INFO:root:teuthology version: 1.1.1.dev362+g93d2b653 2022-06-06T22:01:06.026 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-06-06T23:43:15.987 INFO:teuthology.results:Tests finished! gathering results... 2022-06-06T23:43:19.266 INFO:scrape:Found 25 jobs 2022-06-06T23:43:20.285 INFO:scrape:Found 2 distinct failure reasons 2022-06-06T23:43:20.287 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds 2022-06-06T23:43:20.288 INFO:scrape:2 jobs: ['6865055', '6865062'] 2022-06-06T23:43:20.289 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', '2-workunit/suites/pjd}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'races', 'ranks/5', 'session_timeout', 'thrashosds-health}'] 2022-06-06T23:43:20.290 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', '2-workunit/suites/pjd}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'prefetch_dirfrags/no', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/no', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/5', 'session_timeout', 'tasks/{1-thrash/mon', 'tasks/{1-thrash/osd', 'thrashosds-health}'] 2022-06-06T23:43:20.290 INFO:scrape: 2022-06-06T23:43:20.291 INFO:scrape:Crash: Found coredumps on ubuntu@smithi104.front.sepia.ceph.com 2022-06-06T23:43:20.292 INFO:scrape:ceph version 17.0.0-12791-g44457532 (44457532553f59daa44f901930401f299f7ef2a5) quincy (dev) 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f80f5612ce0] 2: gsignal() 3: abort() 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7f80f6ec1b72] 5: /usr/lib64/ceph/libceph-common.so.2(+0x2c1d35) [0x7f80f6ec1d35] 6: (MDLog::trim_all()+0x94d) [0x5595a7713b7d] 7: (MDCache::shutdown_pass()+0xa6d) [0x5595a753a1bd] 8: (MDSRankDispatcher::tick()+0x2d0) [0x5595a73f0ca0] 9: (Context::complete(int)+0xd) [0x5595a73cd2fd] 10: (CommonSafeTimer::timer_thread()+0x18b) [0x7f80f6fd967b] 11: (CommonSafeTimerThread::entry()+0x11) [0x7f80f6fdb681] 12: /lib64/libpthread.so.0(+0x81ca) [0x7f80f56081ca] 13: clone() 2022-06-06T23:43:20.293 INFO:scrape:1 jobs: ['6865046'] 2022-06-06T23:43:20.294 INFO:scrape:suites: ['1-ceph', '2-logrotate}', '2-workunit/suites/fsstress}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/no', 'races', 'ranks/5', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health}'] 2022-06-06T23:43:20.295 INFO:scrape: