2022-05-27T03:07:53.044 INFO:root:teuthology version: 1.1.1.dev346+g91acb46d 2022-05-27T03:07:53.045 INFO:teuthology.results:seed: '6384' 2022-05-27T03:08:34.618 INFO:root:teuthology version: 1.1.1.dev346+g91acb46d 2022-05-27T03:08:34.624 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-05-27T04:57:43.463 INFO:teuthology.results:Tests finished! gathering results... 2022-05-27T04:57:43.761 INFO:scrape:Found 6 jobs 2022-05-27T04:57:43.969 INFO:scrape:Found 1 distinct failure reasons 2022-05-27T04:57:43.970 INFO:scrape:Crash: Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining), test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2022-05-27T04:57:43.970 INFO:scrape:ceph version 17.0.0-12316-g003da67b (003da67b0a02e4e9d00c956e19822ce45c763758) quincy (dev) 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f556b726ce0] 2: gsignal() 3: abort() 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7f556c747772] 5: /usr/lib64/ceph/libceph-common.so.2(+0x285935) [0x7f556c747935] 6: ceph-mds(+0x49be30) [0x559858fcce30] 7: (Continuation::_continue_function(int, int)+0x163) [0x559858fd87a3] 8: (CInode::validate_disk_state(CInode::validated_data*, MDSContext*)+0x4dc) [0x559858fcaf6c] 9: (MDSContext::complete(int)+0x203) [0x55985902f1c3] 10: (Server::respond_to_request(boost::intrusive_ptr&, int)+0xf2) [0x559858d5f892] 11: (MDCache::uninline_data_work(boost::intrusive_ptr)+0x33b) [0x559858e50a7b] 12: (MDCache::dispatch_request(boost::intrusive_ptr&)+0xc4) [0x559858e5f074] 13: (MDSContext::complete(int)+0x203) [0x55985902f1c3] 14: (void finish_contexts > >(ceph::common::CephContext*, std::vector >&, int)+0x8d) [0x559858d03b7d] 15: (Locker::eval(CInode*, int, bool)+0x4d8) [0x559858efdbb8] 16: (Locker::handle_client_caps(boost::intrusive_ptr const&)+0x1c9b) [0x559858f0d93b] 17: (Locker::dispatch(boost::intrusive_ptr const&)+0x114) [0x559858f0f734] 18: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd54) [0x559858d0aca4] 19: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x7cb) [0x559858d0d8db] 20: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559858d0defc] 21: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x108) [0x559858cfcdf8] 22: (DispatchQueue::entry()+0x14fa) [0x7f556c9d1a0a] 23: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f556ca89f61] 24: /lib64/libpthread.so.0(+0x81ca) [0x7f556b71c1ca] 25: clone() 2022-05-27T04:57:43.970 INFO:scrape:2 jobs: ['6849718', '6849715'] 2022-05-27T04:57:43.970 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin/{0-install', 'mds', 'mon', 'mount/fuse', 'osd}', 'overrides/{no_client_pidfile', 'tasks/uninlining}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-05-27T04:57:43.970 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs/functional/{begin/{0-install', 'mds', 'mon', 'mount/fuse', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{no_client_pidfile', 'tasks/uninlining}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-05-27T04:57:43.970 INFO:scrape: 2022-05-27T04:57:43.971 INFO:teuthology.results:Sending results to mchangir@redhat.com: Test Run: mchangir-2022-05-27_03:07:40-fs-wip-mchangir-mds-uninline-file-during-scrub-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/mchangir-2022-05-27_03:07:40-fs-wip-mchangir-mds-uninline-file-during-scrub-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-27_03:07:40-fs-wip-mchangir-mds-uninline-file-during-scrub-distro-default-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [6849715] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/uninlining} ----------------------------------------------------------------- time: 00:26:11 info: http://pulpito.ceph.com/mchangir-2022-05-27_03:07:40-fs-wip-mchangir-mds-uninline-file-during-scrub-distro-default-smithi/6849715/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-27_03:07:40-fs-wip-mchangir-mds-uninline-file-during-scrub-distro-default-smithi/6849715/ sentry: https://sentry.ceph.com/organizations/ceph/?query=80b21a946fe14792a52fa473a7b46703 Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining), test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) [6849718] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/uninlining} ----------------------------------------------------------------- time: 00:24:50 info: http://pulpito.ceph.com/mchangir-2022-05-27_03:07:40-fs-wip-mchangir-mds-uninline-file-during-scrub-distro-default-smithi/6849718/ log: http://qa-proxy.ceph.com/teuthology/mchangir-2022-05-27_03:07:40-fs-wip-mchangir-mds-uninline-file-during-scrub-distro-default-smithi/6849718/ sentry: https://sentry.ceph.com/organizations/ceph/?query=28d7257ac92d4cbeb35e228cf66f806c Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining), test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) Pass ================================================================= [6849713] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/uninlining} time: 01:40:34 info: http://pulpito.ceph.com/mchangir-2022-05-27_03:07:40-fs-wip-mchangir-mds-uninline-file-during-scrub-distro-default-smithi/6849713/ [6849714] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/uninlining} time: 01:09:34 info: http://pulpito.ceph.com/mchangir-2022-05-27_03:07:40-fs-wip-mchangir-mds-uninline-file-during-scrub-distro-default-smithi/6849714/ [6849716] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/uninlining} time: 01:25:46 info: http://pulpito.ceph.com/mchangir-2022-05-27_03:07:40-fs-wip-mchangir-mds-uninline-file-during-scrub-distro-default-smithi/6849716/ [6849717] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/uninlining} time: 01:09:32 info: http://pulpito.ceph.com/mchangir-2022-05-27_03:07:40-fs-wip-mchangir-mds-uninline-file-during-scrub-distro-default-smithi/6849717/