2021-06-10T06:05:24.630 INFO:root:teuthology version: 1.1.0-f359b10d 2021-06-10T06:05:24.634 INFO:teuthology.results:subset: '0/32' 2021-06-10T06:05:24.634 INFO:teuthology.results:seed: '6971' 2021-06-10T09:19:16.104 INFO:root:teuthology version: 1.1.0-f359b10d 2021-06-10T09:19:16.135 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-06-10T16:15:50.904 INFO:teuthology.results:Tests finished! gathering results... 2021-06-10T16:16:35.368 INFO:scrape:Found 260 jobs 2021-06-10T16:17:36.589 INFO:scrape:Found 17 distinct failure reasons 2021-06-10T16:17:36.590 INFO:scrape:Failure: "2021-06-10T08:04:54.285858+0000 mon.a (mon.0) 413 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log 2021-06-10T16:17:36.591 INFO:scrape:1 jobs: ['6164361'] 2021-06-10T16:17:36.591 INFO:scrape:suites: ['2-workunit/suites/ffsb}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'fs/thrash/workloads/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'ranks/3', 'rhel_8}', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.592 INFO:scrape: 2021-06-10T16:17:36.601 INFO:scrape:Failure: Test failure: test_scrub_backtrace (tasks.cephfs.test_multimds_misc.TestScrub2) 2021-06-10T16:17:36.601 INFO:scrape:1 jobs: ['6164366'] 2021-06-10T16:17:36.601 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/multimds_misc}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.602 INFO:scrape: 2021-06-10T16:17:36.603 INFO:scrape:Failure: Test failure: test_add_ancestor_and_child_directory (tasks.cephfs.test_mirroring.TestMirroring) 2021-06-10T16:17:36.603 INFO:scrape:2 jobs: ['6164247', '6164236'] 2021-06-10T16:17:36.603 INFO:scrape:suites intersection: ['mount/fuse'] 2021-06-10T16:17:36.604 INFO:scrape:suites union: ['centos_latest', 'cephfs-mirror/one-per-cluster', 'clients/mirror', 'clients/{mirror}', 'cluster/1-node', 'cluster/{1-node}', 'debug', 'fs/mirror/{begin', 'fs/valgrind/{begin', 'mirror/{cephfs-mirror/one-per-cluster', 'mount/fuse', 'objectstore/bluestore-bitmap', 'overrides/whitelist_health', 'overrides/{whitelist_health}', 'supported-random-distros$/{centos_8}', 'tasks/mirror}', 'tasks/mirror}}'] 2021-06-10T16:17:36.604 INFO:scrape: 2021-06-10T16:17:36.605 INFO:scrape:Failure: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2021-06-10T16:17:36.605 INFO:scrape:3 jobs: ['6164284', '6164370', '6164454'] 2021-06-10T16:17:36.606 INFO:scrape:suites intersection: ['clusters/1a3s-mds-2c-client', 'conf/{client', 'fs/multifs/{begin', 'mds', 'mon', 'mon-debug', 'osd}', 'overrides/{frag_enable', 'tasks/multifs-auth}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.606 INFO:scrape:suites union: ['clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/multifs/{begin', 'k-testing}', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'rhel_8}', 'tasks/multifs-auth}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.607 INFO:scrape: 2021-06-10T16:17:36.607 INFO:scrape:Failure: Test failure: test_deauthorize_auth_id_after_out_of_band_update (tasks.cephfs.test_volumes.TestSubvolumes) 2021-06-10T16:17:36.608 INFO:scrape:2 jobs: ['6164249', '6164429'] 2021-06-10T16:17:36.608 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/volumes/{begin', 'mds', 'mon', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/volumes/{overrides', 'test/basic}}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.609 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs/volumes/{begin', 'k-testing}', 'mds', 'mon', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/volumes/{overrides', 'test/basic}}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.609 INFO:scrape: 2021-06-10T16:17:36.610 INFO:scrape:Failure: reached maximum tries (50) after waiting for 300 seconds 2021-06-10T16:17:36.610 INFO:scrape:1 jobs: ['6164286'] 2021-06-10T16:17:36.610 INFO:scrape:suites: ['clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'fs/verify/{begin', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{frag_enable', 'overrides}}', 'ranks/3', 'session_timeout', 'tasks/fsstress', 'validater/valgrind}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.630 INFO:scrape: 2021-06-10T16:17:36.630 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=734742252f269faa019c376c1632345e91d20161 2021-06-10T16:17:36.631 INFO:scrape:7 jobs: ['6164328', '6164231', '6164455', '6164246', '6164372', '6164413', '6164285'] 2021-06-10T16:17:36.631 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.632 INFO:scrape:suites union: ['1-client', '2-upgrade', '3-client-upgrade', '3-compat_client/no}}', '3-compat_client/pacific}}', '4-compat_client', '5-client-sanity}}', 'clusters/1-mds-2-client-micro', 'clusters/small-cluster', 'conf/{client', 'fs/bugs/client_trim_caps/{begin', 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap', 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap', 'mds', 'mon', 'multimds/no', 'multimds/yes', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'pg-warn', 'tasks/trim-i24137}', 'tasks/{0-octopus', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.632 INFO:scrape: 2021-06-10T16:17:36.633 INFO:scrape:Crash: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan), test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2021-06-10T16:17:36.633 INFO:scrape:ceph version 17.0.0-5077-g73474225 (734742252f269faa019c376c1632345e91d20161) quincy (dev) 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0) [0x7f0d9eecc3c0] 2: gsignal() 3: abort() 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a7) [0x7f0d9f179d48] 5: /usr/lib/ceph/libceph-common.so.2(+0x264ee6) [0x7f0d9f179ee6] 6: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0x2209) [0x55a6b6951c09] 7: (Server::_unlink_local(boost::intrusive_ptr&, CDentry*, CDentry*)+0x9c2) [0x55a6b68acce2] 8: (Server::handle_client_unlink(boost::intrusive_ptr&)+0x414) [0x55a6b68cba74] 9: (Server::dispatch_client_request(boost::intrusive_ptr&)+0x9b0) [0x55a6b68e8200] 10: (Server::handle_client_request(boost::intrusive_ptr const&)+0x5dd) [0x55a6b68e8fad] 11: (Server::dispatch(boost::intrusive_ptr const&)+0xec) [0x55a6b68f1b8c] 12: (MDSRank::handle_message(boost::intrusive_ptr const&)+0x3e9) [0x55a6b683e089] 13: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x643) [0x55a6b6840e03] 14: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a6b684149c] 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x128) [0x55a6b6831ce8] 16: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x460) [0x7f0d9f3c7ff0] 17: (DispatchQueue::entry()+0x58f) [0x7f0d9f3c588f] 18: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0d9f4907e1] 19: (Thread::_entry_func(void*)+0xd) [0x7f0d9f262d8d] 20: /lib/x86_64-linux-gnu/libpthread.so.0(+0x9609) [0x7f0d9eec0609] 21: clone() 2021-06-10T16:17:36.633 INFO:scrape:2 jobs: ['6164314', '6164416'] 2021-06-10T16:17:36.634 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.641 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/data-scan}', 'tasks/snapshots}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.642 INFO:scrape: 2021-06-10T16:17:36.642 INFO:scrape:Failure: Test failure: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2021-06-10T16:17:36.642 INFO:scrape:1 jobs: ['6164323'] 2021-06-10T16:17:36.643 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'rhel_8}', 'tasks/forward-scrub}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.643 INFO:scrape: 2021-06-10T16:17:36.644 INFO:scrape:Failure: Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2021-06-10T16:17:36.644 INFO:scrape:1 jobs: ['6164395'] 2021-06-10T16:17:36.645 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/scrub}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.645 INFO:scrape: 2021-06-10T16:17:36.645 INFO:scrape:Failure: Test failure: test_clients (tasks.cephfs.test_failover.TestMultiFilesystems) 2021-06-10T16:17:36.646 INFO:scrape:3 jobs: ['6164411', '6164239', '6164326'] 2021-06-10T16:17:36.646 INFO:scrape:suites intersection: ['clusters/1a3s-mds-2c-client', 'conf/{client', 'fs/multifs/{begin', 'mds', 'mon', 'mon-debug', 'osd}', 'overrides/{frag_enable', 'tasks/failover}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.647 INFO:scrape:suites union: ['clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/multifs/{begin', 'k-testing}', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/failover}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.647 INFO:scrape: 2021-06-10T16:17:36.648 INFO:scrape:Failure: Test failure: test_ls_H_prints_human_readable_file_size (tasks.cephfs.test_cephfs_shell.TestLS) 2021-06-10T16:17:36.648 INFO:scrape:1 jobs: ['6164241'] 2021-06-10T16:17:36.649 INFO:scrape:suites: ['clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/shell/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/cephfs-shell}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.649 INFO:scrape: 2021-06-10T16:17:36.649 INFO:scrape:Dead: b'2021-06-10T16:14:32.905 DEBUG:teuthology.exit:Finished running handlers' 2021-06-10T16:17:36.650 INFO:scrape:1 jobs: ['6164444'] 2021-06-10T16:17:36.650 INFO:scrape:suites: ['2-workunit/fs/snaps}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/thrash/workloads/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/none', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'ranks/1', 'session_timeout', 'tasks/{1-thrash/osd', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.651 INFO:scrape: 2021-06-10T16:17:36.652 INFO:scrape:Failure: Test failure: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2021-06-10T16:17:36.652 INFO:scrape:1 jobs: ['6164351'] 2021-06-10T16:17:36.652 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'rhel_8}', 'tasks/mds-full}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.653 INFO:scrape: 2021-06-10T16:17:36.653 INFO:scrape:Failure: wait_for_recovery: failed before timeout expired 2021-06-10T16:17:36.654 INFO:scrape:1 jobs: ['6164257'] 2021-06-10T16:17:36.654 INFO:scrape:suites: ['2-workunit/suites/fsstress}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/thrash/workloads/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/none', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'ranks/5', 'session_timeout', 'tasks/{1-thrash/osd', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.655 INFO:scrape: 2021-06-10T16:17:36.656 INFO:scrape:Failure: "2021-06-10T07:49:47.463219+0000 mds.a (mds.1) 10 : cluster [WRN] Scrub error on inode 0x20000001337 (/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21) see mds.a log and `damage ls` output for details" in cluster log 2021-06-10T16:17:36.656 INFO:scrape:1 jobs: ['6164339'] 2021-06-10T16:17:36.656 INFO:scrape:suites: ['clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/workload/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'ranks/3', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/blogbench}}'] 2021-06-10T16:17:36.657 INFO:scrape: 2021-06-10T16:17:36.657 INFO:scrape:Failure: Test failure: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2021-06-10T16:17:36.658 INFO:scrape:1 jobs: ['6164406'] 2021-06-10T16:17:36.659 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-10T16:17:36.659 INFO:scrape: 2021-06-10T16:17:36.685 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/ failed: 29 dead: 1 running: 0 waiting: 0 queued: 0 passed: 230 Fail ================================================================= [6164231] fs/bugs/client_trim_caps/{begin clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/trim-i24137} ----------------------------------------------------------------- time: 00:03:28 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164231/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164231/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0c5b53d88605494fa87145add252a2b4 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =734742252f269faa019c376c1632345e91d20161 [6164236] fs/mirror/{begin cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{centos_8} tasks/mirror} ----------------------------------------------------------------- time: 00:09:20 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164236/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164236/ sentry: https://sentry.ceph.com/organizations/ceph/?query=daf27caa4b424e50a6aa1f3cd55d38a6 Test failure: test_add_ancestor_and_child_directory (tasks.cephfs.test_mirroring.TestMirroring) [6164239] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} ----------------------------------------------------------------- time: 00:29:23 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164239/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164239/ sentry: https://sentry.ceph.com/organizations/ceph/?query=47e6959062b4443396d24419b0edfb86 Test failure: test_clients (tasks.cephfs.test_failover.TestMultiFilesystems) [6164241] fs/shell/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cephfs-shell} ----------------------------------------------------------------- time: 00:17:38 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164241/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164241/ sentry: https://sentry.ceph.com/organizations/ceph/?query=25a5d3bf74624131afaecbbe79056904 Test failure: test_ls_H_prints_human_readable_file_size (tasks.cephfs.test_cephfs_shell.TestLS) [6164246] fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} ----------------------------------------------------------------- time: 00:16:17 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164246/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164246/ sentry: https://sentry.ceph.com/organizations/ceph/?query=be6653451a4040d78e24ce68e3c0ca41 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =734742252f269faa019c376c1632345e91d20161 [6164247] fs/valgrind/{begin centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}} ----------------------------------------------------------------- time: 00:21:44 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164247/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164247/ sentry: https://sentry.ceph.com/organizations/ceph/?query=42b5e490be9d46f29c66ee36124d45f2 Test failure: test_add_ancestor_and_child_directory (tasks.cephfs.test_mirroring.TestMirroring) [6164249] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} ----------------------------------------------------------------- time: 00:25:15 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164249/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164249/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0aa58903dd384d43945b8480638af48e Test failure: test_deauthorize_auth_id_after_out_of_band_update (tasks.cephfs.test_volumes.TestSubvolumes) [6164257] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} ----------------------------------------------------------------- time: 01:45:32 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164257/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164257/ wait_for_recovery: failed before timeout expired [6164284] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth} ----------------------------------------------------------------- time: 00:15:19 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164284/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164284/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6f656738c15e4a50809c14fc32457c05 Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) [6164285] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} ----------------------------------------------------------------- time: 00:08:24 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164285/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164285/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ded2967d9c0c4a60be81d073179eca97 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =734742252f269faa019c376c1632345e91d20161 [6164286] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/fsstress validater/valgrind} ----------------------------------------------------------------- time: 01:38:21 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164286/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164286/ reached maximum tries (50) after waiting for 300 seconds [6164314] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan} ----------------------------------------------------------------- time: 00:20:40 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164314/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164314/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fffead49d3594eec9888b1b4c4812fe7 Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan), test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) [6164323] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub} ----------------------------------------------------------------- time: 00:14:18 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164323/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164323/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0eeff54127b407f969a87d0bd8b4b19 Test failure: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) [6164326] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} ----------------------------------------------------------------- time: 00:35:50 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164326/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164326/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5c30d222c3b9470eb5cbc7ec76bc7076 Test failure: test_clients (tasks.cephfs.test_failover.TestMultiFilesystems) [6164328] fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} ----------------------------------------------------------------- time: 00:15:21 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164328/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164328/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad50eb98688e434794e6589022ffbbed Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =734742252f269faa019c376c1632345e91d20161 [6164339] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench}} ----------------------------------------------------------------- time: 00:22:58 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164339/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164339/ "2021-06-10T07:49:47.463219+0000 mds.a (mds.1) 10 : cluster [WRN] Scrub error on inode 0x20000001337 (/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21) see mds.a log and `damage ls` output for details" in cluster log [6164351] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} ----------------------------------------------------------------- time: 00:18:36 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164351/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164351/ sentry: https://sentry.ceph.com/organizations/ceph/?query=92292040c0244e1ca30ed2620c9251dc Test failure: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) [6164361] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:51:37 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164361/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164361/ "2021-06-10T08:04:54.285858+0000 mon.a (mon.0) 413 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log [6164366] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/multimds_misc} ----------------------------------------------------------------- time: 00:12:00 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164366/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164366/ sentry: https://sentry.ceph.com/organizations/ceph/?query=66235e4719a14062b77670b8a6124aac Test failure: test_scrub_backtrace (tasks.cephfs.test_multimds_misc.TestScrub2) [6164370] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth} ----------------------------------------------------------------- time: 00:13:35 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164370/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164370/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b22d7675c7d4165b94160580c968625 Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) [6164372] fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} ----------------------------------------------------------------- time: 00:15:17 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164372/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164372/ sentry: https://sentry.ceph.com/organizations/ceph/?query=697f0efec3a34ac5830d9ed4969faeda Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =734742252f269faa019c376c1632345e91d20161 [6164395] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/scrub} ----------------------------------------------------------------- time: 00:15:19 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164395/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164395/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3946a83dcd9343678fe8625436550c3e Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) [6164406] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} ----------------------------------------------------------------- time: 00:13:14 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164406/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164406/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bc5f414f243e4aca81e0b6d60aa2e363 Test failure: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) [6164411] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} ----------------------------------------------------------------- time: 00:31:04 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164411/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164411/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f713f8fa11ad45bf858ae0a834b5533d Test failure: test_clients (tasks.cephfs.test_failover.TestMultiFilesystems) [6164413] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} ----------------------------------------------------------------- time: 00:08:41 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164413/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164413/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5206f22a01b44093a75f25718309682a Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =734742252f269faa019c376c1632345e91d20161 [6164416] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snapshots} ----------------------------------------------------------------- time: 00:18:08 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164416/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164416/ sentry: https://sentry.ceph.com/organizations/ceph/?query=27ff96983f324953a3582e0ed37fafe0 Test failure: test_snapclient_cache (tasks.cephfs.test_snapshots.TestSnapshots) [6164429] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} ----------------------------------------------------------------- time: 00:27:00 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164429/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164429/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b06a484d5ecd4bf2bf8779cb6d1df2ec Test failure: test_deauthorize_auth_id_after_out_of_band_update (tasks.cephfs.test_volumes.TestSubvolumes) [6164454] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth} ----------------------------------------------------------------- time: 00:12:09 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164454/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164454/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c10815f2e9de42fc870925ded44d1e2c Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) [6164455] fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} ----------------------------------------------------------------- time: 00:15:49 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164455/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164455/ sentry: https://sentry.ceph.com/organizations/ceph/?query=30bd116ee8db41feb2e761a9ff79c9e5 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =734742252f269faa019c376c1632345e91d20161 Dead ================================================================= [6164444] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164444/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164444/ Pass ================================================================= [6164230] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:13:29 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164230/ [6164232] fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/centos_latest} time: 00:43:24 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164232/ [6164233] fs/full/{begin clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mgr-osd-full} time: 00:10:12 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164233/ [6164234] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls} time: 00:14:05 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164234/ [6164235] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client} time: 00:13:39 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164235/ [6164237] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:41:55 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164237/ [6164238] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} time: 00:18:47 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164238/ [6164240] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:10:02 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164240/ [6164242] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:41:41 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164242/ [6164243] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} time: 01:08:01 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164243/ [6164244] fs/top/{begin cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/whitelist_health supported-random-distros$/{ubuntu_latest} tasks/fstop} time: 00:08:37 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164244/ [6164245] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} time: 00:18:53 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164245/ [6164248] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/dbench validater/lockdep} time: 00:49:27 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164248/ [6164250] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io}} time: 00:14:19 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164250/ [6164251] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc}} time: 00:41:38 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164251/ [6164252] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} time: 00:45:00 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164252/ [6164253] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build}} time: 00:37:10 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164253/ [6164254] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin} time: 00:28:58 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164254/ [6164255] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} time: 00:59:10 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164255/ [6164256] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench}} time: 00:21:04 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164256/ [6164258] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench}} time: 00:43:13 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164258/ [6164259] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/alternate-pool} time: 00:13:33 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164259/ [6164260] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb}} time: 00:49:42 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164260/ [6164261] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} time: 00:11:43 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164261/ [6164262] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats}} time: 00:16:42 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164262/ [6164263] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/asok_dump_tree} time: 00:22:44 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164263/ [6164264] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}} time: 00:12:05 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164264/ [6164265] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress}} time: 00:17:34 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164265/ [6164266] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}} time: 00:17:55 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164266/ [6164267] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx}} time: 00:48:41 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164267/ [6164268] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair} time: 00:14:30 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164268/ [6164269] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}} time: 00:15:46 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164269/ [6164270] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:25:15 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164270/ [6164271] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}} time: 00:23:34 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164271/ [6164272] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:11:05 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164272/ [6164273] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace} time: 00:13:31 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164273/ [6164274] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:11:41 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164274/ [6164275] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}} time: 07:17:32 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164275/ [6164276] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen}} time: 00:56:59 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164276/ [6164277] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} time: 00:40:10 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164277/ [6164278] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone}} time: 00:11:55 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164278/ [6164279] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cap-flush} time: 00:13:19 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164279/ [6164280] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd}} time: 00:16:02 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164280/ [6164281] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} time: 00:14:41 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164281/ [6164282] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 01:16:34 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164282/ [6164283] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file} time: 00:10:49 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164283/ [6164287] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io}} time: 00:14:54 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164287/ [6164288] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} time: 00:14:18 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164288/ [6164289] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits} time: 00:19:04 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164289/ [6164290] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc}} time: 00:58:51 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164290/ [6164291] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 01:09:41 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164291/ [6164292] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} time: 00:54:46 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164292/ [6164293] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}} time: 00:37:57 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164293/ [6164294] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}} time: 00:20:20 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164294/ [6164295] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build}} time: 01:23:26 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164295/ [6164296] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead} time: 00:09:15 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164296/ [6164297] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench}} time: 00:44:09 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164297/ [6164298] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}} time: 00:16:10 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164298/ [6164299] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench}} time: 00:52:02 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164299/ [6164300] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} time: 00:16:48 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164300/ [6164301] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery} time: 00:29:38 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164301/ [6164302] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb}} time: 00:49:54 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164302/ [6164303] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} time: 00:42:38 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164303/ [6164304] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats}} time: 00:28:56 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164304/ [6164305] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:17:55 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164305/ [6164306] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/damage} time: 00:22:59 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164306/ [6164307] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/ino_release_cb} time: 00:13:25 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164307/ [6164308] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:11:38 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164308/ [6164309] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress}} time: 00:19:19 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164309/ [6164310] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} time: 00:59:42 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164310/ [6164311] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx}} time: 00:28:54 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164311/ [6164312] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} time: 00:18:29 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164312/ [6164313] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}} time: 00:13:19 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164313/ [6164315] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} time: 00:11:14 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164315/ [6164316] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}} time: 00:20:51 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164316/ [6164317] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen}} time: 01:06:33 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164317/ [6164318] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/exports} time: 00:46:36 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164318/ [6164319] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}} time: 00:13:47 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164319/ [6164320] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone}} time: 00:18:50 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164320/ [6164321] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}} time: 00:16:24 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164321/ [6164322] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd}} time: 00:14:10 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164322/ [6164324] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 01:21:26 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164324/ [6164325] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/mdtest} time: 00:11:56 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164325/ [6164327] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} time: 00:12:01 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164327/ [6164329] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/dbench validater/lockdep} time: 01:00:57 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164329/ [6164330] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io}} time: 00:17:28 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164330/ [6164331] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc}} time: 00:37:36 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164331/ [6164332] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} time: 00:52:33 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164332/ [6164333] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/fragment} time: 00:21:01 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164333/ [6164334] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build}} time: 00:46:01 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164334/ [6164335] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:49:48 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164335/ [6164336] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} time: 00:52:53 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164336/ [6164337] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/misc}} time: 00:19:26 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164337/ [6164338] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} time: 00:40:47 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164338/ [6164340] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:11:37 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164340/ [6164341] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair} time: 00:18:55 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164341/ [6164342] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:11:33 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164342/ [6164343] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} time: 00:34:42 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164343/ [6164344] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench}} time: 01:16:21 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164344/ [6164345] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb}} time: 01:21:35 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164345/ [6164346] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} time: 00:13:47 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164346/ [6164347] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush} time: 00:09:10 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164347/ [6164348] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats}} time: 00:16:56 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164348/ [6164349] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}} time: 00:19:41 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164349/ [6164350] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress}} time: 00:16:26 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164350/ [6164352] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}} time: 00:15:46 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164352/ [6164353] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx}} time: 00:24:46 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164353/ [6164354] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}} time: 00:15:20 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164354/ [6164355] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/ffsb}} time: 00:42:09 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164355/ [6164356] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds_creation_retry} time: 00:12:23 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164356/ [6164357] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}} time: 00:24:40 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164357/ [6164358] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}} time: 01:31:17 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164358/ [6164359] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen}} time: 00:41:08 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164359/ [6164360] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/metrics} time: 00:19:35 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164360/ [6164362] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone}} time: 00:17:00 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164362/ [6164363] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd}} time: 00:15:52 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164363/ [6164364] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} time: 00:18:46 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164364/ [6164365] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:14:44 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164365/ [6164367] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs} time: 00:13:17 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164367/ [6164368] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 01:24:43 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164368/ [6164369] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} time: 00:19:53 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164369/ [6164371] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:11:11 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164371/ [6164373] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/fsstress validater/valgrind} time: 01:29:26 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164373/ [6164374] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io}} time: 00:15:53 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164374/ [6164375] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} time: 00:12:13 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164375/ [6164376] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc}} time: 00:55:01 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164376/ [6164377] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}} time: 00:11:56 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164377/ [6164378] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build}} time: 02:34:47 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164378/ [6164379] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/openfiletable} time: 00:16:35 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164379/ [6164380] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench}} time: 00:23:57 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164380/ [6164381] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}} time: 00:16:58 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164381/ [6164382] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 01:03:12 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164382/ [6164383] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} time: 00:15:39 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164383/ [6164384] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/snapshot}} time: 00:21:16 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164384/ [6164385] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench}} time: 01:09:31 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164385/ [6164386] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm} time: 00:14:17 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164386/ [6164387] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/iozone}} time: 00:15:54 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164387/ [6164388] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb}} time: 00:55:06 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164388/ [6164389] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} time: 00:52:24 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164389/ [6164390] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats}} time: 00:17:19 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164390/ [6164391] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/quota} time: 00:12:33 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164391/ [6164392] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress}} time: 00:16:50 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164392/ [6164393] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} time: 00:51:47 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164393/ [6164394] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx}} time: 00:35:39 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164394/ [6164396] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} time: 00:17:07 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164396/ [6164397] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}} time: 00:13:43 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164397/ [6164398] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} time: 00:14:05 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164398/ [6164399] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}} time: 00:20:51 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164399/ [6164400] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:16:45 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164400/ [6164401] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap} time: 00:15:12 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164401/ [6164402] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:15:22 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164402/ [6164403] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen}} time: 00:26:10 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164403/ [6164404] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}} time: 00:35:01 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164404/ [6164405] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone}} time: 00:20:12 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164405/ [6164407] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}} time: 00:14:56 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164407/ [6164408] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd}} time: 00:14:26 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164408/ [6164409] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:40:28 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164409/ [6164410] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file} time: 00:08:58 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164410/ [6164412] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} time: 00:59:02 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164412/ [6164414] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/dbench validater/lockdep} time: 00:47:26 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164414/ [6164415] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io}} time: 00:13:05 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164415/ [6164417] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc}} time: 01:48:34 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164417/ [6164418] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} time: 01:26:06 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164418/ [6164419] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build}} time: 00:35:26 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164419/ [6164420] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} time: 00:54:01 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164420/ [6164421] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/strays} time: 00:25:02 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164421/ [6164422] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench}} time: 00:31:57 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164422/ [6164423] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} time: 00:54:00 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164423/ [6164424] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench}} time: 00:39:32 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164424/ [6164425] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/test_journal_migration} time: 00:18:37 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164425/ [6164426] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb}} time: 01:08:06 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164426/ [6164427] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:40:32 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164427/ [6164428] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} time: 00:25:05 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164428/ [6164430] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} time: 00:11:28 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164430/ [6164431] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats}} time: 00:16:03 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164431/ [6164432] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}} time: 00:17:08 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164432/ [6164433] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:11:19 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164433/ [6164434] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/truncate_delay} time: 00:13:18 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164434/ [6164435] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs_python} time: 00:12:53 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164435/ [6164436] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:10:57 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164436/ [6164437] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress}} time: 00:18:46 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164437/ [6164438] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}} time: 00:16:24 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164438/ [6164439] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx}} time: 00:21:57 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164439/ [6164440] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}} time: 00:16:02 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164440/ [6164441] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/workunit/quota} time: 00:12:27 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164441/ [6164442] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:22:55 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164442/ [6164443] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}} time: 00:23:45 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164443/ [6164445] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen}} time: 01:00:20 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164445/ [6164446] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls} time: 00:13:50 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164446/ [6164447] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} time: 00:47:12 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164447/ [6164448] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone}} time: 00:13:39 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164448/ [6164449] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd}} time: 00:12:31 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164449/ [6164450] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin} time: 00:34:02 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164450/ [6164451] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} time: 00:17:36 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164451/ [6164452] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 01:10:35 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164452/ [6164453] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/mdtest} time: 00:21:50 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164453/ [6164456] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/fsstress validater/valgrind} time: 02:03:53 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164456/ [6164457] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io}} time: 00:14:41 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164457/ [6164458] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} time: 00:14:25 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164458/ [6164459] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc}} time: 00:53:00 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164459/ [6164460] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/alternate-pool} time: 00:13:35 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164460/ [6164461] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}} time: 00:22:13 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164461/ [6164462] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build}} time: 00:30:31 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164462/ [6164463] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench}} time: 00:20:43 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164463/ [6164464] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}} time: 00:15:27 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164464/ [6164465] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:19:45 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164465/ [6164466] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/asok_dump_tree} time: 00:26:49 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164466/ [6164467] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:11:55 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164467/ [6164468] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench}} time: 01:18:03 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164468/ [6164469] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} time: 00:12:45 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164469/ [6164470] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb}} time: 00:54:44 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164470/ [6164471] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair} time: 00:12:08 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164471/ [6164472] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} time: 01:07:58 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164472/ [6164473] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats}} time: 00:13:43 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164473/ [6164474] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 01:14:55 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164474/ [6164475] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} time: 00:42:15 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164475/ [6164476] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}} time: 00:31:38 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164476/ [6164477] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress}} time: 00:16:20 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164477/ [6164478] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} time: 00:44:02 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164478/ [6164479] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace} time: 00:09:25 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164479/ [6164480] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx}} time: 00:20:38 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164480/ [6164481] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} time: 00:19:41 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164481/ [6164482] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}} time: 00:15:29 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164482/ [6164483] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cap-flush} time: 00:13:21 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164483/ [6164484] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} time: 00:11:14 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164484/ [6164485] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}} time: 00:21:49 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164485/ [6164486] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen}} time: 00:57:59 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164486/ [6164487] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}} time: 00:21:03 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164487/ [6164488] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits} time: 00:21:52 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164488/ [6164489] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone}} time: 00:17:55 info: http://pulpito.ceph.com/pdonnell-2021-06-10_06:02:45-fs-wip-pdonnell-testing-20210610.025127-distro-basic-smithi/6164489/