2021-05-04T05:05:50.205 INFO:root:teuthology version: 1.1.0-19220a3b
2021-05-04T05:05:50.207 INFO:teuthology.results:subset: '5/32'
2021-05-04T05:05:50.207 INFO:teuthology.results:seed: '9852'
2021-05-04T08:50:42.742 INFO:root:teuthology version: 1.1.0-19220a3b
2021-05-04T08:50:42.776 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-05-04T11:18:55.221 INFO:teuthology.results:Tests finished! gathering results...
2021-05-04T11:19:18.157 INFO:scrape:Found 261 jobs
2021-05-04T11:19:36.821 INFO:scrape:Found 13 distinct failure reasons
2021-05-04T11:19:36.822 INFO:scrape:Failure: "2021-05-04T08:59:34.201609+0000 mds.k (mds.1) 18 : cluster [WRN] Scrub error on inode 0x10000005f8c (/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-64.xml) see mds.k log and `damage ls` output for details" in cluster log
2021-05-04T11:19:36.823 INFO:scrape:1 jobs: ['6089159']
2021-05-04T11:19:36.823 INFO:scrape:suites: ['clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{rhel_8}', 'fs/workload/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'ranks/3', 'rhel_8}', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/blogbench}}']
2021-05-04T11:19:36.824 INFO:scrape:
2021-05-04T11:19:36.824 INFO:scrape:Failure: Test failure: test_full_fsync (tasks.cephfs.test_full.TestClusterFull)
2021-05-04T11:19:36.825 INFO:scrape:1 jobs: ['6088992']
2021-05-04T11:19:36.825 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/mds-full}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.826 INFO:scrape:
2021-05-04T11:19:36.826 INFO:scrape:Crash: Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi018 with status 23: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=717ce59b76c659aaef8c5aec1355c0ac5cef7234 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh'
2021-05-04T11:19:36.826 INFO:scrape:ceph version 16.2.1-257-g717ce59b (717ce59b76c659aaef8c5aec1355c0ac5cef7234) pacific (stable)
 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0) [0x7fa27476b3c0]
 2: gsignal()
 3: abort()
 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1ad) [0x7fa274c87eb2]
 5: /usr/lib/ceph/libceph-common.so.2(+0x26405f) [0x7fa274c8805f]
 6: (Monitor::~Monitor()+0x144b) [0x56396634fdfb]
 7: (Monitor::~Monitor()+0xd) [0x56396634fe7d]
 8: main()
 9: __libc_start_main()
 10: _start()
2021-05-04T11:19:36.827 INFO:scrape:2 jobs: ['6089154', '6088942']
2021-05-04T11:19:36.827 INFO:scrape:suites intersection: ['clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs/workload/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/fs/misc}}']
2021-05-04T11:19:36.828 INFO:scrape:suites union: ['clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'fs/workload/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'ranks/3', 'ranks/5', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/fs/misc}}']
2021-05-04T11:19:36.828 INFO:scrape:
2021-05-04T11:19:36.829 INFO:scrape:Failure: {'Failure object was': {'smithi072.front.sepia.ceph.com': {'msg': 'non-zero return code', 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'stdout': '', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out (service_start_timeout=25000ms)", 'rc': 1, 'start': '2021-05-04 08:53:03.735815', 'end': '2021-05-04 08:53:28.765163', 'delta': '0:00:25.029348', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'timedatectl set-timezone Etc/UTC', 'warn': True, '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': 'None', 'chdir': 'None', 'executable': 'None', 'creates': 'None', 'removes': 'None', 'stdin': 'None'}}, 'stdout_lines': [], 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out (service_start_timeout=25000ms)"], '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}
2021-05-04T11:19:36.829 INFO:scrape:1 jobs: ['6089170']
2021-05-04T11:19:36.830 INFO:scrape:suites: ['clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_8}', 'fs/workload/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'ranks/5', 'rhel_8}', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/fsstress}}']
2021-05-04T11:19:36.830 INFO:scrape:
2021-05-04T11:19:36.831 INFO:scrape:Failure: Command failed on smithi092 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 717ce59b76c659aaef8c5aec1355c0ac5cef7234'
2021-05-04T11:19:36.831 INFO:scrape:1 jobs: ['6088938']
2021-05-04T11:19:36.832 INFO:scrape:suites: ['1-client', '2-upgrade', '3-compat_client/no}}', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap', 'mds', 'mon', 'multimds/no', 'osd}', 'overrides/{frag_enable', 'pg-warn', 'tasks/{0-nautilus', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.832 INFO:scrape:
2021-05-04T11:19:36.833 INFO:scrape:Failure: Test failure: test_client_abort (tasks.cephfs.test_failover.TestFailover)
2021-05-04T11:19:36.833 INFO:scrape:2 jobs: ['6089021', '6088979']
2021-05-04T11:19:36.833 INFO:scrape:suites intersection: ['clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/multifs/{begin', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'osd}', 'overrides/{frag_enable', 'tasks/failover}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.834 INFO:scrape:suites union: ['clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/multifs/{begin', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{frag_enable', 'tasks/failover}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.834 INFO:scrape:
2021-05-04T11:19:36.835 INFO:scrape:Failure: Command failed on smithi200 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest'
2021-05-04T11:19:36.835 INFO:scrape:2 jobs: ['6088972', '6089151']
2021-05-04T11:19:36.836 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.836 INFO:scrape:suites union: ['1-client', '2-upgrade', '3-verify}', 'clusters/1-mds-2-client-micro', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'distro~HEAD/{ubuntu_latest}', 'fs/upgrade/volumes/import-legacy/{bluestore-bitmap', 'fs/verify/{begin', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{frag_enable', 'pg-warn', 'ranks/5', 'session_timeout', 'tasks/dbench', 'tasks/{0-nautilus', 'ubuntu_18.04}', 'validater/valgrind}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.836 INFO:scrape:
2021-05-04T11:19:36.837 INFO:scrape:Failure: Test failure: test_delete_object (tasks.cephfs.test_volume_client.TestVolumeClient)
2021-05-04T11:19:36.838 INFO:scrape:2 jobs: ['6089144', '6088959']
2021-05-04T11:19:36.838 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/volumes/{begin', 'mds', 'mon', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/volume-client}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.839 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'fs/volumes/{begin', 'k-testing}', 'mds', 'mon', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/volume-client}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.840 INFO:scrape:
2021-05-04T11:19:36.840 INFO:scrape:Failure: Test failure: test_stale_write_caps (tasks.cephfs.test_client_recovery.TestClientRecovery)
2021-05-04T11:19:36.840 INFO:scrape:1 jobs: ['6089146']
2021-05-04T11:19:36.841 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'tasks/client-recovery}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.841 INFO:scrape:
2021-05-04T11:19:36.842 INFO:scrape:Failure: Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)
2021-05-04T11:19:36.842 INFO:scrape:2 jobs: ['6089150', '6088933']
2021-05-04T11:19:36.843 INFO:scrape:suites intersection: ['clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_8}', 'fs/multifs/{begin', 'k-testing}', 'mds', 'mon', 'mon-debug', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/multifs-auth}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.843 INFO:scrape:suites union: ['clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_8}', 'fs/multifs/{begin', 'k-testing}', 'mds', 'mon', 'mon-debug', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/multifs-auth}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.844 INFO:scrape:
2021-05-04T11:19:36.844 INFO:scrape:Failure: Test failure: test_object_deletion (tasks.cephfs.test_damage.TestDamage)
2021-05-04T11:19:36.844 INFO:scrape:1 jobs: ['6089155']
2021-05-04T11:19:36.845 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/damage}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.845 INFO:scrape:
2021-05-04T11:19:36.846 INFO:scrape:Failure: Command failed (workunit test fs/quota/quota.sh) on smithi080 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=717ce59b76c659aaef8c5aec1355c0ac5cef7234 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh'
2021-05-04T11:19:36.846 INFO:scrape:1 jobs: ['6089084']
2021-05-04T11:19:36.847 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'rhel_8}', 'tasks/workunit/quota}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.847 INFO:scrape:
2021-05-04T11:19:36.848 INFO:scrape:Failure: "2021-05-04T06:28:07.767037+0000 mon.a (mon.0) 1528 : cluster [WRN] Replacing daemon mds.c as rank 0 with standby daemon mds.b" in cluster log
2021-05-04T11:19:36.848 INFO:scrape:1 jobs: ['6088994']
2021-05-04T11:19:36.848 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/volumes/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/volumes/{overrides', 'test/basic}}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2021-05-04T11:19:36.849 INFO:scrape:
2021-05-04T11:19:36.861 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/
failed:  16
dead:    2
running: 0
waiting: 0
queued:  0
passed:  243


Fail
=================================================================
[6088933]  fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}
-----------------------------------------------------------------
time:   00:11:30
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088933/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088933/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a8ac01f8046a4d3ab6bf938a82d60a22

    Test failure: test_mount_all_caps_absent
    (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)

[6088938]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}}
-----------------------------------------------------------------
time:   00:07:33
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088938/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088938/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c558f8a59e4449e3afe7f48a43eb060e

    Command failed on smithi092 with status 128: 'rm -rf
    /home/ubuntu/cephtest/clone.client.0 && git clone
    https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd
    /home/ubuntu/cephtest/clone.client.0 && git checkout
    717ce59b76c659aaef8c5aec1355c0ac5cef7234'

[6088942]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc}}
-----------------------------------------------------------------
time:   03:26:21
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088942/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088942/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9ed8d339a30a4cd88a8c571afa771d5c

    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi117 with
    status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=717ce59b76c659aaef8c5aec1355c0ac5cef7234
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/fs/misc/multiple_rsync.sh'

[6088959]  fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volume-client}
-----------------------------------------------------------------
time:   00:16:32
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088959/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088959/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fb495d4a425a4f71beb837a076d9bc7a

    Test failure: test_delete_object
    (tasks.cephfs.test_volume_client.TestVolumeClient)

[6088972]  fs/upgrade/volumes/import-legacy/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04}
-----------------------------------------------------------------
time:   01:10:22
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088972/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088972/

    Command failed on smithi200 with status 1: 'find /home/ubuntu/cephtest -ls
    ; rmdir -- /home/ubuntu/cephtest'

[6088979]  fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover}
-----------------------------------------------------------------
time:   00:25:48
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088979/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088979/
sentry: https://sentry.ceph.com/organizations/ceph/?query=582c8e7f3754407bab7e3784d993f449

    Test failure: test_client_abort (tasks.cephfs.test_failover.TestFailover)

[6088992]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full}
-----------------------------------------------------------------
time:   00:17:50
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088992/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088992/
sentry: https://sentry.ceph.com/organizations/ceph/?query=56bf7b144cb843bc94b484ede8072368

    Test failure: test_full_fsync (tasks.cephfs.test_full.TestClusterFull)

[6088994]  fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}}
-----------------------------------------------------------------
time:   00:51:13
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088994/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088994/

    "2021-05-04T06:28:07.767037+0000 mon.a (mon.0) 1528 : cluster [WRN]
    Replacing daemon mds.c as rank 0 with standby daemon mds.b" in cluster log

[6089021]  fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover}
-----------------------------------------------------------------
time:   00:25:17
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089021/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089021/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bb9deeb8887c4af3830bfe672b2eb5c8

    Test failure: test_client_abort (tasks.cephfs.test_failover.TestFailover)

[6089084]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/workunit/quota}
-----------------------------------------------------------------
time:   00:13:51
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089084/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089084/
sentry: https://sentry.ceph.com/organizations/ceph/?query=058bb60f5f7f4fefa7beb57e1b86f3e6

    Command failed (workunit test fs/quota/quota.sh) on smithi080 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd --
    /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=717ce59b76c659aaef8c5aec1355c0ac5cef7234
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh'

[6089144]  fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volume-client}
-----------------------------------------------------------------
time:   00:15:32
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089144/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089144/
sentry: https://sentry.ceph.com/organizations/ceph/?query=65f946039955438eab7043d51ece2b00

    Test failure: test_delete_object
    (tasks.cephfs.test_volume_client.TestVolumeClient)

[6089150]  fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}
-----------------------------------------------------------------
time:   00:12:01
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089150/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089150/
sentry: https://sentry.ceph.com/organizations/ceph/?query=049e5cb9463c4d5ea403107049e70667

    Test failure: test_mount_all_caps_absent
    (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)

[6089151]  fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} distro~HEAD/{ubuntu_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/dbench validater/valgrind}
-----------------------------------------------------------------
time:   01:55:46
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089151/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089151/
sentry: https://sentry.ceph.com/organizations/ceph/?query=971cc4097e3944b6924de3fd0d0de12f

    Command failed on smithi103 with status 1: 'sudo ceph --cluster ceph osd
    crush tunables default'

[6089154]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc}}
-----------------------------------------------------------------
time:   00:46:24
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089154/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089154/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e56f0c7b7aa14d2aa8cf14685097b537

    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi018 with
    status 23: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=717ce59b76c659aaef8c5aec1355c0ac5cef7234
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/fs/misc/multiple_rsync.sh'

[6089155]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/damage}
-----------------------------------------------------------------
time:   00:20:37
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089155/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089155/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5e1b6553adad46bd86d339a404e4a4a7

    Test failure: test_object_deletion (tasks.cephfs.test_damage.TestDamage)

[6089159]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench}}
-----------------------------------------------------------------
time:   00:31:14
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089159/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089159/

    "2021-05-04T08:59:34.201609+0000 mds.k (mds.1) 18 : cluster [WRN] Scrub
    error on inode 0x10000005f8c
    (/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-64.xml) see
    mds.k log and `damage ls` output for details" in cluster log



Dead
=================================================================
[6089146]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery}
-----------------------------------------------------------------
time:   00:49:27
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089146/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089146/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e7010b62ace944719c740e650e0ac19f

    Test failure: test_stale_write_caps
    (tasks.cephfs.test_client_recovery.TestClientRecovery)

[6089170]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   00:07:56
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089170/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089170/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e0f4a5a5ee84486981c4cb5bc34ebfef

    {'Failure object was': {'smithi072.front.sepia.ceph.com': {'msg': 'non-zero
    return code', 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'stdout':
    '', 'stderr': "Failed to set time zone: Failed to activate service
    'org.freedesktop.timedate1': timed out (service_start_timeout=25000ms)",
    'rc': 1, 'start': '2021-05-04 08:53:03.735815', 'end': '2021-05-04
    08:53:28.765163', 'delta': '0:00:25.029348', 'changed': True, 'invocation':
    {'module_args': {'_raw_params': 'timedatectl set-timezone Etc/UTC', 'warn':
    True, '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends':
    True, 'argv': 'None', 'chdir': 'None', 'executable': 'None', 'creates':
    'None', 'removes': 'None', 'stdin': 'None'}}, 'stdout_lines': [],
    'stderr_lines': ["Failed to set time zone: Failed to activate service
    'org.freedesktop.timedate1': timed out (service_start_timeout=25000ms)"],
    '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File
    "/home/teuthworker/src/git.ceph.com_git_ceph-cm-
    ansible_master/callback_plugins/failure_log.py", line 44, in log_failure
    log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com
    _git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/pyt
    hon3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return
    dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker
    /src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/v
    irtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in
    dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_gi
    t_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python
    3.6/site-packages/yaml/representer.py", line 27, in represent node =
    self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teut
    hology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/si
    te-packages/yaml/representer.py", line 48, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/vir
    tualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in
    represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\',
    data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e25
    2c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 118, in represent_mapping node_value =
    self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi
    t_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python
    3.6/site-packages/yaml/representer.py", line 48, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/vir
    tualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in
    represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\',
    data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e25
    2c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 117, in represent_mapping node_key =
    self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_
    teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.
    6/site-packages/yaml/representer.py", line 58, in represent_data node =
    self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce
    ph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/l
    ib/python3.6/site-packages/yaml/representer.py", line 231, in
    represent_undefined raise RepresenterError("cannot represent an object",
    data)', 'yaml.representer.RepresenterError': "('cannot represent an
    object', 'changed')"}



Pass
=================================================================
[6088919] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen}}
time:   01:03:02
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088919/

[6088920] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}}
time:   00:16:46
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088920/

[6088921] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits}
time:   00:20:12
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088921/

[6088922] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone}}
time:   00:16:15
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088922/

[6088923] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}}
time:   00:15:22
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088923/

[6088924] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd}}
time:   00:11:47
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088924/

[6088925] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:12:37
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088925/

[6088926] fs/bugs/client_trim_caps/{begin clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/trim-i24137}
time:   00:08:49
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088926/

[6088927] fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/centos_latest}
time:   00:43:02
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088927/

[6088928] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead}
time:   00:13:48
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088928/

[6088929] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client}
time:   00:09:15
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088929/

[6088930] fs/mirror/{begin cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{ubuntu_latest} tasks/mirror}
time:   01:05:14
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088930/

[6088931] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   01:36:56
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088931/

[6088932] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}
time:   00:18:49
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088932/

[6088934] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:14:07
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088934/

[6088935] fs/shell/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cephfs-shell}
time:   00:34:46
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088935/

[6088936] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:14:20
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088936/

[6088937] fs/top/{begin cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/whitelist_health supported-random-distros$/{centos_8} tasks/fstop}
time:   00:09:24
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088937/

[6088939] fs/valgrind/{begin centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}}
time:   01:15:14
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088939/

[6088940] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} distro~HEAD/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/fsstress validater/lockdep}
time:   00:13:32
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088940/

[6088941] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io}}
time:   00:14:12
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088941/

[6088943] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
time:   01:08:39
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088943/

[6088944] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build}}
time:   00:42:13
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088944/

[6088945] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery}
time:   00:30:46
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088945/

[6088946] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}
time:   00:44:29
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088946/

[6088947] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench}}
time:   00:18:04
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088947/

[6088948] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}}
time:   00:19:12
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088948/

[6088949] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench}}
time:   01:52:31
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088949/

[6088950] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/damage}
time:   00:18:51
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088950/

[6088951] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb}}
time:   00:22:57
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088951/

[6088952] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}
time:   00:13:09
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088952/

[6088953] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats}}
time:   00:14:25
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088953/

[6088954] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan}
time:   00:26:30
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088954/

[6088955] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}}
time:   00:20:03
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088955/

[6088956] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress}}
time:   00:16:00
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088956/

[6088957] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:34:40
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088957/

[6088958] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc}
time:   00:20:00
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088958/

[6088960] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}}
time:   00:11:48
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088960/

[6088961] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx}}
time:   00:24:01
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088961/

[6088962] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/exports}
time:   00:53:09
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088962/

[6088963] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}}
time:   00:14:08
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088963/

[6088964] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/ffsb}}
time:   00:22:18
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088964/

[6088965] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}}
time:   00:21:58
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088965/

[6088966] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:11:02
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088966/

[6088967] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub}
time:   00:14:49
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088967/

[6088968] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:15:10
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088968/

[6088969] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
time:   01:40:26
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088969/

[6088970] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen}}
time:   00:39:58
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088970/

[6088971] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}
time:   00:22:21
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088971/

[6088973] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone}}
time:   00:15:45
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088973/

[6088974] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/fragment}
time:   00:19:17
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088974/

[6088975] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd}}
time:   00:15:54
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088975/

[6088976] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}}
time:   00:19:45
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088976/

[6088977] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   01:15:22
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088977/

[6088978] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file}
time:   00:11:16
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088978/

[6088980] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} distro~HEAD/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/dbench validater/valgrind}
time:   00:59:29
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088980/

[6088981] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io}}
time:   00:13:42
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088981/

[6088982] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}
time:   00:13:52
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088982/

[6088983] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair}
time:   00:19:05
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088983/

[6088984] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc}}
time:   00:53:51
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088984/

[6088985] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}}
time:   00:15:51
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088985/

[6088986] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build}}
time:   00:39:17
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088986/

[6088987] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush}
time:   00:14:14
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088987/

[6088988] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench}}
time:   00:32:13
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088988/

[6088989] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}}
time:   00:15:43
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088989/

[6088990] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench}}
time:   00:57:09
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088990/

[6088991] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/iozone}}
time:   00:17:24
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088991/

[6088993] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb}}
time:   00:50:05
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088993/

[6088995] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
time:   00:58:59
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088995/

[6088996] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats}}
time:   00:15:56
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088996/

[6088997] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:16:04
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088997/

[6088998] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds_creation_retry}
time:   00:08:51
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088998/

[6088999] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/ino_release_cb}
time:   00:09:08
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6088999/

[6089000] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:09:40
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089000/

[6089001] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress}}
time:   00:17:27
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089001/

[6089002] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}}
time:   00:48:51
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089002/

[6089003] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx}}
time:   00:29:57
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089003/

[6089004] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}}
time:   00:17:12
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089004/

[6089005] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   01:05:03
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089005/

[6089006] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc}
time:   00:44:02
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089006/

[6089007] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}}
time:   00:12:59
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089007/

[6089008] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/metrics}
time:   00:21:07
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089008/

[6089009] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}
time:   00:13:40
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089009/

[6089010] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
time:   00:18:33
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089010/

[6089011] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}}
time:   00:23:49
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089011/

[6089012] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen}}
time:   00:25:12
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089012/

[6089013] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/multimds_misc}
time:   00:20:58
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089013/

[6089014] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}}
time:   00:20:32
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089014/

[6089015] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone}}
time:   00:17:37
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089015/

[6089016] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}}
time:   00:14:20
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089016/

[6089017] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd}}
time:   00:12:44
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089017/

[6089018] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/openfiletable}
time:   00:16:20
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089018/

[6089019] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   00:39:30
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089019/

[6089020] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/mdtest}
time:   00:11:36
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089020/

[6089022] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}}
time:   03:46:46
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089022/

[6089023] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} distro~HEAD/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/fsstress validater/lockdep}
time:   00:13:37
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089023/

[6089024] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io}}
time:   00:16:15
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089024/

[6089025] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc}}
time:   00:46:34
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089025/

[6089026] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
time:   01:03:01
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089026/

[6089027] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm}
time:   00:11:47
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089027/

[6089028] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build}}
time:   00:37:17
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089028/

[6089029] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}
time:   00:44:16
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089029/

[6089030] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench}}
time:   00:28:03
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089030/

[6089031] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:10:37
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089031/

[6089032] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/quota}
time:   00:14:07
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089032/

[6089033] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:10:50
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089033/

[6089034] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/fsstress}}
time:   00:18:59
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089034/

[6089035] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench}}
time:   00:42:19
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089035/

[6089036] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}}
time:   00:37:22
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089036/

[6089037] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb}}
time:   00:56:06
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089037/

[6089038] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}
time:   00:11:21
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089038/

[6089039] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/scrub}
time:   00:25:53
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089039/

[6089040] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats}}
time:   00:16:19
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089040/

[6089041] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/iozone}}
time:   00:12:10
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089041/

[6089042] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress}}
time:   00:16:04
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089042/

[6089043] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap}
time:   00:14:10
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089043/

[6089044] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/pjd}}
time:   00:16:01
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089044/

[6089045] fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}}
time:   00:19:42
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089045/

[6089046] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx}}
time:   00:20:21
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089046/

[6089047] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}}
time:   00:15:22
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089047/

[6089048] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:18:49
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089048/

[6089049] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
time:   00:16:52
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089049/

[6089050] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}}
time:   00:23:29
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089050/

[6089051] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:42:42
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089051/

[6089052] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc}
time:   01:24:40
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089052/

[6089053] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
time:   01:05:53
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089053/

[6089054] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen}}
time:   00:54:16
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089054/

[6089055] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snapshots}
time:   00:22:51
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089055/

[6089056] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}
time:   00:44:37
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089056/

[6089057] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone}}
time:   00:14:47
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089057/

[6089058] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd}}
time:   00:15:36
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089058/

[6089059] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/fsstress}}
time:   00:13:51
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089059/

[6089060] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:10:12
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089060/

[6089061] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/strays}
time:   00:30:18
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089061/

[6089062] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs}
time:   00:12:14
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089062/

[6089063] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   01:00:15
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089063/

[6089064] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}
time:   00:19:38
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089064/

[6089065] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}
time:   00:22:56
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089065/

[6089066] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:14:02
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089066/

[6089067] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} distro~HEAD/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/dbench validater/valgrind}
time:   00:59:03
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089067/

[6089068] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io}}
time:   00:14:04
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089068/

[6089069] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}
time:   00:13:42
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089069/

[6089070] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc}}
time:   00:59:28
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089070/

[6089071] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/iozone}}
time:   00:19:52
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089071/

[6089072] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build}}
time:   01:28:04
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089072/

[6089073] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/test_journal_migration}
time:   00:18:01
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089073/

[6089074] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/misc}}
time:   00:21:15
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089074/

[6089075] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench}}
time:   00:32:59
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089075/

[6089076] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/pjd}}
time:   00:14:28
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089076/

[6089077] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench}}
time:   01:09:09
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089077/

[6089078] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/truncate_delay}
time:   00:13:47
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089078/

[6089079] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:17:29
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089079/

[6089080] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb}}
time:   00:52:51
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089080/

[6089081] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
time:   02:09:52
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089081/

[6089082] fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}}
time:   00:27:26
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089082/

[6089083] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats}}
time:   00:12:48
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089083/

[6089085] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress}}
time:   00:18:34
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089085/

[6089086] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/ffsb}}
time:   00:42:27
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089086/

[6089087] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx}}
time:   00:27:38
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089087/

[6089088] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls}
time:   00:14:37
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089088/

[6089089] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/fsstress}}
time:   00:18:12
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089089/

[6089090] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}}
time:   00:12:58
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089090/

[6089091] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}
time:   00:11:31
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089091/

[6089092] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}}
time:   00:23:45
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089092/

[6089093] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:16:03
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089093/

[6089094] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin}
time:   00:38:35
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089094/

[6089095] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:11:18
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089095/

[6089096] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen}}
time:   01:05:54
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089096/

[6089097] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/iozone}}
time:   00:14:15
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089097/

[6089098] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   01:26:55
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089098/

[6089099] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc}
time:   00:13:37
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089099/

[6089100] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone}}
time:   00:18:09
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089100/

[6089101] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/alternate-pool}
time:   00:12:11
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089101/

[6089102] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/pjd}}
time:   00:15:04
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089102/

[6089103] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd}}
time:   00:14:56
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089103/

[6089104] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   01:18:14
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089104/

[6089105] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file}
time:   00:09:49
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089105/

[6089106] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover}
time:   01:28:41
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089106/

[6089107] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:12:01
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089107/

[6089108] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} distro~HEAD/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/fsstress validater/lockdep}
time:   00:17:39
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089108/

[6089109] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io}}
time:   00:16:57
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089109/

[6089110] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/snapshot}}
time:   00:23:01
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089110/

[6089111] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/asok_dump_tree}
time:   00:22:35
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089111/

[6089112] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc}}
time:   00:31:54
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089112/

[6089113] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
time:   00:55:19
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089113/

[6089114] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build}}
time:   00:49:16
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089114/

[6089115] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}
time:   00:36:07
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089115/

[6089116] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair}
time:   00:13:57
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089116/

[6089117] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench}}
time:   00:25:58
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089117/

[6089118] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/fsstress}}
time:   00:15:55
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089118/

[6089119] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
time:   00:19:20
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089119/

[6089120] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench}}
time:   00:56:16
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089120/

[6089121] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace}
time:   00:13:29
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089121/

[6089122] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb}}
time:   00:21:40
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089122/

[6089123] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}
time:   00:13:05
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089123/

[6089124] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats}}
time:   00:16:29
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089124/

[6089125] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/iozone}}
time:   00:18:41
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089125/

[6089126] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:13:54
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089126/

[6089127] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cap-flush}
time:   00:11:48
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089127/

[6089128] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs_python}
time:   00:08:50
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089128/

[6089129] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:11:17
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089129/

[6089130] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress}}
time:   00:15:35
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089130/

[6089131] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/pjd}}
time:   00:14:30
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089131/

[6089132] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx}}
time:   01:07:29
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089132/

[6089133] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}}
time:   00:15:10
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089133/

[6089134] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits}
time:   00:18:55
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089134/

[6089135] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/ffsb}}
time:   00:40:07
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089135/

[6089136] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}}
time:   00:23:31
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089136/

[6089137] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
time:   02:58:00
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089137/

[6089138] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen}}
time:   00:43:35
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089138/

[6089139] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead}
time:   00:13:16
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089139/

[6089140] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}
time:   00:43:39
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089140/

[6089141] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone}}
time:   00:17:24
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089141/

[6089142] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:42:20
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089142/

[6089143] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc}
time:   00:22:31
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089143/

[6089145] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd}}
time:   00:15:11
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089145/

[6089147] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/fsstress}}
time:   00:18:38
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089147/

[6089148] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   01:12:55
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089148/

[6089149] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/mdtest}
time:   00:17:31
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089149/

[6089152] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io}}
time:   00:16:17
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089152/

[6089153] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}
time:   00:11:27
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089153/

[6089156] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/iozone}}
time:   00:14:48
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089156/

[6089157] fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}}
time:   00:20:47
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089157/

[6089158] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build}}
time:   01:48:11
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089158/

[6089160] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/pjd}}
time:   00:17:29
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089160/

[6089161] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:02
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089161/

[6089162] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan}
time:   00:27:57
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089162/

[6089163] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:15:28
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089163/

[6089164] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench}}
time:   01:08:50
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089164/

[6089165] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/iozone}}
time:   00:15:14
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089165/

[6089166] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb}}
time:   00:35:32
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089166/

[6089167] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/exports}
time:   00:42:37
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089167/

[6089168] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
time:   00:52:16
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089168/

[6089169] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats}}
time:   00:21:53
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089169/

[6089171] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/ffsb}}
time:   00:40:02
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089171/

[6089172] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub}
time:   00:17:52
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089172/

[6089173] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx}}
time:   00:33:33
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089173/

[6089174] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/fsstress}}
time:   00:15:09
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089174/

[6089175] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}}
time:   00:12:43
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089175/

[6089176] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/fragment}
time:   00:18:01
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089176/

[6089177] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}
time:   00:13:54
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089177/

[6089178] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}}
time:   00:20:35
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089178/

[6089179] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}}
time:   00:45:50
info:   http://pulpito.ceph.com/teuthology-2021-05-02_04:17:02-fs-pacific-distro-basic-smithi/6089179/